All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kms7530

3 models

chemeng_phi-3-mini-4k-instruct-bnb-4bit_16_4_100_1_nonmath

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

chemeng_qwen-math-7b_24_1_100_1_nonmath

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

qwen2.5-0.5B-RAG-ko-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
K

Knightluffy

2 models

phi3-asp

Unknown 8K ctx
Q8_0
0GB file 2GB

qwen34bfine1

34B 8K ctx
FP16
68GB file 70.56GB
K

Knoopx

1 models

Qwen3.6-35B-A3B-NVFP4-GGUF

35B 8K ctx
FP4
35GB file 37.57GB
BF16
70GB file 72.57GB
K

Knut Jaegersberg

16 models

2-bit-LLMs

Unknown 8K ctx
FP16
0GB file 2GB

Apriel-1.5-15b-Thinker-Q8_0-GGUF

15B 8K ctx
Q8_0
15.94GB file 18.19GB

Apriel-5B-Instruct-llamafied-Q8_0-GGUF

5B 8K ctx
Q8_0
5.31GB file 7.39GB

BuddhismModel

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

JoyAI-LLM-Flash-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

K2-Think-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Llama-3.1-Tulu-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

marin-32b-base-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

NuExtract-1.5-tiny-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Teuken-7B-instruct-commercial-v0.4-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Teuken-7B-instruct-commercial-v0.4-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Teuken-7B-instruct-research-v0.4-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Teuken-7B-instruct-research-v0.4-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

tildeopen-30b-mu-instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

tildeopen-30b-mu-instruct-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Tri-21B-Think-gguf

21B 8K ctx
FP16
42GB file 44.34GB
K

Kobold A I

4 models

LLaMA2-13B-Erebus-v3-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K_M
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Mistral-7B-Erebus-v3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-7B-Holodeck-1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mixtral-8x7B-Holodeck-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
K

Kobu2

2 models

HELVETE-X-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Llama-3-Groq-8B-Tool-Use-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
K

Kodedsoft

1 models

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_K_XL
0.84GB file 2.88GB
Q2_M
0.84GB file 2.88GB
Q2_XXS
0.84GB file 2.88GB
Q3_K_M
1.18GB file 3.22GB
Q3_K_S
1.18GB file 3.22GB
Q3_K_XL
1.18GB file 3.22GB
Q3_S
1.18GB file 3.22GB
Q3_XXS
1.18GB file 3.22GB
Q4_K_M
1.52GB file 3.56GB
Q4_K_S
1.52GB file 3.56GB
Q4_K_XL
1.52GB file 3.56GB
Q4_NL
1.52GB file 3.56GB
Q4_XS
1.52GB file 3.56GB
Q5_K_M
1.86GB file 3.9GB
Q5_K_S
1.86GB file 3.9GB
Q5_K_XL
1.86GB file 3.9GB
Q6_K
2.19GB file 4.23GB
Q6_K_XL
2.19GB file 4.23GB
FP4
2.7GB file 4.74GB
Q1_M
2.7GB file 4.74GB
Q8_0
2.87GB file 4.91GB
Q8_K_XL
2.87GB file 4.91GB
BF16
5.4GB file 7.44GB
K

Kodiboynton

2 models

talos-inquisitor-v5

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

talos-sentinel-v5

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
K

Koesn

6 models

FuseChat-7B-VaRM-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Llama3.1-8B-Cobalt-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3.1-8B-Enigma-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3.1-8B-Fireplace2-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-7B-v0.1-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
K

Kof1467

1 models

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB