All Supported Models

29681 AI models · 198875 quantization formats tracked

E

Eanemone

1 models

Law-Guardian-Llama-8B-V2-LoRa-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
E

Earthkwake

1 models

Phi-3-mini-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
E

Easier A I

21 models

Falcon-3-10B

10B 8K ctx
Q2_K
3.13GB file 5.29GB
Q3_K_M
4.38GB file 6.54GB
Q4_0
5.63GB file 7.79GB
Q4_K_M
5.63GB file 7.79GB
Q5_0
6.88GB file 9.04GB
Q5_K_M
6.88GB file 9.04GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB

Falcon-3-1B

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Falcon-3-7B

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Gemma-2-2B

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q6_K_L
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Gemma-2-9B

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q2_K_L
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_L
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_L
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q6_K_L
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Granite-3.1-8B

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_L
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Granite-3.2-2B

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q2_K_L
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_L
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_L
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q6_K_L
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Granite-3.2-8B

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_L
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-3B

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_L
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_L
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_L
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_L
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Mistral-NeMo-12B

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q2_K_L
3.75GB file 5.95GB
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q4_K_L
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q5_K_L
8.25GB file 10.45GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q6_K_L
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Mistral-Small-3-24B

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q2_K_L
7.5GB file 9.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_K_L
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q5_K_L
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q6_K_L
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Phi-4-14B

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen-2.5-0.5B

0.5B 8K ctx
Q3_K_L
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen-2.5-14B

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen-2.5-32B

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_L
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q5_K_L
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_L
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen-2.5-3B

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_L
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_L
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_L
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen-2.5-7B

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen-2.5-Coder-14B

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen-2.5-Coder-32B

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen-2.5-Coder-3B

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen-2.5-Coder-7B

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
E

Ebircak

1 models

gemma-4-31B-it-GGUF

31B 8K ctx
Q4_NL
17.44GB file 19.95GB
Q8_0
32.94GB file 35.45GB
E

Echo Labs33

10 models

qwen2.5-14b-instruct-hxq

14B 8K ctx
FP16
28GB file 30.23GB

qwen2.5-3b-instruct-hxq

3B 8K ctx
FP16
6GB file 8.05GB

qwen2.5-7b-instruct-hxq

7B 8K ctx
FP16
14GB file 16.11GB

qwen2.5-coder-3b-hxq

3B 8K ctx
FP16
6GB file 8.05GB

smollm3-3b-hxq

3B 8K ctx
FP16
6GB file 8.05GB

Zamba2-1.2B-Instruct-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB

Zamba2-1.2B-Instruct-v2-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q8_0
1.28GB file 3.3GB

zamba2-2.7b-instruct-hxq

2.7B 8K ctx
FP16
5.4GB file 7.44GB

Zamba2-2.7B-Instruct-v2-GGUF

2.7B 8K ctx
Q4_0
1.52GB file 3.56GB
Q8_0
2.87GB file 4.91GB

Zamba2-7B-Instruct-v2-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
E

Echo Meow

1 models

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
E

Echos Keeper

13 models

gemma-3-1b-arabic-gec-v1-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

gpt-oss-10.2b-specialized-science-pruned-moe-only-14-experts-Q5_K_M-GGUF

10.2B 8K ctx
Q5_0
7.01GB file 9.18GB
FP16
20.4GB file 22.57GB

gpt-oss-13.1b-specialized-all-pruned-moe-only-19-experts-Q5_K_M-GGUF

13.1B 8K ctx
Q5_0
9.01GB file 11.22GB
FP16
26.2GB file 28.41GB

gpt-oss-13.7b-specialized-all-pruned-moe-only-20-experts-Q5_K_M-GGUF

13.7B 8K ctx
Q5_0
9.42GB file 11.64GB
FP16
27.4GB file 29.62GB

gpt-oss-6.6b-specialized-all-pruned-moe-only-8-experts-Q5_K_M-GGUF

6.6B 8K ctx
Q5_0
4.54GB file 6.65GB
FP16
13.2GB file 15.31GB

gpt-oss-6.6b-specialized-all-pruned-moe-only-8-experts-Q8_0-GGUF

6.6B 8K ctx
Q8_0
7.01GB file 9.12GB

Huihui-Jan-v1-4B-abliterated-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-MOE-6x6B-Star-Trek-Universe-Alpha-D-256k-ctx-36B-Q5_K_M-GGUF

6B 8K ctx
Q5_0
4.13GB file 6.23GB
FP16
12GB file 14.1GB

Qwen3-ST-Deep-Space-Nine-v2-256k-ctx-6B-Q4_K_M-GGUF

6B 8K ctx
Q4_0
3.38GB file 5.48GB
FP16
12GB file 14.1GB

Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-Q4_K_M-GGUF

6B 8K ctx
Q4_0
3.38GB file 5.48GB
FP16
12GB file 14.1GB

smollm2-1.7b-distilled-gpt-oss-20b-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

tiny-summary-v2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
E

Ecorbari

1 models

Gemma-2b-it-Psych-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB
E

Edbuildingstuff

2 models

splashco-drive-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

unhinged-horoscopes

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
E

Edens Gate

1 models

Baldur-KTO

8B 8K ctx
Q8_0
8.5GB file 10.63GB