All Supported Models

29681 AI models · 198875 quantization formats tracked

F

Fedoralinux

1 models

Gemma-4-31B-JANG_4M-CRACK-GGUF

31B 8K ctx
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q8_0
32.94GB file 35.45GB
F

Fedric95

5 models

gemma-2-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
FP32
8GB file 10.03GB

gemma-2-9b-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
FP32
36GB file 38.15GB

gemma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Meta-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
FP16
16GB file 18.13GB

Qwen2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB
F

Feedseawave

1 models

WeDLM-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB
F

Feelconstantfear

1 models

gemma-2-2b-it-abliterated-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
F

Felipe Carlos Ipms

2 models

gemma-portuguese-tom-cat-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
F

Felipe Luiz223

1 models

gemma-3-270m-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB
F

Felipecmarins

1 models

gemma3-4b-algebra4-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
F

Felipepinto

1 models

T3Q-qwen2.5-14b-v1.0-e3-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
F

Felix S A G

1 models

Qwen2.5-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
F

Felladrin

19 models

gguf-llama-160m

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

gguf-MXFP4-gpt-oss-20b-Derestricted

20B 8K ctx
FP4
20GB file 22.33GB

gguf-Q4_0-Qwen2.5-Coder-32B-Instruct

32B 8K ctx
Q4_0
18GB file 20.52GB

gguf-Q4_0-Qwen2.5-Coder-32B-Instruct-abliterated

32B 8K ctx
Q4_0
18GB file 20.52GB

gguf-Q4_K_S-1.5-Pints-16K-v0.1

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

gguf-Q4_K_S-MiniCPM4-0.5B-QAT-Int4-unquantized

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

gguf-q5_k_m-h2o-danube3-500m-chat

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

gguf-q5_k_m-imat-qwen2-0.5b-instruct

0.5B 8K ctx
Q5_0
0.34GB file 2.35GB
FP16
1GB file 3.01GB

gguf-Q5_K_M-LlamaCorn-1.1B-Chat

1.1B 8K ctx
Q5_0
0.76GB file 2.78GB
FP16
2.2GB file 4.22GB

gguf-Q5_K_M-NanoLM-0.3B-Instruct-v2

0.3B 8K ctx
Q5_0
0.21GB file 2.21GB
FP16
0.6GB file 2.6GB

gguf-Q5_K_M-NanoLM-1B-Instruct-v2

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

gguf-Q5_K_M-NanoLM-70M-Instruct-v1

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

gguf-q5_k_m-phi-3.5-mini-instruct

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB

gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

0.5B 8K ctx
Q5_0
0.34GB file 2.35GB
FP16
1GB file 3.01GB

gguf-Q5_K_M-Qwen3-4B-Merge-Variant-01

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

gguf-Q8_0-LaMini-Flan-T5-248M

Unknown 8K ctx
Q8_0
0GB file 2GB

gguf-Q8_0-Qwen2.5-Coder-1.5B-Instruct

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

gguf-sharded-LaMini-Flan-T5-248M

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

gguf-sharded-Qwen2-1.5B-Instruct-imat

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB