All Supported Models

29681 AI models · 198875 quantization formats tracked

F

Flyingfishinwater

1 models

starcoder2-3b-instruct-gguf

3B 8K ctx
Q8_0
3.19GB file 5.24GB
F

Flypg

1 models

DeepSeek-R1-Distill-Qwen-14B-Japanese-chat-quant

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
FP16
28GB file 30.23GB
F

Fnasrin

1 models

medical-chatbot

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
F

Fooideal

1 models

Huihui-gpt-oss-20b-BF16-abliterated-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
F

Forcemultiplier

1 models

GlassPolymorphicHTML-Qwen3-VL-4B-Instruct-adapter

4B 8K ctx
BF16
8GB file 10.07GB
F

Forestiak

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
F

Forkjoin Ai

31 models

buleyean-qwen2.5-0.5b

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

buleyean-smollm2-360m

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB

deepseek-r1-distill-qwen-1.5b-gguf

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB

deepseek-r1-distill-qwen-7b-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

dolphin-2.9.1-yi-1.5-34b-gguf

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

gemma-3-12b-it-gguf

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

gemma-3-1b-it-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

gemma-3-4b-it-gguf

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

glm-4-9b-gguf

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

gpt-oss-20b-gguf

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB

llama-2-70b-chat-gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

llama-3.1-70b-instruct-gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

llama-3.1-8b-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

llama-3.1-8b-instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

llama-3.2-1b-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

llama-3.2-1b-instruct-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

llama-3.2-3b-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

llama-3.2-3b-instruct-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

llama-3.3-70b-instruct-gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

meta-llama-3-8b-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

meta-llama-3-8b-instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

mistral-7b-instruct-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

nanbeige-3b-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

nvidia-nemotron-3-nano-30b-a3b-bf16-gguf

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB

personaplex-7b-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

qwen2.5-0.5b-instruct-gguf

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

qwen2.5-1.5b-instruct-gguf

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

qwen2.5-3b-instruct-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

qwen2.5-coder-7b-instruct-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

rwkv7-2.9b-world-gguf

2.9B 8K ctx
Q4_0
1.63GB file 3.68GB
FP16
5.8GB file 7.85GB

tinyllama-1.1b-gguf

1.1B 8K ctx
Q4_K_M
0.62GB file 2.64GB
F

Formul A I

1 models

Llama-3.2-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
F

Forrestrun

1 models

Llama3-8B-Chinese-Chat-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
F

Fortytwo Network

1 models

Strand-Rust-Coder-14B-v1-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB