All Supported Models

29681 AI models · 198875 quantization formats tracked

F

Fadikkop

1 models

openbuddy-openllama-3b-v10-bf16-Q4_K_M-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q4_0
1.69GB file 3.74GB
F

Fahim8401

1 models

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
F

Failspy

3 models

Llama-3-8B-Instruct-MopeyMule-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Mistral-22B-v0.2-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q3_K_S
9.63GB file 11.99GB
Q3_K_L
9.63GB file 11.99GB
Q3_K
9.63GB file 11.99GB
Q4_K_S
12.38GB file 14.74GB
Q4_K
12.38GB file 14.74GB
Q5_K_S
15.13GB file 17.49GB
Q5_K
15.13GB file 17.49GB
Q6_K
17.88GB file 20.24GB
Q8_0
23.38GB file 25.74GB

Phi-3-medium-4k-instruct-abliterated-v3-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
F

Faiztf06

1 models

llama-3-8b-chat-AIRA

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
F

Fake2025

1 models

EXAONE-3.5-7.8B-Instruct-Q8_0-GGUF

7.8B 8K ctx
Q8_0
8.29GB file 10.42GB
F

Falan42

1 models

tinyllama-medical-chat-v1.4

Unknown 8K ctx
FP16
0GB file 2GB
F

Fallen Merick

3 models

Iced-Lemon-Cookie-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Smart-Lemon-Cookie-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Space-Whale-Lite-13B-GGUF

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB
F

Fallen03

1 models

Llama3.1-8B-Chinese-Chat-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
F

Familorujov

1 models

llama-3.2-3B-financial-sentiment-finetuned-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
F

Fanrey

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB