All Supported Models

29681 AI models · 198875 quantization formats tracked

F

Fanshanga

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
F

Fantominsight

3 models

YAPPERTAR-ai-32B-1.0

32B 8K ctx
Q2_K
10GB file 12.52GB

YAPPERTAR-ai-5B-1.0

5B 8K ctx
FP16
10GB file 12.08GB

YAPPERTAR-ai-v1-1b-for-train

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB
F

Farhaan Farru

1 models

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
F

Farhan Ahmad

1 models

llama-3-70b-quantised

70B 8K ctx
Q5_K_S
48.13GB file 51.28GB
F

Farhan Akhtar

2 models

latest_Llama-3B-cot-kaggle

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Llamam-instruct-3B-Reasoningv2

3B 8K ctx
FP16
6GB file 8.05GB
F

Farpluto

8 models

granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

internlm2-chat-1_8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
F

Fasdqwfgzxgfqw

1 models

mjf-pki-qwen

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
F

Fatalokii

1 models

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
F

Fattis

3 models

Darwin-2B-Opus-heretic-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

Hy-MT2-1.8B-heretic-GGUF

1.8B 8K ctx
Q8_0
1.91GB file 3.94GB
BF16
3.6GB file 5.63GB

QwenSeek-2B-heretic-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB
F

Faunix

1 models

QwenSeek-2B-GGUF

2B 8K ctx
Q4_XS
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_S
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB
BF16
4GB file 6.03GB