All Supported Models

29681 AI models · 198875 quantization formats tracked

F

Foundcake

1 models

A.X-4.0-Light-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
F

Foxcow

1 models

Qwen2-1.5B-Instruct-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB
F

Foxcyan

2 models

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q5_K_S-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB
F

Foxtail2

1 models

dolphin-2.9-llama3-8b-GGUF

8B 8K ctx
Q2_XS
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_L
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q1_S
8GB file 10.13GB
Q1_M
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
F

Fr33Z3

1 models

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
F

Fra Qtl

1 models

Qwen3.6-35B-A3B-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
F

Fracarfer5

1 models

rl4b

4B 8K ctx
Q4_1
2.25GB file 4.32GB
F

Fractaldactal

1 models

TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf

20B 8K ctx
Q2_M
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q2_K
6.25GB file 8.58GB
Q2_K_S
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_XS
8.75GB file 11.08GB
Q3_XXS
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_NL
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_S
13.75GB file 16.08GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_S
20GB file 22.33GB
Q1_M
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
F

Fragata

2 models

PULI-LlumiX-32K-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

PULI-LlumiX-32K-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
F

Frameprotocol

1 models

frame-intent-english

Unknown 8K ctx
FP16
0GB file 2GB