All Supported Models

29681 AI models · 198875 quantization formats tracked

L

L T S V V E

1 models

Teuta

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
L

L V S T C K

1 models

domestic-yak-8B-instruct-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
L

L Viking

1 models

Qwen3-30B-A3B-YOYO-V6-Q3_K_S-GGUF

30B 8K ctx
Q3_0
13.13GB file 15.62GB
FP16
60GB file 62.49GB
L

L0Uu

1 models

gemma4-e4b-etafakna-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
L

La2Ydev

2 models

RoGemma2-9b-Instruct

9B 8K ctx
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

RoLlama3.1-8b-Instruct

8B 8K ctx
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
L

Lab2 As

1 models

lora_model_gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB
L

Labotollama3

1 models

lobotollama-6.5b

6.5B 8K ctx
Q4_0
3.66GB file 5.77GB
FP16
13GB file 15.11GB
L

Lactroiii

5 models

cognitivecomputations_Dolphin3.0-R1-Mistral-24B-GGUF

24B 8K ctx
Q2_XXS
7.5GB file 9.89GB
Q2_XS
7.5GB file 9.89GB
Q2_S
7.5GB file 9.89GB
Q2_M
7.5GB file 9.89GB
Q2_K_L
7.5GB file 9.89GB
Q2_K
7.5GB file 9.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_K_XL
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_XS
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_K_L
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_K_S
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_L
16.5GB file 18.89GB
Q6_K_L
19.5GB file 21.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

gemma-4-31B-it-uncensored-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
Q8_0
32.94GB file 35.45GB

huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_XXS
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_0
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
L

Ladygaia

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
L

Laem2Mei

2 models

gemma-2-2b-it-Q6_K-GGUF

2B 8K ctx
Q6_0
1.63GB file 3.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB