All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Nguyentd

1 models

FinancialAdvice-Qwen2.5-7B.gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
N

Nguyenthanhthuan

2 models

Llama_3.2_1B_Intruct_Tool_Calling

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama_3.2_1B_Intruct_Tool_Calling_V2

1B 8K ctx
Q8_0
1.06GB file 3.08GB
N

Nguyenthilaitrieulong

1 models

huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUF

70B 8K ctx
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q3_XXS
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_0
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
N

Nguyenviet

2 models

PhoGPT-4B-Chat-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

PhoGPT-7B5-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_1
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
N

Ngxson

4 models

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-1M-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

SmolLM2-135M-Instruct-IQ4_XS-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Vistral-7B-ChatML

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
N

Nh Ztw

1 models

Qwen3.5-2B-UCO-6to4-TruthFix-GGUF

2B 8K ctx
Q4_K_S
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
N

Nhay103

2 models

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

gpt-oss-20b-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB
N

Nhotin

1 models

vistral7B-chat-gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
N

Ni C Etmtm

1 models

Llama3_kw_gen

Unknown 8K ctx
Q4_K_M
0GB file 2GB
N

Niansuh

1 models

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB