All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Nold

19 models

BioMistral-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Breeze-7B-Instruct-v1_0-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

CroissantLLMBase-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

CroissantLLMChat-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q4_K_M
0.06GB file 2.06GB
Q5_K_M
0.07GB file 2.07GB
Q6_K
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB

embryophagus-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB

FuseChat-7B-VaRM-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

HelpingAI-9B-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

internlm2-chat-20b-GGUF

20B 8K ctx
Q3_K_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB

Lumosia-v2-MoE-4x10.7-GGUF

10.7B 8K ctx
Q3_K_M
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Magicoder-S-DS-6.7B-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q4_K_M
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q8_0
7.12GB file 9.23GB

merlinite-7b-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-gemma-7b-v19.1-4k-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-mixtral-7bx8-v18.1-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Orion-14B-Base-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

phi-2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q4_M_K
1.13GB file 3.16GB
Q5_M_K
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

starcoder2-15b-GGUF

15B 8K ctx
Q3_K_M
6.56GB file 8.81GB
Q4_K_M
8.44GB file 10.69GB
Q5_K_M
10.31GB file 12.56GB
Q6_K
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

starcoder2-3b-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

starcoder2-7b-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Yi-34B-200K-GGUF

34B 8K ctx
Q3_K_M
14.88GB file 17.44GB
Q4_K_M
19.13GB file 21.69GB
Q5_K_M
23.38GB file 25.94GB
Q6_K
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB
N

Nolynn

2 models

EVA-Instruct-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

EVA-Instruct-32B-v2-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
N

Nondzu

1 models

Llama-PLLuM-70B-chat-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_K
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_K
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
N

Nonemonehpark

1 models

kanana-nano-2.1b-base-Q8_0-GGUF

2.1B 8K ctx
Q8_0
2.23GB file 4.26GB
N

Noone Important

1 models

sparsing-law-0.1b-relu-Q4_K_M-GGUF

0.1B 8K ctx
Q4_0
0.06GB file 2.06GB
FP16
0.2GB file 2.2GB
N

Noonecares52647842

1 models

Qwen3-30B-A3B-abliterated-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB
N

Noop S D

1 models

maywell_kiqu-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q1_S
70GB file 73.15GB
N

Nopenet

2 models

nope-edge-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

nope-edge-mini-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
Q8_0
1.81GB file 3.84GB
N

Nopperl

4 models

chameleon-7b-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

emissions-extraction-lora-merged-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

OLMo-1.7-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OLMo-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
N

Nor Hsang Pha

1 models

merge_llama3_adapter_Shan

Unknown 8K ctx
Q4_K_M
0GB file 2GB