All Supported Models

29681 AI models · 198875 quantization formats tracked

N

N L Park

2 models

Mistral-22B-v0.2-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q4_K_M
12.38GB file 14.74GB
Q4_K_S
12.38GB file 14.74GB
Q5_K_M
15.13GB file 17.49GB

Nano_Q2-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
N

N00B001

5 models

OpenCodeReasoning-Nemotron-1.1-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-Coder-30B-A3B-Instruct-Q4_0-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB

Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-Coder-30B-A3B-Instruct-Q4_K_S-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB
N

N19Hty

2 models

Arch-Router-1.5B-IQ3_XXS-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

SmolLM2-1.7B-Instruct-IQ3_XXS-GGUF

1.7B 8K ctx
Q3_0
0.74GB file 2.77GB
FP16
3.4GB file 5.43GB
N

N1Ghts4Kura

1 models

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
N

N1Kg0R

1 models

Vezstral-3B-Bolognese-v3

3B 8K ctx
FP16
6GB file 8.05GB
N

N3Shelter

1 models

Peach-9B-8k-Roleplay-IQ4_XS-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
N

N8 Programs

1 models

Voidhead-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_K_M
0GB file 2GB
N

Nabbers1999

6 models

Mini-Llama-14B-Chat-SFT-0129-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Mini-Llama-14B-Instruct-0124-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Mini-Llama-3B-Chat-SFT-0129-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Mini-Llama-3B-Instruct-0124-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Mini-Llama-8B-Chat-SFT-0129-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Mini-Llama-8B-Instruct-0124-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
N

Nabbey88

1 models

Uncensored-llama-20B-gguf

20B 8K ctx
Q2_XXS
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_M
6.25GB file 8.58GB
Q2_K_S
6.25GB file 8.58GB
Q2_K
6.25GB file 8.58GB
Q3_XXS
8.75GB file 11.08GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_XS
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_NL
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_S
20GB file 22.33GB
Q1_M
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
N

Nablasinc

1 models

Qwen3-8B-fc-rl-one-epoch-Q4_K_M

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB