All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Neuralghost

1 models

darkforensic-7b

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
N

Neuwhufbox

4 models

gemma-2-9b-it-function-calling-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

ko-gemma-2-9b-it-fn-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

ko-gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Linkbricks-Horizon-AI-Korean-Pro-27B-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB
N

Neve A I

6 models

Neve-Cascade-S-90M-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB

Neve-Cascade-X3-1B-GGUF

1B 8K ctx
Q3_K_XL
0.44GB file 2.46GB

Neve-Sense-2-20B-GGUF

20B 8K ctx
Q4_K_XL
11.25GB file 13.58GB

Neve-Strata-4-30B-GGUF

30B 8K ctx
Q4_K_XL
16.88GB file 19.37GB

Neve-Strata-S2-4B-GGUF

4B 8K ctx
Q8_K_XL
4.25GB file 6.32GB

Neve-Strata-X2-35B-GGUF

35B 8K ctx
Q4_K_XL
19.69GB file 22.26GB
N

New Eden Forge

1 models

openhands-lm-32b-v0.1-Q5_0-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
N

Newsletter

25 models

buddhi-128k-chat-7b-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

gemma-2-27b-it-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

gemma-2-2b-it-Q6_K-GGUF

2B 8K ctx
Q6_K
1.63GB file 3.66GB

gemma-2-9b-it-Q6_K-GGUF

9B 8K ctx
Q6_K
7.31GB file 9.46GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Gemma-2-9B-It-SPPO-Iter3-Q6_K-GGUF

9B 8K ctx
Q6_K
7.31GB file 9.46GB

granite-20b-code-instruct-Q6_K-GGUF

20B 8K ctx
Q6_K
16.25GB file 18.58GB

granite-3b-code-instruct-Q6_K-GGUF

3B 8K ctx
Q6_K
2.44GB file 4.49GB

granite-8b-code-instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

h2o-danube2-1.8b-chat-Q6_K-GGUF

1.8B 8K ctx
Q6_K
1.46GB file 3.49GB

internlm2_5-1_8b-chat-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

internlm2_5-7b-chat-1m-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

magnum-32b-v1-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

Mistral-7B-Instruct-v0.2-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Mistral-7B-Instruct-v0.2-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

openchat-3.5-0106-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

Phi-3-medium-128k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB

Phi-3-medium-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3-mini-128k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB

Phi-3.5-mini-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB

Qwen3-0.6B-Base-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

wavecoder-ultra-6.7b-Q6_K-GGUF

6.7B 8K ctx
Q6_0
5.44GB file 7.55GB
FP16
13.4GB file 15.51GB

WEBGEN-4B-Preview-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

zephyr-7b-beta-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB
N

Nexa A I

3 models

LFM2-24B-A2B-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

octo-planner-gguf

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Octopus-v2-gguf-awq

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
N

Nexes Quants

3 models

gemma-3-27b-novision-Q6_K-GGUF

27B 8K ctx
Q6_0
21.94GB file 24.38GB
FP16
54GB file 56.44GB

gemma-3-27b-novision-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q8_0
4.04GB file 6.1GB
BF16
7.6GB file 9.66GB
N

Nexesenex

1 models

meditsolutions_Llama-3.2-SUN-1B-Instruct-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
N

Nexless

2 models

dental-ai-research-slm-0m-20260425-3845

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

dental-research-slm-0m-20260426-4b31

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
N

Nexus Syntegra

2 models

Nexus-TinyFunction-1.2B-v2.0-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

Nexus-TinyFunction-1.2B-v2.0-IMatrix-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB