All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Nyongnyongi

1 models

JT-SCHOOL-EXAONE-Finetuned-Merged

Unknown 8K ctx
FP16
0GB file 2GB
Q8_0
0GB file 2GB
N

Nyuuzyou

6 models

BadApple-LLaMA-nano

Unknown 8K ctx
FP16
0GB file 2GB

Qwen2.5-0.5B-Bluesky

0.5B 8K ctx
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Bluesky-Instruct

0.5B 8K ctx
FP16
1GB file 3.01GB

SmolLM2-1.7B-Eagle-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

SmolLM2-135M-Eagle-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q8_0
0GB file 2GB

SmolLM2-360M-Eagle-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q8_0
0GB file 2GB
O

O B L I T E R A T U S

2 models

gemma-4-E4B-it-OBLITERATED

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

Qwen3.6-27B-OBLITERATED

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
O

O Evortex

7 models

BabyMistral

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

HelpingAI-3B-chat

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

HelpingAI-3B-hindi

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

HelpingAI-9B-200k

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

HelpingAI-flash

Unknown 8K ctx
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB

HelpingAI-Lite-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Nakshatra

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
O

O M P123

2 models

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen3-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
O

O T A A I

1 models

OTA-v1

Unknown 8K ctx
Q8_0
0GB file 2GB
O

O Us M R S T

1 models

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
O

O X K S A1

1 models

kakugo-3B-ars-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
O

Obe J

5 models

granite-3.1-2b-instruct-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

granite-3.1-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3.2-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Qwen2.5-7B-Instruct-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
O

Oblivious

3 models

Refact-1.6B-fim-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_L
2.63GB file 4.73GB
Q3_K_M
2.63GB file 4.73GB
Q3_K_S
2.63GB file 4.73GB
Q4_0
3.38GB file 5.48GB
Q4_1
3.38GB file 5.48GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_0
4.13GB file 6.23GB
Q5_1
4.13GB file 6.23GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

ruGPT-3.5-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q3_K_XS
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K_M
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Vikhr-7B-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_K_XS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB