All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Neph1

6 models

bellman-7b-mistral-instruct

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

bellman-7b-mistral-instruct-v0.2

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

gemma-2-2b-dunsany

2B 8K ctx
FP16
4GB file 6.03GB

llama-3-instruct-bellman-8b-swedish

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

sd-seer-griffin-3b

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

sd-seer-tinyllama

Unknown 8K ctx
FP16
0GB file 2GB
Q8_0
0GB file 2GB
N

Nerdsking

2 models

nerdsking-python-coder-3B-i

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Nerdsking-python-coder-7B-i

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
N

Nerkyor

7 models

Lynn-V4-Flash-Distill-Qwen-35B-A3B-Q4_K_M

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB

Lynn-V4-Pro-Distill-Qwen-35B-A3B-Q4_K_M

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB

Qwen3-4B-Thinking-2507-GGUF-imatrix

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Qwen3.5-4B-GGUF-imatrix

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Qwen3.5-9B-GGUF-imatrix

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

Qwen3.6-35B-A3B-APEX-MTP-GGUF

35B 8K ctx
FP16
70GB file 72.57GB

Qwen3.6-35B-A3B-GGUF-imatrix

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
N

Nero U C H

1 models

Bailong-instruct-7B-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
N

Nervmouse

2 models

gemma-2b-it-code

2B 8K ctx
FP16
4GB file 6.03GB

gemma-Code-Instruct-Finetune-test

Unknown 8K ctx
FP16
0GB file 2GB
N

Nesall

1 models

gemma-4b-instruct-v0.2-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB
N

Nesh Verse

8 models

Flash_Financial_SFT_Nanbeige_4.1-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q5_0-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Flash_Financial_SFT_Nanbeige_4.1-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Flash-financial-analysis-lfm-1.2b

1.2B 8K ctx
Q8_0
1.28GB file 3.3GB
N

Netcat420

38 models

MFANN-llama3.1-abliterated-SLERP-v3.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANN-llama3.1-abliterated-SLERP-v3.1-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANN-llama3.1-abliterated-SLERP-v3.1-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

MFANN-llama3.1-abliterated-SLERP-v3.1-Q5_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

MFANN-llama3.1-abliterated-SLERP-v3.1-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

MFANN-llama3.1-abliterated-SLERP-v3.1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

MFANN3b-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

MFANN3b-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

MFANN3b-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

MFANN3b-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

MFANN3bv0.22-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

MFANN3bv0.22-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

MFANN3bv0.22-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

MFANN3bv0.22-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

MFANN3bv0.22-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

MFANN3bv0.22-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

MFANN3bv0.6-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

MFANNv0.18-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.19-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.21-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.21-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.22-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.22-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.22.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.22.1-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.22.1-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

MFANNv0.22.1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

MFANNv0.23-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MFANNv0.23-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

MHENN

Unknown 8K ctx
Q4_K_M
0GB file 2GB

MHENN5-GGUF

5B 8K ctx
Q4_K_M
2.81GB file 4.89GB

MHENNcodemath

Unknown 8K ctx
Q4_K_M
0GB file 2GB

MHENNcodemathv2

Unknown 8K ctx
Q4_K_M
0GB file 2GB

MHENNlit

Unknown 8K ctx
Q4_K_M
0GB file 2GB

MHENNlitv2

Unknown 8K ctx
Q4_K_M
0GB file 2GB

MHENNlitv3

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Qwen2.5-7b-MFANNv1.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7b-MFANNv1.1-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
N

Nether Quartz

1 models

tatoeba-tok-multi-gemma-2-2b-merged

2B 8K ctx
Q8_0
2.13GB file 4.16GB
N

Netnk9151

8 models

Linkbricks-Horizon-AI-Korean-Advanced-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

Linkbricks-Horizon-AI-Korean-Advanced-12B-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Linkbricks-Horizon-AI-Korean-Superb-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Linkbricks-Horizon-AI-Korean-Superb-22B-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB

Llama-DNA-1.0-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Magnum-Picaro-0.7-v2-12b-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

MISCHIEVOUS-12B-Mix_0.3v-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Rabbit-Ko-15B-Instruct-Q8_0-GGUF

15B 8K ctx
Q8_0
15.94GB file 18.19GB