All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Nulledinstance

6 models

Phi-3-mini-128k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_0
3.09GB file 5.15GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_0
3.09GB file 5.15GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_0
3.09GB file 5.15GB
FP16
7.6GB file 9.66GB

Qwen2.5-0.5B-Instruct-abliterated-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen2.5-0.5B-Instruct-abliterated-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
N

Nullt3R

2 models

Llama-3-8b-64k-PoSE-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-64k-PoSE-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
N

Numinousmuses

1 models

C3D-v0-gguf

0B 8K ctx
Q8_0
0GB file 2GB
N

Nuroai

1 models

Avalon-2B-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
N

Nv7732

1 models

Qwen2-Boundless-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
N

Nvhf

3 models

ADELIE-SFT-Q6_K-GGUF

Unknown 8K ctx
Q6_0
0GB file 2GB
FP16
0GB file 2GB

chatgpt_paraphraser_on_T5_base-Q6_K-GGUF

Unknown 8K ctx
Q6_0
0GB file 2GB
FP16
0GB file 2GB

deepmath-v1-Q6_K-GGUF

Unknown 8K ctx
Q6_0
0GB file 2GB
FP16
0GB file 2GB
N

Nvidia

1 models

NVIDIA-Nemotron-3-Nano-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
N

Nwdxlgzs

2 models

XL-LuaCopilot-0.6B-FFT-GGUF

0.6B 8K ctx
Q3_XS
0.26GB file 2.27GB
Q3_K
0.26GB file 2.27GB
Q3_K_L
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_M
0.26GB file 2.27GB
Q3_S
0.26GB file 2.27GB
Q3_XXS
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q4_K
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K
0.41GB file 2.42GB
Q5_1
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

XL-LuaCopilot-1.7B-FFT-GGUF

1.7B 8K ctx
Q3_K
0.74GB file 2.77GB
Q3_M
0.74GB file 2.77GB
Q3_S
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_XS
0.74GB file 2.77GB
Q3_XXS
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q4_K
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K
1.17GB file 3.2GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB
N

Nwilkie

1 models

Llama-3-Groq-8B-Tool-Use-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
N

Nxvay

1 models

lex01_lora

Unknown 8K ctx
FP16
0GB file 2GB