All Supported Models

29681 AI models · 198875 quantization formats tracked

Q

Qbz506

2 models

nyaya-llama-3b-stage0

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

nyaya-llama-3b-stage0-full

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
Q

Qforge

1 models

Qwen3-14B-AT

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q

Qihoo360

1 models

Light-R1-14B-DS-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
Q

Qikp

19 models

DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-imatrix-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

gemini-3-pro-qwen3-0.6b-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q4_K_M
0.34GB file 2.35GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

gemma-3-110m-english-only-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

hummingbird-2-125m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB

hummingbird-2.1-110m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB

hummingbird-2.5-110m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB

hummingbird-2.6-110m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB

hummingbird-2.7-110m-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

hummingbird-3-110m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

hummingbird-3.1-110m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_K
0GB file 2GB

hummingbird-350m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

kite-2.5-13m-instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

kite-2.6-13m-instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB

OLMo-2-0425-1B-SFT-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

OpenR1-Distill-0.6B-GGUF

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB

qwen3-1.7b-layer-21-duped-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_S
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

SmollerLM-48M-Instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
Q4_K_M
0GB file 2GB

treeswift-90m-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB
Q2_K
0GB file 2GB
Q

Qing Hong258

1 models

Deepseek-R1-8b-JiangPing-v1

8B 8K ctx
FP16
16GB file 18.13GB
Q

Qiskit

1 models

granite-8b-qiskit-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q

Qixiangme

1 models

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
Q

Qizc

1 models

Phi-3-mini-4k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
FP16
7.6GB file 9.66GB
Q

Qjyyy9782

1 models

qwen3_test

32B 8K ctx
Q8_0
34GB file 36.52GB
Q

Qnixsynapse

6 models

codegemma-7b-it-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

gemma-2-9b-it-IQ4_XS-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-V2-2B-Instruct-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB