All Supported Models

29681 AI models · 198875 quantization formats tracked

Q

Quantflex

3 models

MicroThinker-1B-Preview-GGUF

1B 8K ctx
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

MiMo-7B-RL-nomtp-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

SmallThinker-3B-Preview-abliterated-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
Q

Quantized4All

3 models

OpenCodeReasoning-Nemotron-1.1-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q2_K
4.38GB file 6.61GB
Q3_K
6.13GB file 8.36GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_S
6.13GB file 8.36GB
Q3_XS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q5_K
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

OpenCodeReasoning-Nemotron-1.1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K
14GB file 16.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q5_K
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenCodeReasoning-Nemotron-1.1-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
Q

Quardo

4 models

Reasoning-Qwen2-1.5B-000-241201-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

TR-Qwen2-1.5B-002-241130-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

TR-Qwen2-7B-001-241129-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

TR-Qwen2-7B-003-241201-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
Q

Quatfit

1 models

Riko-1.1B

1.1B 8K ctx
FP16
2.2GB file 4.22GB
Q

Quazim0T0

1 models

Phi4.React.Turn.V2.Full

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
BF16
8GB file 10.07GB
Q

Qudsiya17

1 models

my-llama-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q

Quelmap

2 models

Lightning-4b-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

Lightning-4b-GGUF-short-ctx

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
Q

Qui Xilver777

1 models

Falcon3-MoE-2x7B-Insruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
Q

Quiet Impostor

1 models

Gemini-Nano-Gemmafied

Unknown 8K ctx
FP16
0GB file 2GB
Q

Quixi A I

2 models

Ina-v11.1-gguf

11.1B 8K ctx
Q3_K_L
4.86GB file 7.04GB
Q3_K_M
4.86GB file 7.04GB
Q3_K_S
4.86GB file 7.04GB
Q3_M
4.86GB file 7.04GB
Q3_XS
4.86GB file 7.04GB
Q4_0
6.24GB file 8.42GB
Q4_1
6.24GB file 8.42GB
Q4_K_M
6.24GB file 8.42GB
Q4_K_S
6.24GB file 8.42GB
Q4_NL
6.24GB file 8.42GB
Q4_XS
6.24GB file 8.42GB
Q5_K_M
7.63GB file 9.81GB
Q5_K_S
7.63GB file 9.81GB
Q6_K
9.02GB file 11.2GB
Q8_0
11.79GB file 13.97GB

laserxtral-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB