All Supported Models

29681 AI models · 198875 quantization formats tracked

D

Dr Rice I O7

1 models

Oryza-Sirocco-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
D

Dr Ry

1 models

Foundation-Sec-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
D

Dracnacio

1 models

llama-3-8b-phap-luat-lora-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
D

Dracones

2 models

gemma-2-27b-it-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
D

Drag A Ixxx

1 models

Qwen2.5-14B-Instruct-1M-abliterated-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
D

Dragon808

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Dranger003

40 models

airoboros-34b-3.2-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q8_0
36.13GB file 38.69GB

AlphaMonarch-7B-iMat.GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

AlphaMonarch-laser-iMat.GGUF

Unknown 8K ctx
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

bagel-34b-v0.2-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

bagel-34b-v0.4-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q1_0
34GB file 36.56GB
Q8_0
36.13GB file 38.69GB

bagel-dpo-20b-v04-llama-iMat.GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q8_0
21.25GB file 23.58GB

bagel-dpo-34b-v0.5-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q5_0
23.38GB file 25.94GB
Q6_0
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB

bagel-dpo-8x7b-v0.2-iMat.GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q1_0
7GB file 9.11GB
FP16
14GB file 16.11GB

c4ai-command-r-plus-iMat.GGUF

Unknown 8K ctx
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

c4ai-command-r-v01-iMat.GGUF

Unknown 8K ctx
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

c4ai-command-r7b-12-2024-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

CausalLM-34b-beta-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

CodeFuse-DeepSeek-33B-iMat.GGUF

33B 8K ctx
Q3_0
14.44GB file 16.98GB
Q4_0
18.56GB file 21.1GB
Q8_0
35.06GB file 37.6GB

CodeLlama-70b-Instruct-iMat.GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q1_0
70GB file 73.15GB
FP16
140GB file 143.15GB

dbrx-instruct-iMat.GGUF

Unknown 8K ctx
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

deepseek-coder-33b-instruct-iMat.GGUF

33B 8K ctx
Q2_0
10.31GB file 12.85GB
Q3_0
14.44GB file 16.98GB
Q4_0
18.56GB file 21.1GB
Q5_0
22.69GB file 25.23GB
Q1_0
33GB file 35.54GB
FP16
66GB file 68.54GB

dolphincoder-starcoder2-15b-iMat.GGUF

15B 8K ctx
Q3_0
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q6_0
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

gemma-7b-it-iMat.GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

GritLM-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

GritLM-8x7B-iMat.GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q8_0
7.44GB file 9.55GB

labradorite-13b-iMat.GGUF

13B 8K ctx
Q3_0
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q6_0
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

LWM-Text-Chat-128K-iMat.GGUF

Unknown 8K ctx
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

mamba-2.8b-hf-GGUF

2.8B 8K ctx
Q4_0
1.58GB file 3.63GB
Q5_0
1.92GB file 3.97GB
Q6_0
2.28GB file 4.33GB
Q8_0
2.97GB file 5.02GB

mamba-bagel-2.8b-v0.2-GGUF

2.8B 8K ctx
Q4_0
1.58GB file 3.63GB
Q5_0
1.92GB file 3.97GB
Q6_0
2.28GB file 4.33GB
Q8_0
2.97GB file 5.02GB

MambaHermes-3B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

miqu-1-120b-iMat.GGUF

120B 8K ctx
Q2_0
37.5GB file 41.47GB
Q3_0
52.5GB file 56.47GB
FP16
240GB file 243.97GB

miqu-1-70b-iMat.GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

Mixtral-8x7B-Instruct-v0.1-iMat.GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q8_0
7.44GB file 9.55GB

NeuralMonarch-7B-iMat.GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

Nous-Capybara-34B-iMat.GGUF

34B 8K ctx
Q3_0
14.88GB file 17.44GB
FP16
68GB file 70.56GB

OpenCodeInterpreter-CL-70B-iMat.GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
FP16
140GB file 143.15GB

OpenCodeInterpreter-DS-33B-iMat.GGUF

33B 8K ctx
Q3_0
14.44GB file 16.98GB
Q4_0
18.56GB file 21.1GB
Q8_0
35.06GB file 37.6GB

Smaug-34B-v0.1-iMat.GGUF

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
FP16
68GB file 70.56GB

Smaug-72B-v0.1-iMat.GGUF

72B 8K ctx
Q2_0
22.5GB file 25.68GB
Q3_0
31.5GB file 34.68GB
Q1_0
72GB file 75.18GB
FP16
144GB file 147.18GB

Smaug-Mixtral-v0.1-iMat.GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q8_0
0GB file 2GB

Snorkel-Mistral-PairRM-DPO-iMat.GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB

starcoder2-15b-GGUF

15B 8K ctx
Q4_0
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q6_0
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

starcoder2-15b-instruct-iMat.GGUF

15B 8K ctx
Q3_0
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q6_0
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

UNA-SimpleSmaug-34b-v1beta-iMat.GGUF

34B 8K ctx
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q5_0
23.38GB file 25.94GB
Q6_0
27.63GB file 30.19GB
FP16
68GB file 70.56GB

WhiteRabbitNeo-33B-v1.5-iMat.GGUF

33B 8K ctx
Q2_0
10.31GB file 12.85GB
Q3_0
14.44GB file 16.98GB
Q4_0
18.56GB file 21.1GB
FP16
66GB file 68.54GB
D

Draven Black

2 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Phi-4-mini-instruct-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB
D

Dream Fast

4 models

gemma-3-12b-it-heretic

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

gemma-3-12b-it-heretic-v2

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

qwen3-4b-heretic

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

qwen3-8b-heretic

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
D

Dreamgen

5 models

opus-v0-70b-gguf

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB

opus-v1-34b-gguf

34B 8K ctx
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q5_0
23.38GB file 25.94GB
Q6_0
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB

opus-v1.2-70b-gguf

70B 8K ctx
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

opus-v1.2-7b-gguf

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

opus-v1.4-70b-llama3-gguf

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB