All Supported Models

29681 AI models · 198875 quantization formats tracked

D

Davis426

1 models

Healthcare-LLM-Assistant

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
D

Davzoku

1 models

cria-llama2-7b-v1.3-GGUF

7B 8K ctx
FP16
14GB file 16.11GB
D

Dawn A I

1 models

Dawn-V1-mini

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB
Q3_0
0GB file 2GB
BF16
0GB file 2GB
D

Dawoodthouseef

1 models

llama2-gguf

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
D

Dayuan

1 models

ffmpeg-command-generator

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB
D

Dclef

1 models

BaZi-Qwen3-1.7B-GGUF

1.7B 8K ctx
FP16
3.4GB file 5.43GB
D

Dcv21

1 models

Huihui-Qwen3-8B-abliterated-v2-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Ddarolf

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Dddump

4 models

Japanese-Chat-Evolve-TEST-7B-NSFW-gguf

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Japanese-TextGen-Kage-v0.1-2x7B-gguf

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Japanese-TextGen-Kage-v0.1.2-2x7B-NSFW-gguf

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Japanese-TextGen-MoE-TEST-2x7B-NSFW-gguf

7B 8K ctx
Q4_XS
3.94GB file 6.05GB
D

Ddh0

24 models

dolphin-2.1-mistral-7b-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

dolphin-2.2.1-mistral-7b-GGUF-fp16

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

L3.3-Electra-R1-70b-GGUF

70B 8K ctx
Q2_M
21.88GB file 25.03GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_XS
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Meta-Llama-3-8B-Instruct-bf16-GGUF

8B 8K ctx
BF16
16GB file 18.13GB

Mistral-7B-Instruct-v0.1-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-OpenOrca-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-v0.1-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

Mixtral-8x7B-Instruct-v0.1-bf16-GGUF

7B 8K ctx
BF16
14GB file 16.11GB

Naberius-7B-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

neural-chat-7b-v3-1-GGUF-fp16

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

openchat_3.5-GGUF-fp16

3.5B 8K ctx
FP16
7GB file 9.06GB

openchat-3.5-0106-GGUF-fp16

0106B 8K ctx
FP16
212GB file 215.74GB

OpenHermes-2.5-Mistral-7B-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB

phi-2-GGUF-fp16

2B 8K ctx
FP16
4GB file 6.03GB

Phi-3-mini-4k-instruct-bf16-GGUF

16B 8K ctx
BF16
32GB file 34.26GB

Qwen3-4B

4B 8K ctx
Q8_0
4.25GB file 6.32GB

rocket-3B-GGUF-fp16

3B 8K ctx
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

Tess-7B-v1.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Tess-XS-v1.0-GGUF-fp16

1.0B 8K ctx
Q8_0
1.06GB file 3.08GB
FP16
2GB file 4.02GB

Thespis-13b-Alpha-v0.7-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

una-cybertron-7b-v2-GGUF-fp16

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Yi-6B-200K-GGUF-fp16

6B 8K ctx
FP16
12GB file 14.1GB

Yi-6B-GGUF-fp16

6B 8K ctx
FP16
12GB file 14.1GB

zephyr-7b-beta-GGUF-fp16

7B 8K ctx
FP16
14GB file 16.11GB