All Supported Models

29681 AI models · 198875 quantization formats tracked

D

Data Ops Fusion

4 models

gemma-3-4b-it-vietnamese-r16-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-3-4b-it-vietnamese-r32-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

Meta-Llama-3.1-8B-Instruct-vietnamese-r16-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

Qwen2.5-7B-Instruct-vietnamese-r32-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
D

Data Soul

4 models

Gemma-2-2b-Chinese-it-Q5_K_M-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB

Gemma-2-2b-Chinese-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

Ministral-3b-instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Rombo-LLM-V3.1-QWQ-32b-abliterated-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB
D

Dataequity

1 models

mistral-7b-instruct-v0.2.Q5_K_M.gguf

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB
D

Datamatters24

1 models

CaroleNDVoice

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Datouge

1 models

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
D

Dauksza123

1 models

Chris_Dauksza

32B 8K ctx
FP16
64GB file 66.52GB
D

Dave Gergern

1 models

LLaMA2-13B-Psyfighter2-Erebus3-DareTies-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q4_K_S
7.31GB file 9.52GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB
FP16
26GB file 28.21GB
D

Dave Leong S G

1 models

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Davelsphere

10 models

granite-3.0-1b-a400m-base-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.0-2b-base-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-3.0-2b-instruct-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-3.0-3b-a800m-base-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3.0-8b-base-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3.0-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-guardian-3.0-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-guardian-3.0-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
D

Davezaxh

1 models

llama-3.2-exp

3B 8K ctx
Q3_S
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB