All Supported Models

29681 AI models · 198875 quantization formats tracked

D

Devarui379

2 models

portfolio-query-llama-3.2-3b-v3-cot-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF

3B 8K ctx
BF16
6GB file 8.05GB
D

Devd2101

1 models

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
D

Developerjeremylive

1 models

Gemopus-4-26B-A4B-it-GGUF-etheroi

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
Q5_K_M
17.88GB file 20.31GB
Q5_K_S
17.88GB file 20.31GB
Q6_K
21.13GB file 23.56GB
Q8_0
27.63GB file 30.06GB
BF16
52GB file 54.43GB
D

Developmentseed

1 models

gazet-model

0.8B 8K ctx
Q8_0
0.85GB file 2.86GB
D

Deven367

1 models

Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
D

Devgo Aida

1 models

Qwen2.5-Coder-7B-Instruct-IQ3_XXS-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB
D

Devgupta

1 models

llama-3-8b-chat-qa

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
D

Devingulliver

1 models

mamba-gguf

1.4B 8K ctx
Q2_0
0.44GB file 2.46GB
Q3_0
0.61GB file 2.63GB
Q4_0
0.79GB file 2.81GB
Q5_0
0.96GB file 2.98GB
Q6_0
1.14GB file 3.16GB
Q8_0
1.49GB file 3.51GB
D

Devisri050

29 models

gemma-3-1b-it-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

gemma-3-1b-it-Q4_K_S-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

LaMini-Flan-T5-783M-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

LaMini-Flan-T5-783M-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

LaMini-Flan-T5-783M-Q4_K_S-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Llama-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_K_S-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

OpenMath-Nemotron-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

OpenMath-Nemotron-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

OpenMath-Nemotron-1.5B-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2.5-0.5B-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q4_K_S-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

Qwen2.5-1.5B-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-14B-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB

Qwen2.5-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
D

Devmasa

5 models

Qwen3-0.6B-Base-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Base-Q5_K_S-GGUF

0.6B 8K ctx
Q5_0
0.41GB file 2.42GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Base-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Qwen3-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Qwen3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB