All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Apprikat A I

2 models

Qwen2.5-Coder-1.5B-Instruct-FP16-GGUF

1.5B 8K ctx
FP16
3GB file 5.02GB

reader-lm-1.5b-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
A

Appssidekick

1 models

TanzentModels

Unknown 8K ctx
Q4_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
A

Appvoid

10 models

arco-3-gguf

3B 8K ctx
Q8_0
3.19GB file 5.24GB

carbono-001

Unknown 8K ctx
Q8_0
0GB file 2GB

Dripper-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

functiongemma-hermes-3k-ft-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

LFM2-2.6B-Q4_0-GGUF

2.6B 8K ctx
Q4_0
1.46GB file 3.5GB

palmer-002.5

Unknown 8K ctx
FP16
0GB file 2GB

palmer-003

Unknown 8K ctx
FP16
0GB file 2GB

palmer-004

1.1B 8K ctx
FP16
2.2GB file 4.22GB

Qwen3-0.6B-Timber-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

syngen-reasoning-0.6b-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB
A

Apresence

1 models

llama-3-typhoon-v1.5-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Aptha

1 models

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
A

Apto As

10 models

Llama-3.2-1B-Instruct-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-3B-Instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-1.5B-Instruct-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

Qwen2.5-Coder-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-14B-Instruct-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen2.5-Coder-14B-Instruct-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
A

Ar08

4 models

Indic-gemma-7b-finetuned-sft-Navarasa-2.0-IQ3_M-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Llama-2-7b-chat-hf-IQ3_M-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

llama3.2-1B-Function-calling-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

tinyllama-nerd-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Arandompothead

2 models

Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic-v2-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_S
18.56GB file 21GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
A

Arash8248

1 models

SOLAR-10.7B-Instruct-v1.0.Q4-Q8-GPTQ-GGUF

10.7B 8K ctx
Q4_0
6.02GB file 8.2GB
Q8_0
11.37GB file 13.55GB
A

Aratan

1 models

llama_aratan

Unknown 8K ctx
Q4_K_M
0GB file 2GB