All Supported Models

29681 AI models · 198875 quantization formats tracked

A

A Igotahole

4 models

FranFran-Something-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

gemma-2-9b-it-chinese-kyara-Q5_K_S-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Qwen2.5-14B-Instruct-CARE-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

qwen3-14b-sft-merged-Q4_K_S-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB
A

A K A S H2393

3 models

finetuned-1

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

mistral-finetuned

Unknown 8K ctx
FP16
0GB file 2GB

phi2-finetuned

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
A

A L C E L

1 models

Llama-Primus-Reasoning-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

A L D N

4 models

Llama-3.1-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

medical-llm-mistral7B-F16-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

medical-llm-mistral7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
A

A Lex J M19

1 models

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q2_K_L
1.19GB file 3.25GB
Q2_K
1.19GB file 3.25GB
Q2_M
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q3_K_XL
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q3_XS
1.66GB file 3.72GB
Q4_K_S
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_0
2.14GB file 4.2GB
Q4_K_L
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_S
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_L
2.61GB file 4.67GB
Q6_K_L
3.09GB file 5.15GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB
A

A P R K D E V

2 models

icarus-1-3b

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

icarus-1-70b-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
A

A P T O 001

3 models

Qwen3.5-27B-SafetyTuned-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
BF16
54GB file 56.44GB

Qwen3.5-9B-Base-SafetyTuned-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
BF16
18GB file 20.15GB

Qwen3.5-9B-SafetyTuned-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
BF16
18GB file 20.15GB
A

A R M Zyany

1 models

Cascade0.1-Preview1-0505-Step55K-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
BF16
0GB file 2GB
A

A R M174 G3

1 models

Nemotron-Content-Safety-Reasoning-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
A

A R O O J N C B C

1 models

llama-3.2-3b-it-wheat-ChatBot

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB