All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Ankitja

1 models

llama-3-8b-Instruct-bnb-4bit-aiaustin-demo

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Ankur1423

1 models

fine-tune-test-2

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Ankush Rana01

7 models

Llama-3.2-1B-IQ4_NL-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-IQ4_XS-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
A

Ankushbl6

3 models

gemma-4-E4B-it-plinus

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q6_K
28.44GB file 31.01GB
Q8_0
37.19GB file 39.76GB

Qwopus3.5-27B-v3-TQ3_4S

27B 8K ctx
Q3_4S
11.81GB file 14.25GB
A

Anna Ara

13 models

Mimma-3-12b-Q2_K-GGUF

12B 8K ctx
Q2_0
3.75GB file 5.95GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q3_K_L-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q3_K_M-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q3_K_S-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q4_0-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB

Mimma-3-12b-Q4_K_S-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q5_0-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB

Mimma-3-12b-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Mimma-3-12b-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Mimma-3-27b-Q5_K_M-GGUF

27B 8K ctx
Q5_0
18.56GB file 21GB
FP16
54GB file 56.44GB

Mimma-3-27b-Q6_K-GGUF

27B 8K ctx
Q6_0
21.94GB file 24.38GB
FP16
54GB file 56.44GB

Mimma-3-27b-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB
A

Anniestasy

1 models

Asclepius-Llama2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Annonys

1 models

Minoan-Sovereign-V9

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Anon Researcher Ua

1 models

codegpt-oss-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q3_K_S
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_L
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q5_K_S
13.75GB file 16.08GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
A

Anospy

1 models

Qwen2.5-Coder-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
A

Anoxiom

1 models

Sujet-Finance-8B-v0.1-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB