All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mahmad 10Xe

2 models

Llama-3.2-1B-Instruct-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
M

Mahmoudalyosify

1 models

Horus-OSINT

Unknown 8K ctx
Q4_K_M
0GB file 2GB
M

Maicog

2 models

Qwen2.5-14B-Instruct-abliterated-v2-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Instruct-abliterated-v2-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
M

Maidacundo

1 models

panda_agi_64_8_batch_gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
M

Mailroomdevelopers Del

1 models

NVIDIA-Nemotron-3-Nano-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
M

Maincode

1 models

Maincoder-1B-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB
M

Maites

8 models

law-LLM-13B-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Phi-3B-OnFrench-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
M

Majentik

43 models

gpt-oss-120b-RotorQuant-GGUF-IQ4_XS

120B 8K ctx
Q4_XS
67.5GB file 71.47GB

gpt-oss-120b-RotorQuant-GGUF-Q2_K

120B 8K ctx
Q2_K
37.5GB file 41.47GB

gpt-oss-120b-RotorQuant-GGUF-Q3_K_M

120B 8K ctx
Q3_K_M
52.5GB file 56.47GB

gpt-oss-120b-RotorQuant-GGUF-Q4_K_M

120B 8K ctx
Q4_K_M
67.5GB file 71.47GB

gpt-oss-120b-RotorQuant-GGUF-Q5_K_M

120B 8K ctx
Q5_K_M
82.5GB file 86.47GB

gpt-oss-120b-RotorQuant-GGUF-Q8_0

120B 8K ctx
Q8_0
127.5GB file 131.47GB

gpt-oss-20b-RotorQuant-GGUF-IQ4_XS

20B 8K ctx
Q4_XS
11.25GB file 13.58GB

gpt-oss-20b-RotorQuant-GGUF-Q2_K

20B 8K ctx
Q2_K
6.25GB file 8.58GB

gpt-oss-20b-RotorQuant-GGUF-Q3_K_M

20B 8K ctx
Q3_K_M
8.75GB file 11.08GB

gpt-oss-20b-RotorQuant-GGUF-Q4_K_M

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB

gpt-oss-20b-RotorQuant-GGUF-Q5_K_M

20B 8K ctx
Q5_K_M
13.75GB file 16.08GB

gpt-oss-20b-RotorQuant-GGUF-Q8_0

20B 8K ctx
Q8_0
21.25GB file 23.58GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS

30B 8K ctx
Q4_XS
16.88GB file 19.37GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q2_K

30B 8K ctx
Q2_K
9.38GB file 11.87GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q3_K_M

30B 8K ctx
Q3_K_M
13.13GB file 15.62GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q4_K_M

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q5_K_M

30B 8K ctx
Q5_K_M
20.63GB file 23.12GB

Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q8_0

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB

Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q8_0

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS

4B 8K ctx
Q4_XS
2.25GB file 4.32GB

Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K

4B 8K ctx
Q2_K
1.25GB file 3.32GB

Nemotron-3-Nano-4B-RotorQuant-GGUF-Q3_K_M

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB

Nemotron-3-Nano-4B-RotorQuant-GGUF-Q4_K_M

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Nemotron-3-Nano-4B-TurboQuant-GGUF-Q4_K_M

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q2_K

120B 8K ctx
Q2_K
37.5GB file 41.47GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q3_K_M

120B 8K ctx
Q3_K_M
52.5GB file 56.47GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q4_K_M

120B 8K ctx
Q4_K_M
67.5GB file 71.47GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q5_K_M

120B 8K ctx
Q5_K_M
82.5GB file 86.47GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q6_K

120B 8K ctx
Q6_K
97.5GB file 101.47GB

Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q8_0

120B 8K ctx
Q8_0
127.5GB file 131.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q2_K

120B 8K ctx
Q2_K
37.5GB file 41.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q3_K_M

120B 8K ctx
Q3_K_M
52.5GB file 56.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q4_K_M

120B 8K ctx
Q4_K_M
67.5GB file 71.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q5_K_M

120B 8K ctx
Q5_K_M
82.5GB file 86.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q6_K

120B 8K ctx
Q6_K
97.5GB file 101.47GB

Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q8_0

120B 8K ctx
Q8_0
127.5GB file 131.47GB

Qwen3.5-27B-RotorQuant-GGUF-IQ4_XS

27B 8K ctx
Q4_XS
15.19GB file 17.63GB

Qwen3.5-27B-RotorQuant-GGUF-Q2_K

27B 8K ctx
Q2_K
8.44GB file 10.88GB

Qwen3.5-27B-RotorQuant-GGUF-Q3_K_M

27B 8K ctx
Q3_K_M
11.81GB file 14.25GB

Qwen3.5-27B-RotorQuant-GGUF-Q4_K_M

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB

Qwen3.5-27B-RotorQuant-GGUF-Q5_K_M

27B 8K ctx
Q5_K_M
18.56GB file 21GB

Qwen3.5-27B-RotorQuant-GGUF-Q8_0

27B 8K ctx
Q8_0
28.69GB file 31.13GB
M

Makatia

1 models

mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
M

Malekhmem

1 models

testgemma

Unknown 8K ctx
FP16
0GB file 2GB