All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mkreynolds

1 models

K-EXAONE-236B-A23B-GGUF-4bit

236B 8K ctx
Q4_K_M
132.75GB file 138.62GB
M

Mkurman

4 models

lfm2-350M-med

Unknown 8K ctx
Q8_0
0GB file 2GB

llama-3.2-MEDIT-3B-o1

3B 8K ctx
FP16
6GB file 8.05GB

phi4-MedIT-10B-o1

10B 8K ctx
FP16
20GB file 22.16GB

Qwen2.5-14B-DeepSeek-R1-1M

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
M

Mlabonne

1 models

Qwen3-0.6B-abliterated-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
M

Mlaprise

1 models

boustrophedon-14b

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
M

Mlx Community

1 models

Mistral-7B-v0.1-LoRA-Text2SQL

7B 8K ctx
Q8_0
7.44GB file 9.55GB
M

Mmacros

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
M

Mmis1000

12 models

asmr-qwen3.5-2b-zh-cn-echo-gguf-v0.1

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

asmr-qwen3.5-2b-zh-cn-gguf-v0.1

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

asmr-qwen3.5-2b-zh-tw-echo-gguf-v0.1

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

asmr-qwen3.5-2b-zh-tw-gguf-v0.1

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

asmr-qwen3.5-9b-zh-cn-echo-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-cn-echo-mtp-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-cn-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-cn-mtp-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-tw-echo-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-tw-echo-mtp-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-tw-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

asmr-qwen3.5-9b-zh-tw-mtp-gguf-v0.1

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
M

Mmnga

2 models

aibuncho-japanese-novel-gpt-j-6b-gguf

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_L
2.63GB file 4.73GB
Q3_K_M
2.63GB file 4.73GB
Q3_K_S
2.63GB file 4.73GB
Q4_0
3.38GB file 5.48GB
Q4_1
3.38GB file 5.48GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_0
4.13GB file 6.23GB
Q5_1
4.13GB file 6.23GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

gemma-3-270m-it-gguf

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_M
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
M

Mmnga O

3 models

NVIDIA-Nemotron-Nano-9B-v2-Japanese-gguf

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

plamo-3-nict-2b-base-gguf

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

plamo-3-nict-8b-base-gguf

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
M

Mmoralesf

1 models

mariana-qwen3-14b

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB