All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Marko Radojcic

2 models

YugoGPT-Florida_Q4_0.GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB

YugoGPT-Florida_Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
M

Markobes

3 models

lucky52-bloom-7b1-no-39-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

mt0-xxl-mt-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

mt0-xxl-mt-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB
M

Markrodrigo

4 models

Llama-3.1-8B-Instruct-Spatial-SQL-1.0-gguf

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-Spatial-SQL-1.0-gguf

1B 8K ctx
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Spatial-SQL-1.0-gguf

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.2-3B-Instruct-Spatial-SQL-1.1-gguf

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
M

Marksverdhai

1 models

asr-to-bash-gguf

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
M

Markvincevarga

1 models

mouse

3B 8K ctx
FP16
6GB file 8.05GB
M

Marlon81

1 models

Phi-3-mini-4k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB
M

Marmeelade

1 models

guillaumetell-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
M

Marnelram

1 models

prn-modelv1

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
M

Marroyo777

12 models

gemma-2-2b-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

phi-1_5-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

phi-2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

pip-SQL-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-1.5B-Instruct-IQ4_NL-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Instruct-Q2_K-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
M

Marsel M

2 models

C2S-Scale-Gemma-2-27B-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

C2S-Scale-Gemma-2-2B-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB