All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mfiscela

1 models

AldanaLLMQ4_2

Unknown 8K ctx
Q4_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB
M

Mghmffs

1 models

Conrrad-8B-Q4-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
M

Mgiessing

2 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
M

Mgoin

2 models

llama2-7b-gsm8k-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mistral-7b-gsm8k-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
M

Mgonzs13

4 models

ladybird-base-7B-v8-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Mistroll-7B-v2.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

stablelm-zephyr-3B-localmentor-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q4_XS
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB

TextBase-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
M

Mgrzegor

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
M

Mhmd Syd

1 models

AceGPT-13B-chat-GGUF

13B 8K ctx
Q4_K_S
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
M

Mhndayesh

1 models

OmniMesh-Qwen-v0.1

0.5B 8K ctx
FP16
1GB file 3.01GB
M

Mhylle

2 models

gemma3-270m-mist-9liner-bilingual-gguf

Unknown 8K ctx
FP16
0GB file 2GB

ministral-3b-mist-9liner-bilingual-gguf

3B 8K ctx
FP16
6GB file 8.05GB
M

Miao Mint

2 models

Ternary-Bonsai-1.7B-gguf

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB

Ternary-Bonsai-4B-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB