All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mrfakename

1 models

mistral-small-3.1-24b-instruct-2503-gguf

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_L
10.5GB file 12.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_K
13.5GB file 15.89GB
Q5_K
16.5GB file 18.89GB
Q5_1
16.5GB file 18.89GB
Q5_0
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
M

Mrgnw

1 models

gemma-4-e2b-svelte5

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
M

Mrgoldengun

2 models

Qwen3-4B-Q2_K-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Q3_K_M-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB
M

Mrjackspade

1 models

Qwen2.5-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
M

Mrmage

16 models

gemma-2-2b-it-IQ3_M-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-IQ3_XXS-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q3_K_M-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Phi-3-mini-4k-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-IQ3_M-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q3_K_M-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2-0.5B-Instruct-Q3_K_M-GGUF

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-1.5B-Instruct-Q3_K_L-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q3_K_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
M

Mrs83

1 models

Kurtis-SmolLM2-360M-Instruct-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_K_M
0GB file 2GB
M

Msaad02

1 models

llama2_7b_brockportgpt_gguf

7B 8K ctx
Q4_1
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
M

Msaavedra1234

1 models

tiny_t

1.1B 8K ctx
FP16
2.2GB file 4.22GB
M

Mschill

1 models

dsa_llm

20B 8K ctx
FP4
20GB file 22.33GB
M

Msens

1 models

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB