All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Matrixportalx

138 models

ClimateLlama-8B-TR-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

DarkSapling-7B-v2.0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB

EmojiLlama-3.1-8B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Eurus-2-7B-PRIME-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

gemma-2-2b-it-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-2b-it-IQ3_M-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-IQ3_XXS-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-IQ4_NL-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-IQ4_XS-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q3_K_M-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q5_K_M-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q6_K-GGUF

2B 8K ctx
Q6_0
1.63GB file 3.66GB
FP16
4GB file 6.03GB

gemma-2-2b-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-2-9b-it-IQ3_M-GGUF

9B 8K ctx
Q3_0
3.94GB file 6.09GB
FP16
18GB file 20.15GB

gemma-2-9b-it-IQ3_XXS-GGUF

9B 8K ctx
Q3_0
3.94GB file 6.09GB
FP16
18GB file 20.15GB

gemma-2-9b-it-IQ4_NL-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q2_K-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-tr-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Gemmasutra-Small-4B-v1-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB

GLM-4-9B-0414-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

GLM-4-9B-0414-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gpt-oss-20b-abliterated_3.0-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

gpt-oss-20b-abliterated_3.0-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

Huihui-gpt-oss-20b-BF16-abliterated-v2-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

L3-Aspire-Heart-Matrix-8B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

L3-Deluxe-Scrambled-Eggs-On-Toast-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

L3-Super-Nova-RP-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

L3-Super-Nova-RP-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

L3-Umbral-Mind-RP-v0.3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

layerskip-llama3.2-1B-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

LLaMA-3-8B-Instruct-Abliterated-TR-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

LLaMA-3-8B-Instruct-Abliterated-TR-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

LLaMA-3-8B-Instruct-TR-DPO-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

LLaMA-3-8B-Instruct-TR-DPO-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Instruct-IQ3_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-IQ3_XXS-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-RainbowLight-EtherealMix-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3.1-8B-SpecialTitanFusion-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3.1-8B-SuperTulu-LexiNova-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3.1-Storm-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-chatml-tool-v4-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-1B-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-1B-Instruct-IQ4_NL-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.2-3B-Instruct-IQ3_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Llama-3.3-8B-Instruct-128K-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.3-8B-Instruct-128K-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-IQ3_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Ministral-3b-instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Ministral-3b-instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Ministral-3b-instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Ministral-3b-instruct-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Ministral-3b-instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Ministral-3b-instruct-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Mistral-7B-Erebus-v3-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-7B-Holodeck-1-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

NanoAgent-135M-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

NanoAgent-135M-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

OpenCoder-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-4-mini-instruct-Q3_K_L-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-4-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-HomerFuse-NerdExp-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-IQ3_XXS-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-IQ4_XS-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Math-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Math-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-14B-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB

Qwen3-30B-A3B-Instruct-2507-Q4_0-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB

Qwen3-30B-A3B-Instruct-2507-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

QwQ-LCoT2-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

ReaderLM-v2-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Turkish-Llama-3-8B-function-calling-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Turkish-Llama-8b-DPO-v0.1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Turkish-Llama-8b-Instruct-v0.1-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Turkish-Llama-8b-Instruct-v0.1-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Turkish-Llama-8b-Instruct-v0.1-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Turkish-Llama-8b-Instruct-v0.1-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

txgemma-2b-predict-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

txgemma-9b-chat-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

wiroai-turkish-llm-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

wiroai-turkish-llm-9b-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

YuLan-Mini-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

YuLan-Mini-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
M

Matt Hans93

1 models

ups-tools-qwen2.5-7b

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
M

Matteanedda

1 models

reasonong_mistral-7b-instruct-v0.3-bnb-4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
M

Matteocavestri

2 models

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
M

Matthewhaynesonline

1 models

SmolLM2-1.7B-Instruct-Matt-Shill-GGUF

1.7B 8K ctx
Q6_0
1.38GB file 3.41GB
FP16
3.4GB file 5.43GB
M

Mattiasalvetti

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
M

Mattimax

5 models

DAC5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

DAC5.4-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

DAC5.8-0.5B-Q5_K_M-GGUF

0.5B 8K ctx
Q5_0
0.34GB file 2.35GB
FP16
1GB file 3.01GB

DACNova-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

zagreus-0.4B-ita-Q4_K_M-GGUF

0.4B 8K ctx
Q4_0
0.23GB file 2.24GB
FP16
0.8GB file 2.81GB
M

Mattritchey

9 models

coolqwen-3b-it-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

DeepAnalyze-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

HelpingAI-3B-reloaded-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama3-DocChat-1.0-8B-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama3-DocChat-1.0-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

next-1b-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

next-270m-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

next-4b-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

smol_llama-220M-GQA-fineweb_edu-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
M

Mawdistical

16 models

Anthrobomination-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Anthrobomination-70B-IK-GGUF

70B 8K ctx
Q3_K
30.63GB file 33.78GB
Q4_K
39.38GB file 42.53GB

Draconia-Overdrive-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q8_0
34GB file 36.52GB

Incandescent-Malevolence-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Kuwutu-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Kuwutu-Lite-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Macabre-Intuitions-32B-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

Mawnia-12B-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q2_M
3.75GB file 5.95GB
Q2_S
3.75GB file 5.95GB
Q2_XS
3.75GB file 5.95GB
Q2_XXS
3.75GB file 5.95GB
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q3_M
5.25GB file 7.45GB
Q3_XS
5.25GB file 7.45GB
Q3_XXS
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q1_M
12GB file 14.2GB
Q8_0
12.75GB file 14.95GB

Predatorial-Extasy-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Squelching-Fantasies-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Squelching-Fantasies-70B-Regent-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Squelching-Fantasies-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Squelching-Fantasies-glm-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q8_0
34GB file 36.52GB

Squelching-Fantasies-qw3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_XS
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

Squelching-Fantasies-qw3-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q8_0
34GB file 36.52GB

Squelching-Fantasies-qw3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
M

Mawdistical S1

1 models

Gaslit-106B-GGUF

106B 8K ctx
Q2_K
33.13GB file 36.87GB
Q2_M
33.13GB file 36.87GB
Q2_S
33.13GB file 36.87GB
Q2_XS
33.13GB file 36.87GB
Q2_XXS
33.13GB file 36.87GB
Q3_K_L
46.38GB file 50.12GB
Q3_K_M
46.38GB file 50.12GB
Q3_K_S
46.38GB file 50.12GB
Q3_M
46.38GB file 50.12GB
Q3_XS
46.38GB file 50.12GB
Q3_XXS
46.38GB file 50.12GB
Q4_K_M
59.63GB file 63.37GB
Q4_K_S
59.63GB file 63.37GB
Q4_XS
59.63GB file 63.37GB
Q5_K_M
72.88GB file 76.62GB
Q5_K_S
72.88GB file 76.62GB
Q6_K
86.13GB file 89.87GB
Q1_M
106GB file 109.74GB
Q8_0
112.63GB file 116.37GB