All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Andrewtxiz

1 models

granite-20b-code-instruct-8k-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB
A

Andrey R G W

1 models

fialka-7B-v3-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
A

Andri Lawrence

3 models

phi3-mini-128k-sft-merged

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Qwen-3B-Intent-Microplan-v1

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q5_K_M
2.06GB file 4.11GB

Qwen-3B-Intent-Microplan-v2

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
A

Andrijdavid

17 models

CarbonVillain-en-10.7B-v2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K
4.68GB file 6.86GB
Q3_K_L
4.68GB file 6.86GB
Q3_K_M
4.68GB file 6.86GB
Q3_K_S
4.68GB file 6.86GB
Q4_0
6.02GB file 8.2GB
Q4_1
6.02GB file 8.2GB
Q4_K
6.02GB file 8.2GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_0
7.36GB file 9.54GB
Q5_1
7.36GB file 9.54GB
Q5_K
7.36GB file 9.54GB
Q5_K_M
7.36GB file 9.54GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

CatPPT-base-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

finance-chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

LMCocktail-10.7B-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K
4.68GB file 6.86GB
Q3_K_L
4.68GB file 6.86GB
Q3_K_M
4.68GB file 6.86GB
Q3_K_S
4.68GB file 6.86GB
Q4_0
6.02GB file 8.2GB
Q4_1
6.02GB file 8.2GB
Q4_K
6.02GB file 8.2GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_0
7.36GB file 9.54GB
Q5_1
7.36GB file 9.54GB
Q5_K
7.36GB file 9.54GB
Q5_K_M
7.36GB file 9.54GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Marcoroni-7B-v3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MeanGirl-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

mindy-7b-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MiniMA-2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K
1.31GB file 3.36GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

MobileLLaMA-1.4B-Base-GGUF

1.4B 8K ctx
Q2_K
0.44GB file 2.46GB
Q3_K
0.61GB file 2.63GB
Q3_K_L
0.61GB file 2.63GB
Q3_K_M
0.61GB file 2.63GB
Q3_K_S
0.61GB file 2.63GB
Q4_0
0.79GB file 2.81GB
Q4_1
0.79GB file 2.81GB
Q4_K
0.79GB file 2.81GB
Q4_K_M
0.79GB file 2.81GB
Q4_K_S
0.79GB file 2.81GB
Q5_0
0.96GB file 2.98GB
Q5_1
0.96GB file 2.98GB
Q5_K
0.96GB file 2.98GB
Q5_K_M
0.96GB file 2.98GB
Q5_K_S
0.96GB file 2.98GB
Q6_K
1.14GB file 3.16GB
Q8_0
1.49GB file 3.51GB

phi-2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Sakura-SOLAR-Instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

StopCarbon-10.7B-v5-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K
4.68GB file 6.86GB
Q3_K_L
4.68GB file 6.86GB
Q3_K_M
4.68GB file 6.86GB
Q3_K_S
4.68GB file 6.86GB
Q4_0
6.02GB file 8.2GB
Q4_1
6.02GB file 8.2GB
Q4_K
6.02GB file 8.2GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_0
7.36GB file 9.54GB
Q5_1
7.36GB file 9.54GB
Q5_K
7.36GB file 9.54GB
Q5_K_M
7.36GB file 9.54GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

supermario-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

tinyfrank-1.4B-GGUF

1.4B 8K ctx
Q2_0
0.44GB file 2.46GB
Q2_K
0.44GB file 2.46GB
Q3_K
0.61GB file 2.63GB
Q3_K_L
0.61GB file 2.63GB
Q3_K_M
0.61GB file 2.63GB
Q3_K_S
0.61GB file 2.63GB
Q4_0
0.79GB file 2.81GB
Q4_1
0.79GB file 2.81GB
Q4_K
0.79GB file 2.81GB
Q4_K_M
0.79GB file 2.81GB
Q4_K_S
0.79GB file 2.81GB
Q5_0
0.96GB file 2.98GB
Q5_1
0.96GB file 2.98GB
Q5_K
0.96GB file 2.98GB
Q5_K_M
0.96GB file 2.98GB
Q5_K_S
0.96GB file 2.98GB
Q6_0
1.14GB file 3.16GB
Q6_K
1.14GB file 3.16GB
Q8_0
1.49GB file 3.51GB

TinyLlama-1.1B-32k-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K
0.48GB file 2.5GB
Q3_K_L
0.48GB file 2.5GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q4_0
0.62GB file 2.64GB
Q4_1
0.62GB file 2.64GB
Q4_K
0.62GB file 2.64GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_0
0.76GB file 2.78GB
Q5_1
0.76GB file 2.78GB
Q5_K
0.76GB file 2.78GB
Q5_K_M
0.76GB file 2.78GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

TinyLlama-1.1B-Chat-v1.0-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K
0.48GB file 2.5GB
Q3_K_L
0.48GB file 2.5GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q4_0
0.62GB file 2.64GB
Q4_1
0.62GB file 2.64GB
Q4_K
0.62GB file 2.64GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_0
0.76GB file 2.78GB
Q5_1
0.76GB file 2.78GB
Q5_K
0.76GB file 2.78GB
Q5_K_M
0.76GB file 2.78GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K
0.48GB file 2.5GB
Q3_K_L
0.48GB file 2.5GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q4_0
0.62GB file 2.64GB
Q4_1
0.62GB file 2.64GB
Q4_K
0.62GB file 2.64GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_0
0.76GB file 2.78GB
Q5_1
0.76GB file 2.78GB
Q5_K
0.76GB file 2.78GB
Q5_K_M
0.76GB file 2.78GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB
A

Androlike

2 models

astramix_l2_7b_gguf

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

TerraMix_L2_13B_16K_GGUF

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
FP16
26GB file 28.21GB
A

Andtt

12 models

AI21-Jamba-Reasoning-3B-Q3_K_S-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

AI21-Jamba-Reasoning-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Llama-3.1-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Qwen3-0.6B-Q3_K_S-GGUF

0.6B 8K ctx
Q3_0
0.26GB file 2.27GB
FP16
1.2GB file 3.21GB

Qwen3-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Qwen3-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Qwen3-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB
A

Andy0124

2 models

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Andycurrent

10 models

gemma-3-12b-it-uncensored-GGUF

12B 8K ctx
Q2_0
3.75GB file 5.95GB
Q3_0
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-4b-it-uncensored-v2-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Llama-3-8B-Lexi-Uncensored

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral-7B-Uncensored-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

12B 8K ctx
Q2_0
3.75GB file 5.95GB
Q3_0
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Qwen2.5-7B-Instruct-Uncensored_GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-VL-7B-Abliterated-Caption-it_GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen3-0.6B-heretic-abliterated-uncensored-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
FP16
1.2GB file 3.21GB

Qwen3.5-4B-Uncensored-HauhauCS-Aggressive

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB
A

Andyjack

1 models

GLM-4.6-REAP-252B-A32B-MXFP4_MOE_GGUF

252B 8K ctx
FP4
252GB file 258.13GB
A

Andysalerno

1 models

Phi-3-medium-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB