All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Arxorry

1 models

GLM-5.1-Abliterated-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB
A

Arya Y T

1 models

nl2shell-0.8b

0.8B 8K ctx
Q4_K_M
0.45GB file 2.46GB
Q8_0
0.85GB file 2.86GB
BF16
1.6GB file 3.61GB
A

Aryanne

22 models

Basilisk-4B-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB

Bean-3B-ggml-and-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB

CalderaAI_Hexoteric-7B-F16

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

ereb-test

Unknown 8K ctx
Q4_0
0GB file 2GB

Llama-2-4B-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB

llamatest

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Mamba-gpt-3B-v4-ggml-and-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB

MedWest-7B

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-3B-Instruct-v0.2-init

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

MixSwap

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

OmegLLaMA-3B-ggml-and-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Open-StarLake-Swap-7B

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

QwentileSwap

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

sheared-plus-westlake-50_75p

Unknown 8K ctx
Q4_0
0GB file 2GB

sheared-plus-westlake-nearest-50_75p

Unknown 8K ctx
Q4_0
0GB file 2GB

sheared-plus-westlake-normal

Unknown 8K ctx
Q4_0
0GB file 2GB

sheared-silicon10p

Unknown 8K ctx
FP16
0GB file 2GB
Q3_0
0GB file 2GB

TinyllamaMix-1.1B

1.1B 8K ctx
Q8_0
1.17GB file 3.19GB

Westest-7B

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

WestSenzu-Swap-7B

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

YarnLake-Swap-7B

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

YuE-s1-7B-anneal-en-cot-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB
A

Arzaan789

24 models

gemma-3-4b-uncensored

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

granite-3.3-2b-uncensored

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

h2o-danube-1.8b-uncensored

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_L
0.79GB file 2.82GB
Q3_K_M
0.79GB file 2.82GB
Q3_K_S
0.79GB file 2.82GB
Q4_K_M
1.01GB file 3.04GB
Q4_K_S
1.01GB file 3.04GB
Q5_K_M
1.24GB file 3.27GB
Q5_K_S
1.24GB file 3.27GB
Q6_K
1.46GB file 3.49GB
Q8_0
1.91GB file 3.94GB

llama-3.1-8b-uncensored

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

mistral-7b-uncensored

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

olmo2-1b-uncensored

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

phi-3-mini-uncensored

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

phi-4-mini-uncensored

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

qwen1.5-0.5b-uncensored

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

qwen2-0.5b-uncensored

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

qwen2-1.5b-uncensored

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

qwen2.5-0.5b-uncensored

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

qwen2.5-1.5b-uncensored

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

qwen2.5-3b-uncensored

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

qwen3.5-0.8b-uncensored

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_L
0.35GB file 2.36GB
Q3_K_M
0.35GB file 2.36GB
Q3_K_S
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q4_K_S
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q5_K_S
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

qwen3.5-2b-uncensored

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

qwen3.5-4b-uncensored

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

smollm-1.7b-uncensored

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

smollm-135m-uncensored

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

smollm-360m-uncensored

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

smolm2-1.7b-uncensored

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

smolm3-3b-uncensored

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

stablelm-2-1.6b-uncensored

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_L
2.63GB file 4.73GB
Q3_K_M
2.63GB file 4.73GB
Q3_K_S
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

stablelm-2-zephyr-1.6b-uncensored

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_L
2.63GB file 4.73GB
Q3_K_M
2.63GB file 4.73GB
Q3_K_S
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB
A

Arzeth

1 models

opencsg-starcoder2-15b-v0.1-GGUF

15B 8K ctx
Q3_K_L
6.56GB file 8.81GB
Q3_K_M
6.56GB file 8.81GB
Q3_M
6.56GB file 8.81GB
Q4_K_M
8.44GB file 10.69GB
Q4_NL
8.44GB file 10.69GB
Q5_K_M
10.31GB file 12.56GB
Q6_K
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB
A

Asaqibs

1 models

Terminus-LFM2.5-350m-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Asasidh

1 models

model

Unknown 8K ctx
Q8_0
0GB file 2GB
A

Ascktgcc

2 models

Mistral-nemo-ja-rp-v0.1

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Mistral-Nemo-Japanese-Instruct-2408-Q4_K_S-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB
A

Asdasdd121D2

2 models

Qwen2.5-Coder-0.5B-Instruct-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen2.5-Coder-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
A

Asdfasdasda

2 models

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB