All Supported Models

29681 AI models · 198875 quantization formats tracked

T

Thelamapi

4 models

next-1b

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q1_0
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

next-270m

1B 8K ctx
Q8_0
1.06GB file 3.08GB

next-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB

next-70b-i1-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_S
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
T

Themex1380

1 models

Gemma-2-9B-Chinese-Chat-Uncensored

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
T

Theminji

2 models

Qwen3.5-2B-CasualConversations

2B 8K ctx
Q2_K_L
0.63GB file 2.66GB
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

xtest-exe

3B 8K ctx
Q8_0
3.19GB file 5.24GB
T

Theogott

2 models

pb-qwen3_5-9b-powerbasic-ggufs

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

spr-qwen3_5-9b-dora-vramsafe-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
T

Theoistic

1 models

gemma-3-1b-fo

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
T

Theprint

49 models

Boptruth-Agatha-7B

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Boptruth-NeuralMonarch-7B

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

CleverBoi-7B-v2

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

CleverBoi-7B-v3

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

CleverBoi-Gemma-2-9B-v2

9B 8K ctx
Q3_K_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

CleverBoi-Llama-3.1-8B-Instruct

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

CleverBoi-Llama-3.1-8B-v2

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

CleverBoi-Mistral-0.3-7B

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

CleverBoi-Nemo-12B

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

CleverBoi-Nemo-12B-v2

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

CleverBoi-Phi-3.5-mini-instruct

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB
BF16
7.6GB file 9.66GB

Conversely-Mistral-7B

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

DevilsAdvocate-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

DevilsAdvocate-7B-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

DevilsAdvocate-8B-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Empathetic-Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Gemma3-Python-22k-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

GeneralChat-Llama3.2-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Genuine-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Genuine-7B-Instruct-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Genuine-Phi4-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Genuine-Zeth-4B-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Hemispheres-v0.2-Llama3.2-3B-Final

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

LetsCode-Llama3.2-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

mistral-7b-cthulhu

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MLF-Llama3.2-3B

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

PersonalFinance-Llama3.2-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

phi-3-mini-4k-python

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Pythonified-Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

ReasonableMath-Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

ReWiz-7B

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Rewiz-Gemma3-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

ReWiz-Llama-3.1-8B-v2

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

ReWiz-Llama-3.2-3B

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

ReWiz-Qwen-2.5-14B

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Rewiz-Tom-7B

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

RRT1-3B

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

theprint-moe-8x3-0126-GGUF

0126B 8K ctx
Q2_0
39.38GB file 43.44GB
Q3_0
55.13GB file 59.19GB
Q4_0
70.88GB file 74.94GB
Q4_1
70.88GB file 74.94GB
Q5_0
86.63GB file 90.69GB
Q6_0
102.38GB file 106.44GB
Q8_0
133.88GB file 137.94GB

tinyllama_alpaca_cthulhu_small

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

tinyllama-Evol-Instruct

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

TiTan-Gemma3-0.27B-GGUF

0.27B 8K ctx
Q3_0
0.12GB file 2.12GB
Q4_0
0.15GB file 2.15GB
Q5_0
0.19GB file 2.19GB
Q6_0
0.22GB file 2.22GB
Q8_0
0.29GB file 2.29GB

TiTan-Gemma3-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

TiTan-Gemma3-4B-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

TiTan-Llama-3.2-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

TiTan-Qwen2.5-0.5B-GGUF

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Tom-Qwen-7B-Instruct

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

WorldBuilder-12B-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

WorldBuilder-7B-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Zeth-Gemma3-4B-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
T

Theros

1 models

temp1234-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB
T

Therummage

2 models

Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Huihui-Qwen3-30B-A3B-Thinking-2507-abliterated-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB
T

Theship87

6 models

ministral-4b-fork-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

ministral-4b-fork-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Ministral-4b-instruct-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Ministral-4b-instruct-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

qwen25-14b-fork-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

qwen25-14b-fork-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
T

Thesleebit

1 models

llama3-7b-finetuned-journal

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB