All Supported Models

29681 AI models · 198875 quantization formats tracked

T

Tanujrai

2 models

gemma-3-1b-it-Q4_0

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Instruct-Q4_0.gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
T

Tanziro

1 models

bangla-romanized-dhaka-shortchat-gemma3-1b-it-lora-clean-v2-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
T

Tapioca Takeshi

1 models

Qubit

Unknown 8K ctx
Q4_K_M
0GB file 2GB
T

Tapopadma

1 models

myai-F16-GGUF

1.1B 8K ctx
FP16
2.2GB file 4.22GB
T

Tarekxpc

1 models

mis_qa_gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
T

Tarklanse

1 models

Llama3-8B_Traditional_Chinese_roleplay_chat_GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
T

Taronaeo

8 models

Granite-3.0-1B-A400M-Instruct-BE-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Granite-3.1-2B-Instruct-BE-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Granite-3.3-2B-Instruct-BE-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Llama-3.2-1B-Instruct-BE-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-BE-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-1.5B-Instruct-BE-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-3B-Instruct-BE-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-Instruct-BE-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
T

Tarruda

2 models

Qwen3.5-397B-A17B-GGUF

397B 8K ctx
Q3_XXS
173.69GB file 182.19GB
BF16
794GB file 802.5GB

Qwen3.5-397B-A17B-heretic-smol-IQ2_XS-GGUF

397B 8K ctx
Q2_XS
124.06GB file 132.56GB
T

Tarun58

1 models

VaultCoder-3B

3B 8K ctx
FP16
6GB file 8.05GB
T

Tarxxxxxx

3 models

TX-12G

Unknown 8K ctx
FP16
0GB file 2GB

TX-16G

Unknown 8K ctx
FP16
0GB file 2GB

TX-8G

Unknown 8K ctx
FP16
0GB file 2GB