All Supported Models

29681 AI models · 198875 quantization formats tracked

T

Teamblobfish

2 models

DeepSeek-V4-Flash-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q4_K_M
0GB file 2GB
Q8_0
0GB file 2GB

DeepSeek-V4-Pro-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q8_0
0GB file 2GB
T

Tech Meld

2 models

Llama3-ChatQA-1.5-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

NuminaMath-7B-TIR-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
T

Techwithsergiu

4 models

Qwen3.5-text-0.8B-GGUF

0.8B 8K ctx
Q4_K_M
0.45GB file 2.46GB
Q4_K_S
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

Qwen3.5-text-2B-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Qwen3.5-text-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-text-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
T

Teclabs

3 models

Llama-3.1-8b-Instruct-Ind-Tax-Act-1961

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8b-Instruct-Ind-Tax-Act-1961_Optimal

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

llama-capro

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
T

Teddylee777

10 models

camel-llama3-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB

EEVE-Korean-Instruct-10.8B-v1.0-gguf

10.8B 8K ctx
Q4_0
6.08GB file 8.26GB
Q4_1
6.08GB file 8.26GB
Q4_K_M
6.08GB file 8.26GB
Q4_K_S
6.08GB file 8.26GB
Q5_0
7.43GB file 9.61GB
Q5_K_M
7.43GB file 9.61GB
Q5_K_S
7.43GB file 9.61GB
Q6_K
8.78GB file 10.96GB
Q8_0
11.48GB file 13.66GB
FP16
21.6GB file 23.78GB
FP32
43.2GB file 45.38GB

ghost-8b-beta-1608-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama-3-8b-it-ko-chang-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-KoEn-8B-Instruct-preview-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-KoEn-8B-preview-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP32
32GB file 34.13GB

Llama-3-Open-Ko-8B-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Llama-3-Open-Ko-8B-Instruct-preview-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Qwen2.5-7B-Instruct-kowiki-qa-context-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP32
28GB file 30.11GB

Qwen2.5-7B-Instruct-kowiki-qa-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP32
28GB file 30.11GB
T

Teemperor

2 models

Phi-3-medium-128k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_0
3.09GB file 5.15GB
FP16
7.6GB file 9.66GB

starcoder2-15b-Q6_K-GGUF

15B 8K ctx
Q6_0
12.19GB file 14.44GB
FP16
30GB file 32.25GB
T

Teich A I

9 models

Qwen3-1.7B-Gemini-2.5-Flash-Lite-Preview-Distill-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-14B-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-GGUF

30B 8K ctx
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-4B-Instruct-2507-Polaris-Alpha-Distill-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Gemini-2.5-Flash-Distill-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Gemini-2.5-Flash-Lite-Preview-Distill-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-GPT-5-Codex-Distill-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B-Gemini-2.5-Flash-Distill-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB
T

Tekiny

6 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-Q5_K_S-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Mistral-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
T

Telecomadm1145

2 models

Qwen3-8B-Novel-Merged-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen3-8B-Novel-Merged-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
T

Teleprint Me

2 models

cyberpunk-valerie-v0.1

Unknown 8K ctx
FP16
0GB file 2GB

refact-1.6b-fim

6B 8K ctx
BF16
12GB file 14.1GB