All Supported Models

29681 AI models · 198875 quantization formats tracked

U

U Office Force X

2 models

TAIDE-Llama3

Unknown 8K ctx
BF16
0GB file 2GB

Tame-Llama3

8B 8K ctx
BF16
16GB file 18.13GB
U

U Rajinda

1 models

ShweYon-V2.1-SFT

Unknown 8K ctx
Q8_0
0GB file 2GB
U

U S S Inferprise

1 models

Phi4-Mini-Prose2Tags-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
U

U S T C Knowledge Computing Lab

1 models

Llama3-KALE-LM-Chem-8B-gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
U

U2 D I A

2 models

gemma4-particle-edu-e4b

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

gemma4-particle-edu-loras

27B 8K ctx
FP16
54GB file 56.44GB
U

Uaebn

1 models

leesplank-municipal-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB
U

Uaritm

2 models

gemma3-amosov-final-model

Unknown 8K ctx
Q4_K_M
0GB file 2GB

gemmamed_cardio

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
U

Uaytug

2 models

uCoder-8b-base-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

ucoder-mini-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q2_M
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
U

Ubergarm

44 models

DeepSeek-R1-0528-GGUF

0528B 8K ctx
Q2_K_R4
165GB file 175.65GB
Q3_K
231GB file 241.65GB
Q3_K_R4
231GB file 241.65GB
Q4_K
297GB file 307.65GB
Q1_S
528GB file 538.65GB
Q1_S_R4
528GB file 538.65GB

DeepSeek-TNG-R1T2-Chimera-GGUF

Unknown 8K ctx
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K
0GB file 2GB

DeepSeek-V3-0324-GGUF

0324B 8K ctx
Q2_K_R4
101.25GB file 108.56GB
Q4_K_R4
182.25GB file 189.56GB
Q1_S_R4
324GB file 331.31GB

DeepSeek-V3.1-GGUF

3.1B 8K ctx
Q2_K
0.97GB file 3.02GB
Q3_K
1.36GB file 3.41GB
Q4_K
1.74GB file 3.79GB
Q5_K
2.13GB file 4.18GB
Q1_K
3.1GB file 5.15GB
Q1_S
3.1GB file 5.15GB

DeepSeek-V3.1-Terminus-GGUF

236B 8K ctx
Q2_K
73.75GB file 79.62GB
Q3_K
103.25GB file 109.12GB
Q4_K
132.75GB file 138.62GB
Q5_K
162.25GB file 168.12GB
Q1_K
236GB file 241.87GB
Q1_S
236GB file 241.87GB

DeepSeek-V3.2-Speciale-GGUF

236B 8K ctx
Q2_K
73.75GB file 79.62GB
Q3_K
103.25GB file 109.12GB
Q5_K
162.25GB file 168.12GB
Q1_K
236GB file 241.87GB

Devstral-2-123B-Instruct-2512-GGUF

123B 8K ctx
Q4_K
69.19GB file 73.21GB

Devstral-Small-2-24B-Instruct-2512-GGUF

24B 8K ctx
Q4_K
13.5GB file 15.89GB

gemma-3-27b-it-qat-GGUF

27B 8K ctx
Q3_0
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

GigaChat3-10B-A1.8B-GGUF

10B 8K ctx
Q2_K
3.13GB file 5.29GB
Q4_K
5.63GB file 7.79GB
Q5_K
6.88GB file 9.04GB
Q1_K
10GB file 12.16GB
Q8_0
10.63GB file 12.79GB

GLM-4.5-Air-GGUF

Unknown 8K ctx
Q1_K
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q4_K
0GB file 2GB
Q5_K
0GB file 2GB

GLM-4.5-GGUF

4.5B 8K ctx
Q2_K
1.41GB file 3.48GB
Q3_K
1.97GB file 4.04GB
Q4_K
2.53GB file 4.6GB
Q5_K
3.09GB file 5.16GB
Q1_K
4.5GB file 6.57GB

GLM-4.6-GGUF

4.6B 8K ctx
Q2_K
1.44GB file 3.52GB
Q3_K
2.01GB file 4.09GB
Q4_K
2.59GB file 4.67GB
Q5_K
3.16GB file 5.24GB
Q1_K
4.6GB file 6.68GB

GLM-4.7-Flash-GGUF

Unknown 8K ctx
FP4
0GB file 2GB
Q4_K
0GB file 2GB
Q5_K
0GB file 2GB

GLM-4.7-GGUF

4.7B 8K ctx
Q2_K
1.47GB file 3.55GB
Q3_K
2.06GB file 4.14GB
Q4_K
2.64GB file 4.72GB
Q5_K
3.23GB file 5.31GB
Q1_K
4.7GB file 6.78GB

GLM-5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q3_K
2.19GB file 4.27GB
Q1_K
5GB file 7.08GB

GLM-5.1-GGUF

5.1B 8K ctx
Q2_K
1.59GB file 3.67GB
Q3_K
2.23GB file 4.31GB
Q4_K
2.87GB file 4.95GB
Q1_K
5.1GB file 7.18GB

Hunyuan-A13B-Instruct-GGUF

13B 8K ctx
Q3_K
5.69GB file 7.9GB

Kimi-Dev-72B-GGUF

72B 8K ctx
Q3_K
31.5GB file 34.68GB

Kimi-K2-Instruct-0905-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q4_K
1.13GB file 3.16GB
Q5_K
1.38GB file 3.41GB
Q1_K
2GB file 4.03GB

Kimi-K2-Instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q4_K
1.13GB file 3.16GB
Q1_K
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB

Kimi-K2-Thinking-GGUF

Unknown 8K ctx
Q1_K
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q4_K
0GB file 2GB
Q4_X
0GB file 2GB

Kimi-K2.5-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB
Q3_K
1.09GB file 3.13GB
Q1_K
2.5GB file 4.54GB

Kimi-K2.6-GGUF

2.6B 8K ctx
Q2_K
0.81GB file 2.85GB
Q3_K
1.14GB file 3.18GB
Q4_X
1.46GB file 3.5GB
Q1_K
2.6GB file 4.64GB

Ling-1T-GGUF

Unknown 8K ctx
Q1_K
0GB file 2GB
Q2_K
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K
0GB file 2GB
Q4_K
0GB file 2GB
Q5_K
0GB file 2GB

MiMo-V2-Flash-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q5_K
0GB file 2GB

MiniMax-M2.5-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB
Q3_K
1.09GB file 3.13GB
Q4_K
1.41GB file 3.45GB
Q4_NL
1.41GB file 3.45GB
Q4_XS
1.41GB file 3.45GB
Q5_K
1.72GB file 3.76GB

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_K
0.84GB file 2.88GB
Q3_K
1.18GB file 3.22GB
Q4_K
1.52GB file 3.56GB
Q5_K
1.86GB file 3.9GB
Q1_0
2.7GB file 4.74GB

Qwen3-14B-GGUF

14B 8K ctx
Q4_K
7.88GB file 10.11GB

Qwen3-235B-A22B-GGUF

235B 8K ctx
Q3_K
102.81GB file 108.66GB

Qwen3-235B-A22B-Instruct-2507-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q3_K
102.81GB file 108.66GB
Q4_K
132.19GB file 138.04GB
Q5_K
161.56GB file 167.41GB

Qwen3-235B-A22B-Thinking-2507-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q3_K
102.81GB file 108.66GB
Q4_K
132.19GB file 138.04GB
Q5_K
161.56GB file 167.41GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q4_K
16.88GB file 19.37GB

Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K
13.13GB file 15.62GB
Q4_K
16.88GB file 19.37GB
Q5_K
20.63GB file 23.12GB
Q1_K
30GB file 32.49GB

Qwen3-30B-A3B-Thinking-2507-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_K
16.88GB file 19.37GB
Q5_K
20.63GB file 23.12GB
Q1_K
30GB file 32.49GB

Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K
13.13GB file 15.62GB
Q4_K
16.88GB file 19.37GB
Q5_K
20.63GB file 23.12GB
Q1_K
30GB file 32.49GB

Qwen3-Coder-480B-A35B-Instruct-GGUF

480B 8K ctx
Q2_K
150GB file 159.86GB
Q3_K
210GB file 219.86GB
Q4_K
270GB file 279.86GB
Q5_K
330GB file 339.86GB
Q1_K
480GB file 489.86GB

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q2_K
17.81GB file 20.74GB
Q3_K
24.94GB file 27.87GB
Q4_0
32.06GB file 34.99GB
Q4_K
32.06GB file 34.99GB
Q1_K
57GB file 59.93GB

Qwen3.5-122B-A10B-GGUF

122B 8K ctx
Q2_K
38.13GB file 42.13GB
Q4_K
68.63GB file 72.63GB
Q5_K
83.88GB file 87.88GB
Q1_K
122GB file 126GB

Qwen3.5-27B-GGUF

27B 8K ctx
Q4_NL
15.19GB file 17.63GB
Q5_K
18.56GB file 21GB

Qwen3.5-35B-A3B-GGUF

35B 8K ctx
Q4_0
19.69GB file 22.26GB
Q4_K
19.69GB file 22.26GB

Qwen3.5-397B-A17B-GGUF

397B 8K ctx
Q2_K
124.06GB file 132.56GB
Q2_XS
124.06GB file 132.56GB
Q3_K
173.69GB file 182.19GB
Q4_K
223.31GB file 231.81GB
Q1_K
397GB file 405.5GB
BF16
794GB file 802.5GB

Qwen3.6-27B-GGUF

27B 8K ctx
Q4_K
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q5_K
18.56GB file 21GB

Step-3.5-Flash-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K
0GB file 2GB
Q4_K
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K
0GB file 2GB
U

Ubermorgen

1 models

qwen3-devops

1.7B 8K ctx
FP16
3.4GB file 5.43GB