All Supported Models

29681 AI models · 198875 quantization formats tracked

O

Openthaigpt

7 models

openthaigpt-1.0.0-13b-chat

13B 8K ctx
FP16
26GB file 28.21GB

openthaigpt-1.0.0-70b-chat

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

openthaigpt-1.0.0-7b-chat

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

openthaigpt-1.0.0-7b-chat-gguf

7B 8K ctx
Q4_K
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

openthaigpt1.5-14b-instruct

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

openthaigpt1.5-72b-instruct

72B 8K ctx
Q4_0
40.5GB file 43.68GB
FP16
144GB file 147.18GB

openthaigpt1.5-7b-instruct

7B 8K ctx
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
O

Openwalrus

6 models

Qwen3-0.6B

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q2_K_L
0.19GB file 2.2GB
Q2_K_XL
0.19GB file 2.2GB
Q2_M
0.19GB file 2.2GB
Q2_XXS
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_K_XL
0.26GB file 2.27GB
Q3_XXS
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_K_XL
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_XL
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q6_K_XL
0.49GB file 2.5GB
Q1_M
0.6GB file 2.61GB
Q1_S
0.6GB file 2.61GB
Q8_0
0.64GB file 2.65GB
Q8_K_XL
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q2_K_XL
0.53GB file 2.56GB
Q2_M
0.53GB file 2.56GB
Q2_XXS
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_XXS
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_XL
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_XL
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q6_K_XL
1.38GB file 3.41GB
Q1_M
1.7GB file 3.73GB
Q1_S
1.7GB file 3.73GB
Q8_0
1.81GB file 3.84GB
Q8_K_XL
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-14B

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-32B

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

Qwen3-4B

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q1_S
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB
O

Openx A I Labs

1 models

nix-reviewer-1.5b-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
O

Operablepattern

1 models

gemma-2b-it-Q

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
O

Orabazes

1 models

QwQ-32B-Preview-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
O

Oracle Like

1 models

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_K_XL
0.84GB file 2.88GB
Q2_M
0.84GB file 2.88GB
Q2_XXS
0.84GB file 2.88GB
Q3_K_M
1.18GB file 3.22GB
Q3_K_S
1.18GB file 3.22GB
Q3_K_XL
1.18GB file 3.22GB
Q3_S
1.18GB file 3.22GB
Q3_XXS
1.18GB file 3.22GB
Q4_K_M
1.52GB file 3.56GB
Q4_K_S
1.52GB file 3.56GB
Q4_K_XL
1.52GB file 3.56GB
Q4_NL
1.52GB file 3.56GB
Q4_XS
1.52GB file 3.56GB
Q5_K_M
1.86GB file 3.9GB
Q5_K_S
1.86GB file 3.9GB
Q5_K_XL
1.86GB file 3.9GB
Q6_K
2.19GB file 4.23GB
Q6_K_XL
2.19GB file 4.23GB
FP4
2.7GB file 4.74GB
Q1_M
2.7GB file 4.74GB
Q8_0
2.87GB file 4.91GB
Q8_K_XL
2.87GB file 4.91GB
BF16
5.4GB file 7.44GB
O

Orange Q W Q

1 models

CapyTessBorosYi-Spicyboros-LimaRPv3-34B

34B 8K ctx
Q3_K_M
14.88GB file 17.44GB
Q4_K_M
19.13GB file 21.69GB
Q5_K_M
23.38GB file 25.94GB
Q6_K
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB
O

Orangelemonfrizzey

2 models

Nanbeige4.1-3B-heretic-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Nanbeige4.1-3B-heretic-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
O

Orchard Pair

3 models

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
O

Orcs Rise

1 models

qmd-query-expansion-lfm2-gguf

1.2B 8K ctx
Q8_0
1.28GB file 3.3GB