All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Genevera

3 models

glm-4-9b-chat-abliterated-Q6_K-GGUF

9B 8K ctx
Q6_0
7.31GB file 9.46GB
FP16
18GB file 20.15GB

medicine-chat-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

WiroAI-Finance-Gemma-9B-Q5_K_S-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB
G

Genie A I Lab

1 models

Omni-Genie

3B 8K ctx
Q4_0
1.69GB file 3.74GB
G

Gentekmedia

1 models

Llama-3.2-8X4B-MOE-V2-Dark-Champion-Instruct-uncensored-abliterated-21B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
G

Geoffmunn

13 models

Qwen3-0.6B-f16

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q2_K_HIFI
0.19GB file 2.2GB
Q3_K_HIFI
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q4_K_HIFI
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q5_K_HIFI
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-f16

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_HIFI
0.53GB file 2.56GB
Q3_K_HIFI
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_HIFI
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_HIFI
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

Qwen3-14B-f16

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_HIFI
4.38GB file 6.61GB
Q3_K_HIFI
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_HIFI
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_HIFI
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen3-30B-A3B-Thinking-2507

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-32B-f16

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_HIFI
10GB file 12.52GB
Q3_K_HIFI
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q4_K_HIFI
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q5_K_HIFI
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen3-4B-f16

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_HIFI
1.25GB file 3.32GB
Q3_K_HIFI
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_HIFI
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_HIFI
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-SafeRL-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-8B-f16

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_HIFI
2.5GB file 4.63GB
Q3_K_HIFI
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_HIFI
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_HIFI
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3-Coder-30B-A3B-Instruct-f16

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_HIFI
13.13GB file 15.62GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_K_HIFI
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-Coder-30B-A3B-Instruct-f32

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3Guard-Gen-0.6B

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

Qwen3Guard-Gen-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3Guard-Gen-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
G

Geonheechoi22

2 models

llama-2-ko-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Llama-3-Open-Ko-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Geonmin Kim

1 models

raft_llama3.2_1b-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
G

Geonsooda

1 models

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
G

George Bredis

1 models

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
G

Georgeck

2 models

Hacker-News-Comments-Summarization-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Hacker-News-Comments-Summarization-Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
G

Georgesung

1 models

llama3_8b_chat_uncensored

8B 8K ctx
Q4_0
4.5GB file 6.63GB