All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jackrong

19 models

DASD-1.7B-stage2-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
Q8_0
1.81GB file 3.84GB

DASD-4B-Thinking-2507-stage2-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Gemopus-4-26B-A4B-it-GGUF

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
Q5_K_M
17.88GB file 20.31GB
Q5_K_S
17.88GB file 20.31GB
Q6_K
21.13GB file 23.56GB
Q8_0
27.63GB file 30.06GB
BF16
52GB file 54.43GB

Gemopus-4-31B-it-GGUF

31B 8K ctx
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q5_K_S
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB
BF16
62GB file 64.51GB

GPT-5-Distill-llama3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

GPT-5-Distill-llama3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Llama-3.1-8B-Instruct-Chinese-Elite

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

llama-3.2-3B-Chinese-Elite

3B 8K ctx
FP16
6GB file 8.05GB

Llama3.1-8B-Thinking-R1-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

Qwen3-4B-Thinking-2507-GLM-4.7-Distilled-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_L
0.35GB file 2.36GB
Q3_K_M
0.35GB file 2.36GB
Q3_K_S
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q4_K_S
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q5_K_S
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB
BF16
1.6GB file 3.61GB

Qwen3.5-27B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Qwen3.5-2B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3.5-9B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

Qwen3.5-9B-Neo-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

Qwopus-GLM-18B-Merged-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Qwopus3.5-9B-Coder-MTP-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

Qwopus3.6-27B-v2-MTP-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
J

Jacky840327

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
J

Jacob Ml

2 models

jacob-24b

24B 8K ctx
Q4_0
13.5GB file 15.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

jacob-24b-prod

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB
J

Jacobcarajo

28 models

codegemma-1.1-7b-it-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

CodeLlama-13b-Python-hf-Q5_K_M-GGUF

13B 8K ctx
Q5_0
8.94GB file 11.15GB
FP16
26GB file 28.21GB

CodeQwen1.5-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Dolphin3.0-Mistral-24B-Q5_K_M-GGUF

24B 8K ctx
Q5_0
16.5GB file 18.89GB
FP16
48GB file 50.39GB

Dolphin3.0-R1-Mistral-24B-Q5_K_M-GGUF

24B 8K ctx
Q5_0
16.5GB file 18.89GB
FP16
48GB file 50.39GB

gemma-2-27b-it-Q5_K_M-GGUF

27B 8K ctx
Q5_0
18.56GB file 21GB
FP16
54GB file 56.44GB

gemma-2-9b-it-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Huihui-gpt-oss-20b-BF16-abliterated-Q5_K_M-GGUF

20B 8K ctx
Q5_0
13.75GB file 16.08GB

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3.5-mini-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB

phi-4-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Phi-4-reasoning-plus-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen2-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-Math-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-14B-Instruct-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen2.5-32B-Instruct-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

Qwen2.5-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-Math-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen3-30B-A3B-Instruct-2507-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-32B-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

Qwen3-Coder-30B-A3B-Instruct-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

starcoder2-15b-instruct-v0.1-Q5_K_M-GGUF

15B 8K ctx
Q5_0
10.31GB file 12.56GB
FP16
30GB file 32.25GB

starcoder2-15b-Q5_K_M-GGUF

15B 8K ctx
Q5_0
10.31GB file 12.56GB
FP16
30GB file 32.25GB
J

Jacobhoffmann

1 models

CodeLlama-13B-TestGen-Dart_v0.2-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB
J

Jacoposg

2 models

Llama-3.2-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
J

Jacytong

2 models

cscec_8bit_model

8B 8K ctx
Q1_0
8GB file 10.13GB

Deep-Seek-R1-32B-CSCEC-LoRa

32B 8K ctx
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
J

Jadael

1 models

comma-v0.1-2t-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
J

Jaelin

6 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
J

Jaewoo49

1 models

gemma-3-270m-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB