All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jiahua4

1 models

Qwen2-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
J

Jiangliuer00

1 models

Qwen2.5-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
J

Jianhu

1 models

Qwen2.5-Coder-1.5B-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB
J

Jianping746

4 models

Dolus-14b-Mini-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Llama3.1-8B-Chinese-Chat-IQ4_XS-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Mistral-NeMo-Minitron-8B-Chat-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
J

Jiansujiansu

1 models

Qwen3-Coder-30B-A3B-Instruct-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB
J

Jianxiansheng

1 models

gpt-oss-nano

20B 8K ctx
Q4_0
11.25GB file 13.58GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB
J

Jiaojjjjje

1 models

Qwen3.5-35B-A3B-abliterated-GGUF

35B 8K ctx
Q8_0
37.19GB file 39.76GB
J

Jie1888

1 models

Gemma-4-31B-JANG_4M-CRACK-GGUF

31B 8K ctx
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q8_0
32.94GB file 35.45GB
J

Jiejie0301

1 models

Llama3-8B-Chinese-Chat-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
J

Jihunnam

1 models

EXAONE-3.5-2.4B-Instruct-Q4_K_M-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
FP16
4.8GB file 6.84GB