All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jbishop914

1 models

ue5-agent-qwen3b-merged

3B 8K ctx
FP16
6GB file 8.05GB
J

Jburmeister

6 models

Llama-3.3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
FP16
140GB file 143.15GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
FP16
140GB file 143.15GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-405B-Instruct-GGUF

405B 8K ctx
Q2_K
126.56GB file 135.2GB
Q3_K_S
177.19GB file 185.83GB

Meta-Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
J

Jburnford

4 models

dyslexic-writer-qwen3-0.6b

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
Q8_0
0.64GB file 2.65GB

dyslexic-writer-qwen3-1.7b

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
Q8_0
1.81GB file 3.84GB

dyslexic-writer-qwen3-14b

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB

dyslexic-writer-qwen3-4b

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
J

Jc Builds

6 models

Gemma-4-E4B-it-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB

Qwen3.5-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Qwen3.5-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

Qwen3.6-27B-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB

SmolLM3-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
J

Jcatumba

1 models

llama-3-8b-chat-legal

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
J

Jclees2

1 models

HyperCLOVAX-SEED-Text-Instruct-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
J

Jdecourval

1 models

chef-ai

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB
J

Jdhdhshsbzn

1 models

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
J

Jdopensource

1 models

JoyAI-LLM-Flash-GGUF

Unknown 8K ctx
Q3_XS
0GB file 2GB
Q4_XS
0GB file 2GB
Q8_0
0GB file 2GB
J

Jdouble U

1 models

careconnect-llama3.2-3b

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB