All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jananiranjith

1 models

tamil-llama-finetuned

7B 8K ctx
FP16
14GB file 16.11GB
J

Janeodum

1 models

tsaro-e2b-gguf

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q4_K_M
1.13GB file 3.16GB
J

Janhq

6 models

Jan-code-4b-gguf

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_L
1.75GB file 3.82GB
Q4_K_XL
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_1
2.75GB file 4.82GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Jan-v1-2509-gguf

2509B 8K ctx
Q4_K_M
1411.31GB file 1454.42GB
Q5_K_M
1724.94GB file 1768.05GB
Q6_K
2038.56GB file 2081.67GB
Q8_0
2665.81GB file 2708.92GB

Jan-v1-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Jan-v1-edge-gguf

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB

Jan-v3-4B-base-instruct-gguf

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Jan-v3.5-4B-gguf

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q5_K_S
2.75GB file 4.82GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
J

Janne Doe

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
J

Janspoerer

1 models

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
J

Jantam13

1 models

victor-triage-lora-llama3.1-8b-F16-GGUF

8B 8K ctx
FP16
16GB file 18.13GB
J

Jantxu

1 models

nano-llama

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
J

Janw23

2 models

Nxcode-CQ-7B-orpo-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
J

Jaredquek

1 models

OpenhermesTrial

7B 8K ctx
Q8_0
7.44GB file 9.55GB
J

Jarradh

2 models

GroveMoE-Inst-Q6_K-GGUF

Unknown 8K ctx
Q6_0
0GB file 2GB
FP16
0GB file 2GB

MiroThinker-v1.5-30B-heretic-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB