All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jotaefecueme2

1 models

Meta-Llama-3-8B-Instruct-survey

8B 8K ctx
FP16
16GB file 18.13GB
J

Jott1970

4 models

Llama-2-13B-German-ORPO-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Llama-3.1-8B-Instruct-Fei-v1-Uncensored-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

LLAMA3.1-CHATBOT-02-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

talktoaiZERO-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB
J

Joumdane

1 models

Bifrost-27B-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K
11.81GB file 14.25GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q3_S
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_K
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K
18.56GB file 21GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
J

Joyboy Brian

1 models

Phi-3-mini-128k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
J

Joyjoandy

1 models

Qwen2.5-Sex

1.5B 8K ctx
FP16
3GB file 5.02GB
J

Jpacifico

5 models

Chocolatine-14B-Instruct-DPO-v1.2-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Chocolatine-2-14B-Instruct-v2.0.3-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Chocolatine-3B-Instruct-DPO-Revised-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Chocolatine-3B-Instruct-DPO-v1.2-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
J

Jpcurada

2 models

likas-gemma4-e2b-gguf

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
Q8_0
1.81GB file 3.84GB
J

Jphme

4 models

em_german_13b_leo_gguf

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

em_german_13b_v01_gguf

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

em_german_70b_v01_gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB

em_german_7b_v01_gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
J

Jpodivin

5 models

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB

mamba-2.8b-hf-GGUF

2.8B 8K ctx
Q2_K
0.88GB file 2.93GB
Q3_K
1.22GB file 3.27GB
Q3_K_L
1.22GB file 3.27GB
Q3_K_S
1.22GB file 3.27GB
Q4_0
1.58GB file 3.63GB
Q4_1
1.58GB file 3.63GB
Q4_K
1.58GB file 3.63GB
Q4_K_S
1.58GB file 3.63GB
Q5_0
1.92GB file 3.97GB
Q5_1
1.92GB file 3.97GB
Q5_K
1.92GB file 3.97GB
Q5_K_S
1.92GB file 3.97GB
Q6_K
2.28GB file 4.33GB
Q8_0
2.97GB file 5.02GB

Meta-Llama-Guard-2-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

rwkv-4-pile-169m-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
J

Jr12Lm12

1 models

Meta-Llama-3.1-8B-climate-expert-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB