All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jfierrot15

1 models

gemma-2-9b-Q2_K-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
FP16
18GB file 20.15GB
J

Jg007

3 models

functiongemma-270m-it-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

GaMS3-12B-Instruct-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

GaMS3-12B-Instruct-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB
J

Jgchaparro

1 models

language_garden-ell-tsd-8B-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
J

Jgolosova

2 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
J

Jhangmez

3 models

CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-q4_k_m

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q8_0
4.04GB file 6.1GB
J

Jharis97

7 models

Llama-3.2-1B-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q3_K_S-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_K_S-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
J

Jhofseth

1 models

Reflection-Llama-3.1-70B-GGUF

70B 8K ctx
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
J

Jhon676

1 models

TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf

20B 8K ctx
Q2_M
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_K_S
6.25GB file 8.58GB
Q2_K
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q3_XS
8.75GB file 11.08GB
Q3_XXS
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_L
8.75GB file 11.08GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q4_NL
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_S
20GB file 22.33GB
Q1_M
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
J

Jhonparra18

2 models

gpt2-large-sft-chat-eng-20ep-gguf

Unknown 8K ctx
FP16
0GB file 2GB

PetroQA-OrpoQwen2.5-7B-Instruct-gguf

7B 8K ctx
FP16
14GB file 16.11GB
J

Ji Ha

1 models

Speechless-Mistral-MoLORAs-7B-GGUF

7B 8K ctx
FP16
14GB file 16.11GB