All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Achitech

4 models

DeepCoder-14B-Preview-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

DeepCoder-14B-Preview-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

DeepCoder-14B-Preview-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB

DeepCoder-14B-Preview-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
A

Acnoryx

1 models

Airy

0.8B 8K ctx
Q2_XXS
0.25GB file 2.26GB
Q2_K
0.25GB file 2.26GB
Q2_M
0.25GB file 2.26GB
Q2_XS
0.25GB file 2.26GB
Q3_M
0.35GB file 2.36GB
Q3_K_M
0.35GB file 2.36GB
Q1_S
0.8GB file 2.81GB
Q1_M
0.8GB file 2.81GB
A

Acon96

10 models

Home-1B-v1-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

Home-1B-v2-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

Home-1B-v3-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

Home-3B-v1-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Home-3B-v2-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Home-3B-v3-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Home-FunctionGemma-270m

9B 8K ctx
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

Home-Llama-3.2-3B

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

stablehome-multilingual-experimental

Unknown 8K ctx
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB
Q5_0
0GB file 2GB

tinyhome-polish-experimental

Unknown 8K ctx
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB
Q5_0
0GB file 2GB
A

Actionpace

8 models

Chronorctypus-Limarobormes-13b

13B 8K ctx
Q4_K_S
7.31GB file 9.52GB
Q4_K_M
7.31GB file 9.52GB
Q5_1
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB

Chronos-Hermes-2-Storywriter-mergetest

Unknown 8K ctx
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB

EvolCodeLlama-7b

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Kimiko-v2-13B-mergetest

13B 8K ctx
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

LimaRP-Llama2-13B-v3-EXPERIMENT-mergetest

13B 8K ctx
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

limarp-llama2-mergetest

Unknown 8K ctx
Q8_0
0GB file 2GB
Q5_K_M
0GB file 2GB

limarp-llama2-v2-mergetest

Unknown 8K ctx
Q8_0
0GB file 2GB
Q5_K_M
0GB file 2GB

Llama2-13B-no_robots-alpaca-lora-mergetest

13B 8K ctx
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB
A

Actualbrain

1 models

Phi-3-mini-4k-CodeInstruct-GGUF_q8_0

3.8B 8K ctx
Q8_0
4.04GB file 6.1GB
A

Actuator X

2 models

Llama-3.2-3B-Tele-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Tele-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
A

Adach27

2 models

Llama-PLLuM-8B-chat-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

PLLuM-8x7B-chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Adam Conway

1 models

Qwen2.5-Coder-7B-Instruct-Home-Assistant

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
A

Adam Grzesik

1 models

Samantha-PL-AG-Mistral-7B-v0.2

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
A

Adam Lucek

1 models

Orpo-Llama-3.2-1B-15k-Q4_K_M-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB