All Supported Models

29681 AI models · 198875 quantization formats tracked

L

Levelfive

2 models

qwen2.5-coder-7b-instruct-q4km-complete

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

qwen2.5-coder-7b-instruct-q4km-only

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
L

Levosilimo

2 models

Qwen3.6-35B-A3B-Asymmetric-IQ4_KS-GGUF

35B 8K ctx
Q4_K
19.69GB file 22.26GB

Qwen3.6-35B-A3B-BF16-GGUF

35B 8K ctx
BF16
70GB file 72.57GB
L

Lewdiculous

20 models

Bepis_9B-GGUF-IQ-Imatrix

9B 8K ctx
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Copium-Cola-9B-GGUF-IQ-Imatrix

9B 8K ctx
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

EndlessRP-v3-7B-GGUF-Imatrix

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Eris_7B-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Eris_Remix_7B-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Erosumika-7B-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Erosumika-7B-v2-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Erosumika-7B-v3-0.2-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunocchini-1.2-7b-longtext-GGUF-Imatrix

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunocchini-7b-128k-test-GGUF-Imatrix

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunoichi-DPO-v2-7B-GGUF-Imatrix

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Layris_9B-GGUF-IQ-Imatrix

9B 8K ctx
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mistral-7b-v0.1-layla-v4-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

opus-v1.2-7b-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Pasta-Lake-7b-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB

Prima-LelantaclesV4-7b-16k-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Prima-LelantaclesV5-7b-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Prima-LelantaclesV6-7b-GGUF-IQ-Imatrix

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Prodigy_7B-GGUF-Imatrix

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
L

Lhambridge

1 models

Phi-4-mini-instruct-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB
L

Lhca521

3 models

Huihui-Qwen3.6-27B-abliterated-GGUF

27B 8K ctx
Q3_K_M
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

MiniMax-M2.7-Abliterated-Heretic-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
Q6_K
28.44GB file 31.01GB
Q8_0
37.19GB file 39.76GB
BF16
70GB file 72.57GB
L

Lhfazry

1 models

gemma-2b-chat-doctor

2B 8K ctx
FP16
4GB file 6.03GB
L

Lhz0912

1 models

Qwen2-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
L

Li Chen Yi

1 models

llama-2-7b-combined-1

7B 8K ctx
FP16
14GB file 16.11GB
L

Liamfudge

1 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
L

Liamhvn

2 models

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB

SmolLM2-135M-Instruct-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB