All Supported Models

29681 AI models · 198875 quantization formats tracked

L

Lee Eric

1 models

openbuddy-codellama2-34b-v11.1-GGUF

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB
L

Lee Ite

1 models

Llama-3.1-8B-PHQ

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB
L

Leeminwaan

8 models

DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

gpt-oss-10.8b-specialized-all-pruned-moe-only-15-experts-GGUF

10.8B 8K ctx
Q2_0
3.38GB file 5.56GB
Q3_0
4.73GB file 6.91GB
Q4_0
6.08GB file 8.26GB
Q4_1
6.08GB file 8.26GB
Q5_0
7.43GB file 9.61GB
Q5_1
7.43GB file 9.61GB
Q6_0
8.78GB file 10.96GB
Q8_0
11.48GB file 13.66GB

gpt-oss-20b-pruned-10.2B-GGUF

10.2B 8K ctx
Q2_0
3.19GB file 5.36GB
Q3_0
4.46GB file 6.63GB
Q4_0
5.74GB file 7.91GB
Q4_1
5.74GB file 7.91GB
Q5_0
7.01GB file 9.18GB
Q5_1
7.01GB file 9.18GB
Q6_0
8.29GB file 10.46GB
Q8_0
10.84GB file 13.01GB

gpt-oss-4.2b-specialized-all-pruned-moe-only-4-experts-GGUF

4.2B 8K ctx
Q2_0
1.31GB file 3.38GB
Q3_0
1.84GB file 3.91GB
Q4_0
2.36GB file 4.43GB
Q4_1
2.36GB file 4.43GB
Q5_0
2.89GB file 4.96GB
Q5_1
2.89GB file 4.96GB
Q6_0
3.41GB file 5.48GB
Q8_0
4.46GB file 6.53GB

gpt-oss-6.0b-specialized-all-pruned-moe-only-7-experts-GGUF

6.0B 8K ctx
Q2_0
1.88GB file 3.98GB
Q3_0
2.63GB file 4.73GB
FP16
12GB file 14.1GB

qwen_3_4B_ViO_LR-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q5_1
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

SmolLM3-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
L

Leepaper

1 models

xLAM-2-32b-fc-r-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
L

Leeroy Jankins

1 models

jimi

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
L

Lefantom00

6 models

Hermes-3-iSMART

Unknown 8K ctx
Q5_0
0GB file 2GB
Q8_0
0GB file 2GB

Ministral-8B-it-2410-iSMART

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

Mistral-Nemo-it-2407-iSMART

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Qwen2.5-7B-it-1M-iSMART-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

Qwen3-8B-abliterated-iSMART

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

vinallama-7b-iSMART

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
L

Lefromage

14 models

gemma-2-27b-it-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

gemma-2-27b-it-Q4_0-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB

gemma-2-2b-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma-2-9b-it-Q2_K-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q3_K_S-GGUF

9B 8K ctx
Q3_0
3.94GB file 6.09GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

OlympicCoder-7B-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

OlympicCoder-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

OlympicCoder-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

OlympicCoder-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-Next-80B-A3B-Instruct-GGUF

80B 8K ctx
Q2_K
25GB file 28.31GB
Q3_K_L
35GB file 38.31GB
Q3_K_M
35GB file 38.31GB
Q3_K_S
35GB file 38.31GB
Q4_0
45GB file 48.31GB
Q4_1
45GB file 48.31GB
Q4_K_M
45GB file 48.31GB
Q4_K_S
45GB file 48.31GB
Q4_NL
45GB file 48.31GB
Q4_XS
45GB file 48.31GB
Q5_0
55GB file 58.31GB
Q5_K_M
55GB file 58.31GB
Q5_K_S
55GB file 58.31GB
Q6_K
65GB file 68.31GB
FP4
80GB file 83.31GB
Q8_0
85GB file 88.31GB

Qwen3-Next-80B-A3B-Instruct-split-GGUF

80B 8K ctx
Q2_K
25GB file 28.31GB
Q3_K_M
35GB file 38.31GB
Q4_0
45GB file 48.31GB
Q4_K_S
45GB file 48.31GB
Q4_NL
45GB file 48.31GB
Q4_XS
45GB file 48.31GB

Qwen3-Next-80B-A3B-Thinking-GGUF

80B 8K ctx
Q2_K
25GB file 28.31GB
Q3_K_M
35GB file 38.31GB
Q4_0
45GB file 48.31GB
Q4_K_M
45GB file 48.31GB
Q4_K_S
45GB file 48.31GB
Q5_K_M
55GB file 58.31GB
Q6_K
65GB file 68.31GB
FP4
80GB file 83.31GB
Q8_0
85GB file 88.31GB
L

Legendbl

1 models

GLM-4.7-Flash-Uncensored-Heretic-NEO-CODE-Imatrix-MAX-GGUF

Unknown 8K ctx
Q2_M
0GB file 2GB
Q3_M
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
L

Legenduck

1 models

llama-3-Korean-Bllossom-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
L

Legionarius

1 models

Nxcode-CQ-7B-orpo-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB