All Supported Models

29681 AI models · 198875 quantization formats tracked

L

Linqiuvip

1 models

Qwen1.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
L

Linxsxs

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
L

Lipcut

1 models

shizhi-twilight-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
L

Liquid A I

18 models

LFM2-1.2B-Extract-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2-1.2B-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2-1.2B-RAG-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2-1.2B-Tool-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2-2.6B-Exp-GGUF

2.6B 8K ctx
Q4_0
1.46GB file 3.5GB
Q4_K_M
1.46GB file 3.5GB
Q5_K_M
1.79GB file 3.83GB
Q6_K
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB

LFM2-2.6B-GGUF

2.6B 8K ctx
Q4_0
1.46GB file 3.5GB
Q4_K_M
1.46GB file 3.5GB
Q5_K_M
1.79GB file 3.83GB
Q6_K
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB

LFM2-2.6B-Transcript-GGUF

2.6B 8K ctx
Q4_0
1.46GB file 3.5GB
Q4_K_M
1.46GB file 3.5GB
Q5_K_M
1.79GB file 3.83GB
Q6_K
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB
BF16
5.2GB file 7.24GB

LFM2-24B-A2B-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

LFM2-350M-Extract-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

LFM2-350M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

LFM2-350M-Math-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

LFM2-700M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

LFM2-8B-A1B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

LFM2.5-1.2B-Base-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-Instruct-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-JP-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2.5-1.2B-Thinking-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-350M-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
L

Liraz Ai

1 models

ember-agent-grpo-gemma4-2b-Q4_K_M

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
L

Listenrwt

1 models

chinese_light_novel_40k

Unknown 8K ctx
Q4_K_M
0GB file 2GB
L

Lite L L Ms

28 models

CarbonVillain-en-10.7B-v3-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K
4.68GB file 6.86GB
Q3_K_L
4.68GB file 6.86GB
Q3_K_M
4.68GB file 6.86GB
Q3_K_S
4.68GB file 6.86GB
Q4_0
6.02GB file 8.2GB
Q4_1
6.02GB file 8.2GB
Q4_K
6.02GB file 8.2GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_0
7.36GB file 9.54GB
Q5_1
7.36GB file 9.54GB
Q5_K
7.36GB file 9.54GB
Q5_K_M
7.36GB file 9.54GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

codegemma-1.1-7b-it-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

codegemma-7b-it-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Ko-Llama3-Luxia-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-8b-64k-PoSE-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Instruct-262k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Open-Ko-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Open-Ko-8B-Instruct-preview-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3-8B-Chinese-Chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3-ChatQA-1.5-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_1
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB

Meta-Llama-3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-Guard-2-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral-7B-Merge-14-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OGNO-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-llama3-8b-v21.1-8k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

openchat-3.6-8b-20240522-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Phi-3-medium-128k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_1
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q5_1
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3-mini-128k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_1
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q5_1
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3-mini-4k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_1
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q5_1
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Qwen1.5-110B-Chat-GGUF

110B 8K ctx
Q2_K
34.38GB file 38.18GB
Q3_K_L
48.13GB file 51.93GB
Q3_K_M
48.13GB file 51.93GB
Q3_K_S
48.13GB file 51.93GB
Q4_0
61.88GB file 65.68GB
Q4_1
61.88GB file 65.68GB
Q4_K_M
61.88GB file 65.68GB
Q4_K_S
61.88GB file 65.68GB
Q5_0
75.63GB file 79.43GB
Q5_1
75.63GB file 79.43GB
Q5_K_M
75.63GB file 79.43GB
Q5_K_S
75.63GB file 79.43GB
Q6_K
89.38GB file 93.18GB
Q8_0
116.88GB file 120.68GB

shieldgemma-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

shieldgemma-9b-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K
3.94GB file 6.09GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q5_K
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

starcoder2-15b-instruct-v0.1-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_L
6.56GB file 8.81GB
Q3_K_M
6.56GB file 8.81GB
Q3_K_S
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q4_1
8.44GB file 10.69GB
Q4_K_M
8.44GB file 10.69GB
Q4_K_S
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q5_1
10.31GB file 12.56GB
Q5_K_M
10.31GB file 12.56GB
Q5_K_S
10.31GB file 12.56GB
Q6_K
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

Turkish-Llama-8b-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
L

Lite Mind

1 models

YutaLM-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB
L

Littlekeivon

1 models

Llama-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB
L

Liullk

1 models

Qwen2.5-Sex

1.5B 8K ctx
FP16
3GB file 5.02GB