All Supported Models

29681 AI models · 198875 quantization formats tracked

L

Llm76

1 models

Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
L

Llmfan46

13 models

Darkidol-Ballad-27B-ultra-uncensored-heretic-v1-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Darkidol-Ballad-27B-ultra-uncensored-heretic-v2-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Gemma-4-Garnet-31B-it-uncensored-heretic-GGUF

31B 8K ctx
Q3_K_L
13.56GB file 16.07GB
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q4_K_S
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q5_K_S
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB
BF16
62GB file 64.51GB

Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-GGUF

31B 8K ctx
Q3_K_L
13.56GB file 16.07GB
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q4_K_S
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q5_K_S
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB
BF16
62GB file 64.51GB

GLM-4-32B-0414-uncensored-heretic-v1-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

GLM-4-32B-0414-uncensored-heretic-v2-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

GLM-Z1-32B-0414-uncensored-heretic-v1-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

GLM-Z1-32B-0414-uncensored-heretic-v2-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

gpt-oss-120b-heretic-v2-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

gpt-oss-120b-ultra-heretic-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

MiniMax-M2.7-ultra-uncensored-heretic-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-ultra-uncensored-heretic-v1-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-ultra-uncensored-heretic-v2-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB
L

Llmixer

1 models

BigWeave-v12-90b-Q_3_L-GGUF

90B 8K ctx
FP16
180GB file 183.47GB
L

Llmware

4 models

dragon-llama-7b-v0

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

dragon-mistral-7b-v0

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

dragon-yi-6b-v0

6B 8K ctx
Q4_0
3.38GB file 5.48GB
FP16
12GB file 14.1GB

tiny-llama-chat-gguf

1.1B 8K ctx
FP16
2.2GB file 4.22GB
L

Lmcoleman

3 models

DeepSWE-Preview-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

gemma-4-31B-Zeroclaw-ClaudeReasoning-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB

Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-Zeroclaw-GGUF

40B 8K ctx
Q4_K_M
22.5GB file 25.16GB
Q5_K_M
27.5GB file 30.16GB
L

Lmstudio Community

277 models

AceInstruct-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

AceInstruct-72B-GGUF

72B 8K ctx
Q3_K_L
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

AceInstruct-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

AceReason-Nemotron-1.1-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

AceReason-Nemotron-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

AceReason-Nemotron-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

AFM-4.5B-GGUF

4.5B 8K ctx
Q3_K_L
1.97GB file 4.04GB
Q4_K_M
2.53GB file 4.6GB
Q6_K
3.66GB file 5.73GB
Q8_0
4.78GB file 6.85GB

AlchemistCoder-DS-6.7B-GGUF

6.7B 8K ctx
Q4_K_M
3.77GB file 5.88GB
Q4_XS
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB

AlchemistCoder-L-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

AM-Thinking-v1-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

AMD-OLMo-1B-SFT-DPO-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

AMD-OLMo-1B-SFT-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Apriel-Nemotron-15b-Thinker-GGUF

15B 8K ctx
Q3_K_L
6.56GB file 8.81GB
Q4_K_M
8.44GB file 10.69GB
Q6_K
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

Athene-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Athene-V2-Agent-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Athene-V2-Chat-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

aya-23-35B-GGUF

35B 8K ctx
Q2_K
10.94GB file 13.51GB
Q2_M
10.94GB file 13.51GB
Q3_K_L
15.31GB file 17.88GB
Q3_K_S
15.31GB file 17.88GB
Q3_M
15.31GB file 17.88GB
Q4_K_M
19.69GB file 22.26GB
Q4_NL
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q6_K
28.44GB file 31.01GB
Q1_M
35GB file 37.57GB
Q8_0
37.19GB file 39.76GB

aya-23-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

aya-expanse-32b-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

aya-expanse-8b-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

ByteCraft-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

c4ai-command-a-03-2025-GGUF

2025B 8K ctx
Q3_K_L
885.94GB file 921.12GB
Q4_K_M
1139.06GB file 1174.24GB
Q6_K
1645.31GB file 1680.49GB
Q8_0
2151.56GB file 2186.74GB

c4ai-command-r-08-2024-GGUF

2024B 8K ctx
Q3_K_L
885.5GB file 920.66GB
Q4_0
1138.5GB file 1173.66GB
Q4_K_M
1138.5GB file 1173.66GB
Q6_K
1644.5GB file 1679.66GB
Q8_0
2150.5GB file 2185.66GB

c4ai-command-r-plus-08-2024-GGUF

2024B 8K ctx
Q3_K_L
885.5GB file 920.66GB
Q4_0
1138.5GB file 1173.66GB
Q4_K_M
1138.5GB file 1173.66GB
Q6_K
1644.5GB file 1679.66GB

c4ai-command-r-v01-GGUF

01B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

codegemma-1.1-7b-it-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

codegemma-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q2_M
0.63GB file 2.66GB
Q2_S
0.63GB file 2.66GB
Q2_XS
0.63GB file 2.66GB
Q2_XXS
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q1_M
2GB file 4.03GB
Q1_S
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB

codegemma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

codegemma-7b-it-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

CodeLlama-7B-KStack-clean-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

CodeLlama-7B-KStack-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Codestral-22B-v0.1-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q3_K_L
9.63GB file 11.99GB
Q3_K_M
9.63GB file 11.99GB
Q4_K_M
12.38GB file 14.74GB
Q4_XS
12.38GB file 14.74GB
Q5_K_M
15.13GB file 17.49GB
Q6_K
17.88GB file 20.24GB
Q8_0
23.38GB file 25.74GB

cogito-v1-preview-llama-3B-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

cogito-v1-preview-llama-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

cogito-v1-preview-llama-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

cogito-v1-preview-qwen-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

cogito-v1-preview-qwen-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

cogito-v2-preview-llama-109B-MoE-GGUF

109B 8K ctx
Q3_K_L
47.69GB file 51.48GB
Q4_K_M
61.31GB file 65.1GB
Q6_K
88.56GB file 92.35GB
Q8_0
115.81GB file 119.6GB

cogito-v2-preview-llama-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

datagemma-rag-27b-it-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

datagemma-rig-27b-it-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

DeepCoder-1.5B-Preview-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

DeepCoder-14B-Preview-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

deepseek-coder-1.3B-kexer-GGUF

1.3B 8K ctx
Q3_M
0.57GB file 2.59GB
Q4_K_M
0.73GB file 2.75GB
Q6_K
1.06GB file 3.08GB
Q8_0
1.38GB file 3.4GB

deepseek-coder-6.7B-kexer-GGUF

6.7B 8K ctx
Q3_M
2.93GB file 5.04GB
Q4_K_M
3.77GB file 5.88GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB

DeepSeek-Coder-V2-Instruct-0724-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

DeepSeek-Coder-V2-Lite-Instruct-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

DeepSeek-R1-0528-GGUF

0528B 8K ctx
Q3_K_L
231GB file 241.65GB
Q4_K_M
297GB file 307.65GB
Q6_K
429GB file 439.65GB
Q8_0
561GB file 571.65GB

DeepSeek-R1-0528-Qwen3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Llama-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

DeepSeek-R1-Distill-Llama-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-Distill-Qwen-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

DeepSeek-R1-Distill-Qwen-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

DeepSeek-R1-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

DeepSeek-V2.5-1210-GGUF

1210B 8K ctx
Q3_K_L
529.38GB file 551.2GB
Q4_K_M
680.63GB file 702.45GB
Q6_K
983.13GB file 1004.95GB
Q8_0
1285.63GB file 1307.45GB

DeepSeek-V2.5-GGUF

2.5B 8K ctx
Q4_K_M
1.41GB file 3.45GB
Q6_K
2.03GB file 4.07GB
Q8_0
2.66GB file 4.7GB

DeepSeek-V3-0324-GGUF

0324B 8K ctx
Q3_K_L
141.75GB file 149.06GB
Q4_K_M
182.25GB file 189.56GB
Q6_K
263.25GB file 270.56GB
Q8_0
344.25GB file 351.56GB

DeepSWE-Preview-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Devstral-Small-2505-GGUF

2505B 8K ctx
Q3_K_L
1095.94GB file 1138.98GB
Q4_K_M
1409.06GB file 1452.1GB
Q6_K
2035.31GB file 2078.35GB
Q8_0
2661.56GB file 2704.6GB

Dhanishtha-2.0-preview-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

DiscoPOP-zephyr-7b-gemma-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

dolphin-2.8-mistral-7b-v02-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

dots.llm1.inst-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

ERNIE-4.5-0.3B-GGUF

0.3B 8K ctx
Q3_K_L
0.13GB file 2.13GB
Q4_K_M
0.17GB file 2.17GB
Q6_K
0.24GB file 2.24GB
Q8_0
0.32GB file 2.32GB

ERNIE-4.5-21B-A3B-PT-GGUF

21B 8K ctx
Q3_K_L
9.19GB file 11.53GB
Q4_K_M
11.81GB file 14.15GB
Q6_K
17.06GB file 19.4GB
Q8_0
22.31GB file 24.65GB

EuroLLM-9B-Instruct-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

EXAONE-3.5-2.4B-Instruct-GGUF

2.4B 8K ctx
Q3_K_L
1.05GB file 3.09GB
Q4_K_M
1.35GB file 3.39GB
Q6_K
1.95GB file 3.99GB
Q8_0
2.55GB file 4.59GB

EXAONE-3.5-32B-Instruct-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

EXAONE-3.5-7.8B-Instruct-GGUF

7.8B 8K ctx
Q3_K_L
3.41GB file 5.54GB
Q4_K_M
4.39GB file 6.52GB
Q6_K
6.34GB file 8.47GB
Q8_0
8.29GB file 10.42GB

EXAONE-4.0.1-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

EXAONE-Deep-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

EXAONE-Deep-7.8B-GGUF

7.8B 8K ctx
Q3_K_L
3.41GB file 5.54GB
Q4_K_M
4.39GB file 6.52GB
Q6_K
6.34GB file 8.47GB
Q8_0
8.29GB file 10.42GB

Falcon3-10B-Instruct-GGUF

10B 8K ctx
Q3_K_L
4.38GB file 6.54GB
Q4_K_M
5.63GB file 7.79GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB

Falcon3-1B-Instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Falcon3-3B-Instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Falcon3-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

FineMath-Llama-3B-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

gemma-1.1-2b-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-27b-it-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

gemma-2-2b-it-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-2b-aps-it-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-1B-it-qat-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

gemma-7b-aps-it-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

GLM-4-32B-0414-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

GLM-4-9B-0414-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

GLM-4.5-Air-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

GLM-4.5-GGUF

4.5B 8K ctx
Q3_K_L
1.97GB file 4.04GB
Q4_K_M
2.53GB file 4.6GB
Q6_K
3.66GB file 5.73GB
Q8_0
4.78GB file 6.85GB

GLM-Z1-32B-0414-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

GLM-Z1-9B-0414-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

GLM-Z1-Rumination-32B-0414-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

granite-3.0-1b-a400m-instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

granite-3.0-2b-instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.0-3b-a800m-instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

granite-3.0-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.1-1b-a400m-instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

granite-3.1-2b-instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.1-3b-a800m-instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.2-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.3-2b-instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.3-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-embedding-107m-multilingual-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

granite-embedding-125m-english-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

granite-embedding-278m-multilingual-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

granite-embedding-30m-english-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Hermes-4-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Hunyuan-A13B-Instruct-GGUF

13B 8K ctx
Q3_K_L
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Hyperion-3.0-Mistral-7B-DPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

INTELLECT-1-Instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

INTELLECT-2-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

internlm2_5-1_8b-chat-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

internlm2_5-20b-chat-GGUF

20B 8K ctx
Q3_K_L
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB

internlm2-math-plus-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_M
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_XS
8.75GB file 11.08GB
Q3_XXS
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_NL
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_M
20GB file 22.33GB
Q1_S
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB

internlm2-math-plus-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

internlm2-math-plus-mixtral8x22b-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q2_M
6.88GB file 9.24GB
Q2_S
6.88GB file 9.24GB
Q2_XXS
6.88GB file 9.24GB
Q3_K_M
9.63GB file 11.99GB
Q3_M
9.63GB file 11.99GB
Q3_XS
9.63GB file 11.99GB
Q4_K_M
12.38GB file 14.74GB
Q4_K_S
12.38GB file 14.74GB
Q4_XS
12.38GB file 14.74GB
Q5_K_M
15.13GB file 17.49GB
Q6_K
17.88GB file 20.24GB
Q1_M
22GB file 24.36GB

internlm3-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

KernelLLM-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Kevin-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

KwaiCoder-AutoThink-preview-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Ling-lite-0415-GGUF

0415B 8K ctx
Q3_K_L
181.56GB file 190.36GB
Q4_K_M
233.44GB file 242.24GB
Q6_K
337.19GB file 345.99GB
Q8_0
440.94GB file 449.74GB

Llama-3_1-Nemotron-51B-Instruct-GGUF

51B 8K ctx
Q3_K_L
22.31GB file 25.15GB
Q4_K_M
28.69GB file 31.53GB
Q6_K
41.44GB file 44.28GB
Q8_0
54.19GB file 57.03GB

Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

253B 8K ctx
Q3_K_L
110.69GB file 116.84GB
Q4_K_M
142.31GB file 148.46GB
Q6_K
205.56GB file 211.71GB
Q8_0
268.81GB file 274.96GB

Llama-3-Groq-70B-Tool-Use-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Groq-8B-Tool-Use-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-UltraLong-1M-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-UltraLong-2M-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-UltraLong-4M-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Llama-3.1-Tulu-3-405B-GGUF

405B 8K ctx
Q3_K_L
177.19GB file 185.83GB
Q4_K_M
227.81GB file 236.45GB
Q6_K
329.06GB file 337.7GB
Q8_0
430.31GB file 438.95GB

Llama-3.1-Tulu-3-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-3.1-Tulu-3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-Tulu-3.1-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.3-70B-Instruct-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-4-Scout-17B-16E-Instruct-GGUF

17B 8K ctx
Q3_K_L
7.44GB file 9.72GB
Q4_K_M
9.56GB file 11.84GB
Q6_K
13.81GB file 16.09GB
Q8_0
18.06GB file 20.34GB

Llama3-ChatQA-1.5-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Llama3-ChatQA-1.5-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Magistral-Small-2506-GGUF

2506B 8K ctx
Q3_K_L
1096.38GB file 1139.44GB
Q4_K_M
1409.63GB file 1452.69GB
Q6_K
2036.13GB file 2079.19GB
Q8_0
2662.63GB file 2705.69GB

mathstral-7B-v0.1-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

medgemma-27b-text-it-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Meta-Llama-3-120B-Instruct-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q2_M
37.5GB file 41.47GB
Q3_K_L
52.5GB file 56.47GB
Q3_K_M
52.5GB file 56.47GB
Q3_K_S
52.5GB file 56.47GB
Q4_K_M
67.5GB file 71.47GB
Q4_K_S
67.5GB file 71.47GB
Q5_K_M
82.5GB file 86.47GB
Q5_K_S
82.5GB file 86.47GB
Q6_K
97.5GB file 101.47GB
Q1_M
120GB file 123.97GB
Q1_S
120GB file 123.97GB
Q8_0
127.5GB file 131.47GB

Meta-Llama-3-70B-Instruct-BPE-fix-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q1_M
70GB file 73.15GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q2_XS
21.88GB file 25.03GB
Q4_K_M
39.38GB file 42.53GB
Q1_M
70GB file 73.15GB

Meta-Llama-3-8B-Instruct-BPE-fix-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

MindLink-32B-0801-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

MindLink-72B-0801-GGUF

72B 8K ctx
Q3_K_L
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

Mistral-7B-Instruct-v0.3-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-Large-Instruct-2407-GGUF

2407B 8K ctx
Q2_K
752.19GB file 793.63GB
Q2_M
752.19GB file 793.63GB
Q3_K_M
1053.06GB file 1094.5GB
Q3_M
1053.06GB file 1094.5GB
Q3_XXS
1053.06GB file 1094.5GB
Q4_K_M
1353.94GB file 1395.38GB
Q4_XS
1353.94GB file 1395.38GB

Mistral-Large-Instruct-2411-GGUF

2411B 8K ctx
Q3_K_L
1054.81GB file 1096.31GB
Q4_K_M
1356.19GB file 1397.69GB
Q6_K
1958.94GB file 2000.44GB
Q8_0
2561.69GB file 2603.19GB

Mistral-Nemo-Instruct-2407-GGUF

2407B 8K ctx
Q3_K_L
1053.06GB file 1094.5GB
Q4_K_M
1353.94GB file 1395.38GB
Q6_K
1955.69GB file 1997.13GB
Q8_0
2557.44GB file 2598.88GB

Mistral-Small-24B-Instruct-2501-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Mistral-Small-3.1-24B-Instruct-2503-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Mistral-Small-Instruct-2409-GGUF

2409B 8K ctx
Q3_K_L
1053.94GB file 1095.41GB
Q4_K_M
1355.06GB file 1396.53GB
Q6_K
1957.31GB file 1998.78GB
Q8_0
2559.56GB file 2601.03GB

Nemotron-Research-Reasoning-Qwen-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

nomic-embed-code-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

NuExtract-v1.5-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

OlympicCoder-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OlympicCoder-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openchat-3.6-8b-20240522-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

OpenCoder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

OpenCoder-8B-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

OpenCodeReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

OpenCodeReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenCodeReasoning-Nemotron-32B-IOI-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenCodeReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openhands-lm-1.5b-v0.1-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

openhands-lm-32b-v0.1-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

openhands-lm-7b-v0.1-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenMath-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

OpenMath-Nemotron-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

OpenMath-Nemotron-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenMath-Nemotron-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenReasoning-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

OpenReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

OpenReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenThinker-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenThinker2-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenThinker2-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenThinker3-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OREAL-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OREAL-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OREAL-DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Phi-3.1-mini-128k-instruct-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.1-mini-4k-instruct-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.5-MoE-instruct-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

phi-4-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Phi-4-reasoning-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Phi-4-reasoning-plus-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen1.5-32B-Chat-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen2-500M-Instruct-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q4_XS
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q4_XS
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2-Math-72B-Instruct-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q2_M
22.5GB file 25.68GB
Q3_K_L
31.5GB file 34.68GB
Q3_K_M
31.5GB file 34.68GB
Q3_K_S
31.5GB file 34.68GB
Q3_M
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB

Qwen2-Math-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2-VL-2B-Instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_K_L
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-14B-Instruct-1M-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-32B-Instruct-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-72B-Instruct-GGUF

72B 8K ctx
Q3_K_L
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

Qwen2.5-7B-Instruct-1M-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-0.5B-GGUF

0.5B 8K ctx
Q3_K_L
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_K_L
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-14B-Instruct-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen2.5-Coder-32B-Instruct-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen2.5-Coder-3B-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Math-72B-Instruct-GGUF

72B 8K ctx
Q3_K_L
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

Qwen2.5-Math-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-VL-32B-Instruct-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q3_K_L
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

Qwen3-14B-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen3-235B-A22B-GGUF

235B 8K ctx
Q3_K_L
102.81GB file 108.66GB
Q4_K_M
132.19GB file 138.04GB
Q6_K
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB

Qwen3-235B-A22B-Instruct-2507-GGUF

235B 8K ctx
Q3_K_L
102.81GB file 108.66GB
Q4_K_M
132.19GB file 138.04GB
Q6_K
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB

Qwen3-235B-A22B-Thinking-2507-GGUF

235B 8K ctx
Q3_K_L
102.81GB file 108.66GB
Q4_K_M
132.19GB file 138.04GB
Q6_K
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q3_K_L
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q3_K_L
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen3-4B-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q3_K_L
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-Coder-480B-A35B-Instruct-GGUF

480B 8K ctx
Q3_K_L
210GB file 219.86GB
Q4_K_M
270GB file 279.86GB
Q6_K
390GB file 399.86GB
Q8_0
510GB file 519.86GB

QwQ-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

QwQ-32B-Preview-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

r1-1776-distill-llama-70b-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

r1-1776-GGUF

1776B 8K ctx
Q3_K_L
777GB file 808.1GB
Q4_K_M
999GB file 1030.1GB
Q6_K
1443GB file 1474.1GB
Q8_0
1887GB file 1918.1GB

reka-flash-3-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

reka-flash-3.1-GGUF

3.1B 8K ctx
Q3_K_L
1.36GB file 3.41GB
Q4_K_M
1.74GB file 3.79GB
Q6_K
2.52GB file 4.57GB
Q8_0
3.29GB file 5.34GB

sarvam-m-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Skywork-OR1-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Skywork-OR1-32B-Preview-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Skywork-OR1-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Skywork-OR1-7B-Preview-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Skywork-OR1-Math-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Skywork-SWE-32B-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q3_K_L
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

SmolLM2-135M-Instruct-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

SmolLM2-360M-Instruct-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

stable-code-instruct-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

starcoder2-15b-instruct-v0.1-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q2_XS
4.69GB file 6.94GB
Q4_K_M
8.44GB file 10.69GB
Q4_XS
8.44GB file 10.69GB
Q5_K_M
10.31GB file 12.56GB
Q6_K
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB

Starling-LM-7B-beta-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

txgemma-27b-chat-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

txgemma-9b-chat-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

wavecoder-ultra-6.7b-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q2_M
2.09GB file 4.2GB
Q2_S
2.09GB file 4.2GB
Q2_XS
2.09GB file 4.2GB
Q2_XXS
2.09GB file 4.2GB
Q3_K_L
2.93GB file 5.04GB
Q3_K_M
2.93GB file 5.04GB
Q3_K_S
2.93GB file 5.04GB
Q3_M
2.93GB file 5.04GB
Q3_S
2.93GB file 5.04GB
Q3_XS
2.93GB file 5.04GB
Q3_XXS
2.93GB file 5.04GB
Q4_K_M
3.77GB file 5.88GB
Q4_K_S
3.77GB file 5.88GB
Q4_NL
3.77GB file 5.88GB
Q4_XS
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q5_K_S
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q1_M
6.7GB file 8.81GB
Q1_S
6.7GB file 8.81GB
Q8_0
7.12GB file 9.23GB

WizardLM-2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

xLAM-7b-r-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

xLAM-8x7b-r-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Yi-1.5-34B-Chat-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q2_M
10.63GB file 13.19GB
Q3_K_L
14.88GB file 17.44GB
Q3_M
14.88GB file 17.44GB
Q4_K_M
19.13GB file 21.69GB
Q4_NL
19.13GB file 21.69GB
Q5_K_M
23.38GB file 25.94GB
Q6_K
27.63GB file 30.19GB
Q1_M
34GB file 36.56GB
Q8_0
36.13GB file 38.69GB

Yi-1.5-6B-Chat-GGUF

6B 8K ctx
Q3_K_L
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q4_NL
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

Yi-1.5-9B-Chat-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Yi-Coder-1.5B-Chat-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Yi-Coder-1.5B-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Yi-Coder-9B-Chat-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

zeta-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

ZR1-1.5B-GGUF

1.5B 8K ctx
Q3_K_L
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
L

Lmutimb

2 models

Meta-Llama-3.1-8B-Instruct-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Meta-Llama-3.1-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
L

Lnstagram

1 models

gemma3-1b-tool-use-merged

1B 8K ctx
FP16
2GB file 4.02GB
L

Lo W872

1 models

Nanbeige4.1-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
L

Lobitta

1 models

gpt-oss-20b-Derestricted-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB