All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Rocwo

2 models

Mistral-7B.F16-Instruct-v0.2-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B.Q8_0-Instruct-v0.2-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
R

Roderick3Rd

1 models

AR15_Expert_Larry_3B_4bit

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
R

Rodial

1 models

Qwen3-Omni-30B-A3B-Thinking-GGUF

30B 8K ctx
FP16
60GB file 62.49GB
R

Rodrigomt

7 models

gama-12b-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

granite-4.0-h-small-heretic-high-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q4_K_XL
0GB file 2GB

Jan-v1-2509-GGUF

2509B 8K ctx
Q4_K_XL
1411.31GB file 1454.42GB
Q8_K_XL
2665.81GB file 2708.92GB

quem-V2-4b-GGUF

4B 8K ctx
Q4_K_XL
2.25GB file 4.32GB
Q8_K_XL
4.25GB file 6.32GB

Qwen3-30B-A3B-Thinking-Deepseek-Distill-2507-v3.1-V2-GGUF

30B 8K ctx
Q3_K_XL
13.13GB file 15.62GB
Q4_K_XL
16.88GB file 19.37GB
Q5_K_XL
20.63GB file 23.12GB

Qwen3-Coder-30B-A3B-Instruct-480b-Distill-V2-GGUF

30B 8K ctx
Q3_K_XL
13.13GB file 15.62GB
Q4_K_XL
16.88GB file 19.37GB
Q5_K_XL
20.63GB file 23.12GB

WEBGEN-4B-Preview-480B-Double-Distill-GGUF

4B 8K ctx
Q4_K_XL
2.25GB file 4.32GB
Q8_K_XL
4.25GB file 6.32GB
R

Rohanify

1 models

Indenta-13M-Python

Unknown 8K ctx
FP16
0GB file 2GB
R

Rohanjain2312

1 models

medical-mistral-7b

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
R

Rohithbojja

1 models

llama3.1-Intent

Unknown 8K ctx
FP16
0GB file 2GB
R

Rohithporandla417

1 models

llama-3.2-3b

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
R

Roleplaiapp

962 models

14B-Qwen2.5-Kunou-v1-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

14B-Qwen2.5-Kunou-v1-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

14B-Qwen2.5-Kunou-v1-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

14B-Qwen2.5-Kunou-v1-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

14B-Qwen2.5-Kunou-v1-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

14B-Qwen2.5-Kunou-v1-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

14B-Qwen2.5-Kunou-v1-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

14B-Qwen2.5-Kunou-v1-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

14B-Qwen2.5-Kunou-v1-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

14B-Qwen2.5-Kunou-v1-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

14B-Qwen2.5-Kunou-v1-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

AceInstruct-1.5B-Q2_K-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q3_K_L-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q3_K_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q3_K_S-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

AceInstruct-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q5_0-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB

AceInstruct-1.5B-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q5_K_S-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB

AceInstruct-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

AceInstruct-72B-Q2_K-GGUF

72B 8K ctx
Q2_0
22.5GB file 25.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q3_K_L-GGUF

72B 8K ctx
Q3_0
31.5GB file 34.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q3_K_M-GGUF

72B 8K ctx
Q3_0
31.5GB file 34.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q3_K_S-GGUF

72B 8K ctx
Q3_0
31.5GB file 34.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q4_0-GGUF

72B 8K ctx
Q4_0
40.5GB file 43.68GB

AceInstruct-72B-Q4_K_M-GGUF

72B 8K ctx
Q4_0
40.5GB file 43.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q4_K_S-GGUF

72B 8K ctx
Q4_0
40.5GB file 43.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q5_0-GGUF

72B 8K ctx
Q5_0
49.5GB file 52.68GB

AceInstruct-72B-Q5_K_M-GGUF

72B 8K ctx
Q5_0
49.5GB file 52.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q6_K-GGUF

72B 8K ctx
Q6_0
58.5GB file 61.68GB
FP16
144GB file 147.18GB

AceInstruct-72B-Q8_0-GGUF

72B 8K ctx
Q8_0
76.5GB file 79.68GB

AceInstruct-7B-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q3_K_M-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

AceInstruct-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

AceInstruct-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

AceInstruct-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

ALIA-40b-Q2_K-GGUF

40B 8K ctx
Q2_0
12.5GB file 15.16GB
FP16
80GB file 82.66GB

ALIA-40b-Q4_0-GGUF

40B 8K ctx
Q4_0
22.5GB file 25.16GB

ALIA-40b-Q5_0-GGUF

40B 8K ctx
Q5_0
27.5GB file 30.16GB

ALIA-40b-Q6_K-GGUF

40B 8K ctx
Q6_0
32.5GB file 35.16GB
FP16
80GB file 82.66GB

ALIA-40b-Q8_0-GGUF

40B 8K ctx
Q8_0
42.5GB file 45.16GB

Apteed-LLM-Instruct-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Apteed-LLM-Instruct-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

Apteed-LLM-Instruct-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Apteed-LLM-Instruct-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

Apteed-LLM-Instruct-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

Apteed-LLM-Instruct-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

Apteed-LLM-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Apteed-LLM-Instruct-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

Apteed-LLM-Instruct-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

Apteed-LLM-Instruct-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

Apteed-LLM-Instruct-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

Apteed-LLM-Instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

ArxivLlama-3.1-8B-f16-GGUF

8B 8K ctx
FP16
16GB file 18.13GB

ArxivLlama-3.1-8B-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

ArxivLlama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

ArxivLlama-3.1-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

ArxivLlama-3.1-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

ArxivLlama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

ArxivLlama-3.1-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

ArxivLlama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Chocolatine-2-14B-Instruct-v2.0b2-i1-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Chocolatine-2-14B-Instruct-v2.0b2-i1-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Chocolatine-2-14B-Instruct-v2.0b2-i1-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Codestral-22B-v0.1-Q2_K-GGUF

22B 8K ctx
Q2_0
6.88GB file 9.24GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q3_K_L-GGUF

22B 8K ctx
Q3_0
9.63GB file 11.99GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q3_K_M-GGUF

22B 8K ctx
Q3_0
9.63GB file 11.99GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q3_K_S-GGUF

22B 8K ctx
Q3_0
9.63GB file 11.99GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q4_0-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB

Codestral-22B-v0.1-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q4_K_S-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q5_0-GGUF

22B 8K ctx
Q5_0
15.13GB file 17.49GB

Codestral-22B-v0.1-Q5_K_M-GGUF

22B 8K ctx
Q5_0
15.13GB file 17.49GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q5_K_S-GGUF

22B 8K ctx
Q5_0
15.13GB file 17.49GB
FP16
44GB file 46.36GB

Codestral-22B-v0.1-Q6_K-GGUF

22B 8K ctx
Q6_0
17.88GB file 20.24GB
FP16
44GB file 46.36GB

Confucius-o1-14B-f16-GGUF

14B 8K ctx
FP16
28GB file 30.23GB

Confucius-o1-14B-IQ3_M-GGUF

14B 8K ctx
Q3_M
6.13GB file 8.36GB

Confucius-o1-14B-IQ3_XS-GGUF

14B 8K ctx
Q3_XS
6.13GB file 8.36GB

Confucius-o1-14B-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Confucius-o1-14B-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Confucius-o1-14B-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Confucius-o1-14B-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Confucius-o1-14B-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

Confucius-o1-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Confucius-o1-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Confucius-o1-14B-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

Confucius-o1-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

Confucius-o1-14B-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Confucius-o1-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Crumb-13B-IQ4_XS-GGUF

13B 8K ctx
Q4_XS
7.31GB file 9.52GB

Crumb-13B-Q2_K-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Crumb-13B-Q3_K_L-GGUF

13B 8K ctx
Q3_K_L
5.69GB file 7.9GB

Crumb-13B-Q3_K_M-GGUF

13B 8K ctx
Q3_K_M
5.69GB file 7.9GB

Crumb-13B-Q3_K_S-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB

Crumb-13B-Q4_K_M-GGUF

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB

Crumb-13B-Q4_K_S-GGUF

13B 8K ctx
Q4_K_S
7.31GB file 9.52GB

Crumb-13B-Q5_K_M-GGUF

13B 8K ctx
Q5_K_M
8.94GB file 11.15GB

Crumb-13B-Q5_K_S-GGUF

13B 8K ctx
Q5_K_S
8.94GB file 11.15GB

Crumb-13B-Q6_K-GGUF

13B 8K ctx
Q6_K
10.56GB file 12.77GB

Crumb-13B-Q8_0-GGUF

13B 8K ctx
Q8_0
13.81GB file 16.02GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-IQ3_M-GGUF

14B 8K ctx
Q3_M
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-IQ3_S-GGUF

14B 8K ctx
Q3_S
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-IQ3_XS-GGUF

14B 8K ctx
Q3_XS
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-IQ3_S-GGUF

32B 8K ctx
Q3_S
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-IQ3_XS-GGUF

32B 8K ctx
Q3_XS
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

cyberagent-DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

Cydonia-24B-v2a-Q2_K-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB

Cydonia-24B-v2a-Q3_K_M-GGUF

24B 8K ctx
Q3_K_M
10.5GB file 12.89GB

Cydonia-24B-v2a-Q4_K_M-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB

Cydonia-24B-v2a-Q5_K_M-GGUF

24B 8K ctx
Q5_K_M
16.5GB file 18.89GB

Cydonia-24B-v2a-Q6_K-GGUF

24B 8K ctx
Q6_K
19.5GB file 21.89GB

Cydonia-24B-v2a-Q8_0-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-f16-GGUF

8B 8K ctx
FP16
16GB file 18.13GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-i1-IQ3_M-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-i1-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-i1-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-i1-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-i1-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Alpaca-FineTuned-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

DeepSeek-R1-Distill-Alpaca-FineTuned-IQ4_XS-GGUF

671B 8K ctx
Q4_XS
377.44GB file 390.43GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q2_K-GGUF

671B 8K ctx
Q2_K
209.69GB file 222.68GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q3_K_L-GGUF

671B 8K ctx
Q3_K_L
293.56GB file 306.55GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q3_K_M-GGUF

671B 8K ctx
Q3_K_M
293.56GB file 306.55GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q4_K_S-GGUF

671B 8K ctx
Q4_K_S
377.44GB file 390.43GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q5_K_M-GGUF

671B 8K ctx
Q5_K_M
461.31GB file 474.3GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q5_K_S-GGUF

671B 8K ctx
Q5_K_S
461.31GB file 474.3GB

DeepSeek-R1-Distill-Alpaca-FineTuned-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-IQ3_M-GGUF

165B 8K ctx
Q3_M
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-IQ3_S-GGUF

165B 8K ctx
Q3_S
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-IQ3_XS-GGUF

165B 8K ctx
Q3_XS
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-IQ4_XS-GGUF

165B 8K ctx
Q4_XS
92.81GB file 97.51GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q2_K-GGUF

165B 8K ctx
Q2_K
51.56GB file 56.26GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q3_K_L-GGUF

165B 8K ctx
Q3_K_L
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q3_K_M-GGUF

165B 8K ctx
Q3_K_M
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q3_K_S-GGUF

165B 8K ctx
Q3_K_S
72.19GB file 76.89GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q4_K_M-GGUF

165B 8K ctx
Q4_K_M
92.81GB file 97.51GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q4_K_S-GGUF

165B 8K ctx
Q4_K_S
92.81GB file 97.51GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q5_K_M-GGUF

165B 8K ctx
Q5_K_M
113.44GB file 118.14GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q5_K_S-GGUF

165B 8K ctx
Q5_K_S
113.44GB file 118.14GB

DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q6_K-GGUF

165B 8K ctx
Q6_K
134.06GB file 138.76GB

DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB

DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q5_0-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB

DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

70B 8K ctx
Q6_0
56.88GB file 60.03GB
FP16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-70B-Q8_0-GGUF

70B 8K ctx
Q8_0
74.38GB file 77.53GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-IQ4_XS-GGUF

70B 8K ctx
Q4_XS
39.38GB file 42.53GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q2_K-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q3_K_L-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q3_K_M-GGUF

70B 8K ctx
Q3_K_M
30.63GB file 33.78GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q3_K_S-GGUF

70B 8K ctx
Q3_K_S
30.63GB file 33.78GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q4_K_S-GGUF

70B 8K ctx
Q4_K_S
39.38GB file 42.53GB

DeepSeek-R1-Distill-Llama-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-1.5B-Q2_K-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_L-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_S-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q5_0-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB

DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_S-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB

DeepSeek-R1-Distill-Qwen-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-gguf-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

DeepSeek-R1-Distill-Qwen-14B-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q3_K_L-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q3_K_S-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB

DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q5_0-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB

DeepSeek-R1-Distill-Qwen-14B-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB

DeepSeek-R1-Distill-Qwen-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

DeepSeek-R1-Distill-Qwen-32B-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q3_K_L-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q3_K_M-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q3_K_S-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q4_0-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB

DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q4_K_S-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q5_0-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB

DeepSeek-R1-Distill-Qwen-32B-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q6_K-GGUF

32B 8K ctx
Q6_0
26GB file 28.52GB
FP16
64GB file 66.52GB

DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

DeepSeek-R1-Distill-Qwen-7B-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q3_K_L-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q3_K_M-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

DeepSeek-R1-Distill-Qwen-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

DeepSeek-R1-Distill-Qwen-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

DeepSeek-R1-Distill-sthenno-14b-0121-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

DeepSeek-R1-Distill-sthenno-14b-0121-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

deepseek-r1-qwen-2.5-32B-ablated-f16-GGUF

32B 8K ctx
BF16
64GB file 66.52GB

deepseek-r1-qwen-2.5-32B-ablated-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

deepseek-r1-qwen-2.5-32B-ablated-IQ3_XS-GGUF

32B 8K ctx
Q3_XS
14GB file 16.52GB

deepseek-r1-qwen-2.5-32B-ablated-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

deepseek-r1-qwen-2.5-32B-ablated-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

DeepSky-T100-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

DeepSky-T100-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

DeepSky-T100-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

DeepSky-T100-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

DeepSky-T100-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

DeepSky-T100-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

DeepSky-T100-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

DeepSky-T100-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

DeepSky-T100-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

DeepSky-T100-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

DialoGPT-medium-anand-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

DialoGPT-medium-anand-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

DialoGPT-medium-anand-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

DialoGPT-medium-anand-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

DialoGPT-medium-anand-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

DialoGPT-medium-anand-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

DialoGPT-medium-anand-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

DialoGPT-medium-anand-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

DialoGPT-medium-anand-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

DialoGPT-medium-anand-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

DialoGPT-medium-anand-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

DialoGPT-medium-anand-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Dolphin3.0-Llama3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Dolphin3.0-Llama3.1-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

Dolphin3.0-Llama3.1-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

Dolphin3.0-Llama3.1-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Dolphin3.0-Llama3.1-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

Dolphin3.0-Llama3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Dolphin3.0-Llama3.1-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

Dolphin3.0-Llama3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Dolphin3.0-Llama3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Dria-Agent-a-3B-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q3_K_L-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q3_K_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q3_K_S-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Dria-Agent-a-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q5_0-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB

Dria-Agent-a-3B-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Dria-Agent-a-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Dria-Agent-a-7B-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q3_K_L-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q3_K_M-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Dria-Agent-a-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

Dria-Agent-a-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Dria-Agent-a-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-IQ3_M-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-IQ3_S-GGUF

8B 8K ctx
Q3_S
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-IQ3_XS-GGUF

8B 8K ctx
Q3_XS
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-IQ4_XS-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q3_K_L-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q3_K_M-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q3_K_S-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q4_K_M-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q4_K_S-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q5_K_M-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q5_K_S-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q6_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

DS-R1-Distill-Q2.5-14B-Harmony_V0.1-Q8_0-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB

FastHunyuan-gguf-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

FastHunyuan-gguf-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

FastHunyuan-gguf-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

FastHunyuan-gguf-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Fimbulvetr-11B-v2-i1-Q2_K-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

Fimbulvetr-11B-v2-i1-Q3_K_S-GGUF

11B 8K ctx
Q3_K_S
4.81GB file 6.99GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-f16-GGUF

32B 8K ctx
BF16
64GB file 66.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-IQ3_XS-GGUF

32B 8K ctx
Q3_XS
14GB file 16.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

FuseO1-DeekSeekR1-QwQ-SkyT1-32B-Preview-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

Gemma-The-Writer-N-Restless-Quill-10B-Uncensored-IQ4_XS-GGUF

10B 8K ctx
Q4_XS
5.63GB file 7.79GB

Gemma-The-Writer-N-Restless-Quill-10B-Uncensored-Q8_0-GGUF

10B 8K ctx
Q8_0
10.63GB file 12.79GB

GRAG-R1-14B-SFT-DE-EXP-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

GRAG-R1-14B-SFT-DE-EXP-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

GRAG-R1-14B-SFT-DE-EXP-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

GRAG-R1-14B-SFT-DE-EXP-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

GRAG-R1-14B-SFT-DE-EXP-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

GRAG-R1-14B-SFT-DE-EXP-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

GRAG-R1-14B-SFT-DE-EXP-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

GRAG-R1-14B-SFT-DE-EXP-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

GRAG-R1-14B-SFT-DE-EXP-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

GRAG-R1-14B-SFT-DE-EXP-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

internlm3-8b-instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

internlm3-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

internlm3-8b-instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

internlm3-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Jaja-small-v1-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Jaja-small-v1-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

Jaja-small-v1-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Jaja-small-v1-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

Jaja-small-v1-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

Jaja-small-v1-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

Jaja-small-v1-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Jaja-small-v1-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

Jaja-small-v1-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

Jaja-small-v1-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

Jaja-small-v1-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

Jaja-small-v1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Janus-Pro-7B-LM-f16-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

Janus-Pro-7B-LM-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Janus-Pro-7B-LM-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Janus-Pro-7B-LM-Q3_K_L-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB

Janus-Pro-7B-LM-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Janus-Pro-7B-LM-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

Janus-Pro-7B-LM-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Janus-Pro-7B-LM-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

Janus-Pro-7B-LM-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Janus-Pro-7B-LM-Q5_K_S-GGUF

7B 8K ctx
Q5_K_S
4.81GB file 6.92GB

Janus-Pro-7B-LM-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Janus-Pro-7B-LM-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

JapMed-SLERP-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

JapMed-SLERP-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

JapMed-SLERP-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

JapMed-SLERP-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

JapMed-SLERP-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

JapMed-SLERP-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

JapMed-SLERP-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

JapMed-SLERP-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

JapMed-SLERP-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

JapMed-SLERP-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

JapMed-SLERP-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

L3-DARKEST-PLANET-16.5B-IQ4_XS-GGUF

165B 8K ctx
Q4_XS
92.81GB file 97.51GB

L3-DARKEST-PLANET-16.5B-Q8_0-GGUF

165B 8K ctx
Q8_0
175.31GB file 180.01GB

L3.3-Nevoria-R1-70b-IQ3_M-GGUF

70B 8K ctx
Q3_M
30.63GB file 33.78GB

L3.3-Nevoria-R1-70b-IQ4_XS-GGUF

70B 8K ctx
Q4_XS
39.38GB file 42.53GB

L3.3-Nevoria-R1-70b-Q3_K_L-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB

L3.3-Nevoria-R1-70b-Q3_K_M-GGUF

70B 8K ctx
Q3_K_M
30.63GB file 33.78GB

L3.3-Nevoria-R1-70b-Q3_K_S-GGUF

70B 8K ctx
Q3_K_S
30.63GB file 33.78GB

L3.3-Nevoria-R1-70b-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

L3.3-Nevoria-R1-70b-Q6_K-GGUF

70B 8K ctx
Q6_K
56.88GB file 60.03GB

Lascivious-LLaMa-70B-Q2_K-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Lascivious-LLaMa-70B-Q4_K_S-GGUF

70B 8K ctx
Q4_K_S
39.38GB file 42.53GB

Llama-3-monika-ddlc-11.5b-v1-i1-IQ3_M-GGUF

115B 8K ctx
Q3_M
50.31GB file 54.19GB

Llama-3-monika-ddlc-11.5b-v1-i1-IQ3_S-GGUF

115B 8K ctx
Q3_S
50.31GB file 54.19GB

Llama-3-monika-ddlc-11.5b-v1-i1-IQ3_XS-GGUF

115B 8K ctx
Q3_XS
50.31GB file 54.19GB

Llama-3-monika-ddlc-11.5b-v1-i1-IQ4_XS-GGUF

115B 8K ctx
Q4_XS
64.69GB file 68.57GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q2_K-GGUF

115B 8K ctx
Q2_K
35.94GB file 39.82GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q3_K_L-GGUF

115B 8K ctx
Q3_K_L
50.31GB file 54.19GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q3_K_M-GGUF

115B 8K ctx
Q3_K_M
50.31GB file 54.19GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q4_K_M-GGUF

115B 8K ctx
Q4_K_M
64.69GB file 68.57GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q4_K_S-GGUF

115B 8K ctx
Q4_K_S
64.69GB file 68.57GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q5_K_M-GGUF

115B 8K ctx
Q5_K_M
79.06GB file 82.94GB

Llama-3-monika-ddlc-11.5b-v1-i1-Q6_K-GGUF

115B 8K ctx
Q6_K
93.44GB file 97.32GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

70B 8K ctx
Q6_0
56.88GB file 60.03GB
FP16
140GB file 143.15GB

Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

70B 8K ctx
Q8_0
74.38GB file 77.53GB

Llama-3.2-3B-Instruct-uncensored-Q2_K-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Llama-3.2-3B-Instruct-uncensored-Q6_K-GGUF

3B 8K ctx
Q6_K
2.44GB file 4.49GB

Llama-3.3-70B-Instruct-Q2_K-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q3_K_L-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q3_K_M-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q3_K_S-GGUF

70B 8K ctx
Q3_0
30.63GB file 33.78GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q4_0-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB

Llama-3.3-70B-Instruct-Q4_K_M-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q4_K_S-GGUF

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q5_0-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB

Llama-3.3-70B-Instruct-Q5_K_M-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q5_K_S-GGUF

70B 8K ctx
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q6_K-GGUF

70B 8K ctx
Q6_0
56.88GB file 60.03GB
FP16
140GB file 143.15GB

Llama-3.3-70B-Instruct-Q8_0-GGUF

70B 8K ctx
Q8_0
74.38GB file 77.53GB

Llama3-Chinese-8B-Instruct-f16-GGUF

8B 8K ctx
FP16
16GB file 18.13GB

Llama3-Chinese-8B-Instruct-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

Llama3-Chinese-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama3-Chinese-8B-Instruct-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

Llama3-Chinese-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

Llama3-Chinese-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

Llama3-Chinese-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Llama3-Chinese-8B-Instruct-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

Llama3-Chinese-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Llama3-Chinese-8B-Instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

Llama3-Chinese-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Llama3.2-doker-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Llama3.2-doker-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

Llama3.2-doker-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

Llama3.2-doker-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

Llama3.2-doker-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

Llama3.2-doker-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

Llama3.2-doker-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

Llama3.2-doker-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

Llama3.2-doker-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

medicine-LLM-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

medicine-LLM-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

medicine-LLM-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

medicine-LLM-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

medicine-LLM-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

medicine-LLM-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

medicine-LLM-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

medicine-LLM-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

medicine-LLM-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Midnight-Miqu-70B-v1.5-i1-IQ3_M-GGUF

70B 8K ctx
Q3_M
30.63GB file 33.78GB

Midnight-Miqu-70B-v1.5-i1-IQ3_S-GGUF

70B 8K ctx
Q3_S
30.63GB file 33.78GB

Midnight-Miqu-70B-v1.5-i1-IQ3_XS-GGUF

70B 8K ctx
Q3_XS
30.63GB file 33.78GB

Midnight-Miqu-70B-v1.5-i1-Q2_K-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Midnight-Miqu-70B-v1.5-i1-Q3_K_L-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB

Midnight-Miqu-70B-v1.5-i1-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

Midnight-Miqu-70B-v1.5-i1-Q4_K_S-GGUF

70B 8K ctx
Q4_K_S
39.38GB file 42.53GB

Minerva-14b-V0.1-i1-IQ3_M-GGUF

14B 8K ctx
Q3_M
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-IQ3_S-GGUF

14B 8K ctx
Q3_S
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-IQ3_XS-GGUF

14B 8K ctx
Q3_XS
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Minerva-14b-V0.1-i1-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

Minerva-14b-V0.1-i1-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Minerva-14b-V0.1-i1-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Minerva-14b-V0.1-i1-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

Minerva-14b-V0.1-i1-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

Minerva-14b-V0.1-i1-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Mistral-MOE-4X7B-Dark-MultiVerse-Uncensored-Enhanced32-24B-gguf-IQ4_XS-GGUF

24B 8K ctx
Q4_XS
13.5GB file 15.89GB

Mistral-MOE-4X7B-Dark-MultiVerse-Uncensored-Enhanced32-24B-gguf-Q8_0-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

Mistral-Small-24B-Instruct-2501-f16-GGUF

24B 8K ctx
FP16
48GB file 50.39GB

Mistral-Small-24B-Instruct-2501-IQ3_M-GGUF

24B 8K ctx
Q3_M
10.5GB file 12.89GB

Mistral-Small-24B-Instruct-2501-IQ3_XS-GGUF

24B 8K ctx
Q3_XS
10.5GB file 12.89GB

Mistral-Small-24B-Instruct-2501-IQ4_XS-GGUF

24B 8K ctx
Q4_XS
13.5GB file 15.89GB

Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB

Mistral-Small-24B-Instruct-2501-Q3_K_L-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB

Mistral-Small-24B-Instruct-2501-Q3_K_M-GGUF

24B 8K ctx
Q3_K_M
10.5GB file 12.89GB

Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

24B 8K ctx
Q3_K_S
10.5GB file 12.89GB

Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB

Mistral-Small-24B-Instruct-2501-Q4_K_S-GGUF

24B 8K ctx
Q4_K_S
13.5GB file 15.89GB

Mistral-Small-24B-Instruct-2501-Q5_K_M-GGUF

24B 8K ctx
Q5_K_M
16.5GB file 18.89GB

Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

24B 8K ctx
Q5_K_S
16.5GB file 18.89GB

Mistral-Small-24B-Instruct-2501-Q6_K-GGUF

24B 8K ctx
Q6_K
19.5GB file 21.89GB

Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

MistralRP-Noromaid-NSFW-Mistral-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

MistralRP-Noromaid-NSFW-Mistral-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

MN-12B-Mag-Mell-R1-IQ3_M-GGUF

12B 8K ctx
Q3_M
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-IQ3_S-GGUF

12B 8K ctx
Q3_S
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-IQ3_XS-GGUF

12B 8K ctx
Q3_XS
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-IQ4_XS-GGUF

12B 8K ctx
Q4_XS
6.75GB file 8.95GB

MN-12B-Mag-Mell-R1-Q2_K-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

MN-12B-Mag-Mell-R1-Q3_K_L-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-Q3_K_M-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-Q3_K_S-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB

MN-12B-Mag-Mell-R1-Q4_K_M-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

MN-12B-Mag-Mell-R1-Q4_K_S-GGUF

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB

MN-12B-Mag-Mell-R1-Q5_K_M-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB

MN-12B-Mag-Mell-R1-Q5_K_S-GGUF

12B 8K ctx
Q5_K_S
8.25GB file 10.45GB

MN-12B-Mag-Mell-R1-Q6_K-GGUF

12B 8K ctx
Q6_K
9.75GB file 11.95GB

MN-12B-Mag-Mell-R1-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

MN-12B-Mimicore-Orochi-IQ4_XS-GGUF

12B 8K ctx
Q4_XS
6.75GB file 8.95GB

MN-12B-Mimicore-Orochi-Q2_K-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

MN-12B-Mimicore-Orochi-Q3_K_L-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB

MN-12B-Mimicore-Orochi-Q3_K_M-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB

MN-12B-Mimicore-Orochi-Q3_K_S-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB

MN-12B-Mimicore-Orochi-Q4_K_M-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

MN-12B-Mimicore-Orochi-Q4_K_S-GGUF

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB

MN-12B-Mimicore-Orochi-Q5_K_M-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB

MN-12B-Mimicore-Orochi-Q5_K_S-GGUF

12B 8K ctx
Q5_K_S
8.25GB file 10.45GB

MN-12B-Mimicore-Orochi-Q6_K-GGUF

12B 8K ctx
Q6_K
9.75GB file 11.95GB

MN-12B-Mimicore-Orochi-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

oh-dcft-v3.1-claude-3-5-haiku-20241022-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

oh-dcft-v3.1-claude-3-5-haiku-20241022-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

oh-dcft-v3.1-claude-3-5-haiku-20241022-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

oh-dcft-v3.1-claude-3-5-haiku-20241022-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

OpenThinker-7B-IQ3_M-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB

OpenThinker-7B-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

OpenThinker-7B-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OpenThinker-7B-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

OpenThinker-7B-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

OpenThinker-7B-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

OpenThinker-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

OpenThinker-7B-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

OpenThinker-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Pantheon-RP-Pure-1.6.2-22b-Small-f16-GGUF

22B 8K ctx
FP16
44GB file 46.36GB

Pantheon-RP-Pure-1.6.2-22b-Small-IQ3_M-GGUF

22B 8K ctx
Q3_M
9.63GB file 11.99GB

Pantheon-RP-Pure-1.6.2-22b-Small-IQ3_XS-GGUF

22B 8K ctx
Q3_XS
9.63GB file 11.99GB

Pantheon-RP-Pure-1.6.2-22b-Small-IQ4_XS-GGUF

22B 8K ctx
Q4_XS
12.38GB file 14.74GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q2_K-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q3_K_L-GGUF

22B 8K ctx
Q3_K_L
9.63GB file 11.99GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q3_K_M-GGUF

22B 8K ctx
Q3_K_M
9.63GB file 11.99GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q3_K_S-GGUF

22B 8K ctx
Q3_K_S
9.63GB file 11.99GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q4_K_M-GGUF

22B 8K ctx
Q4_K_M
12.38GB file 14.74GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q4_K_S-GGUF

22B 8K ctx
Q4_K_S
12.38GB file 14.74GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q5_K_M-GGUF

22B 8K ctx
Q5_K_M
15.13GB file 17.49GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q5_K_S-GGUF

22B 8K ctx
Q5_K_S
15.13GB file 17.49GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q6_K-GGUF

22B 8K ctx
Q6_K
17.88GB file 20.24GB

Pantheon-RP-Pure-1.6.2-22b-Small-Q8_0-GGUF

22B 8K ctx
Q8_0
23.38GB file 25.74GB

Pathfinder-RP-12B-RU-IQ4_XS-GGUF

12B 8K ctx
Q4_XS
6.75GB file 8.95GB

Pathfinder-RP-12B-RU-Q2_K-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

Pathfinder-RP-12B-RU-Q3_K_L-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB

Pathfinder-RP-12B-RU-Q3_K_M-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB

Pathfinder-RP-12B-RU-Q3_K_S-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB

Pathfinder-RP-12B-RU-Q4_K_M-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

Pathfinder-RP-12B-RU-Q4_K_S-GGUF

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB

Pathfinder-RP-12B-RU-Q5_K_M-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB

Pathfinder-RP-12B-RU-Q5_K_S-GGUF

12B 8K ctx
Q5_K_S
8.25GB file 10.45GB

Pathfinder-RP-12B-RU-Q6_K-GGUF

12B 8K ctx
Q6_K
9.75GB file 11.95GB

Pathfinder-RP-12B-RU-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

phi-4-Q3_K_L-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

phi-4-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

phi-4-Q3_K_S-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

phi-4-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

phi-4-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

phi-4-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

phi-4-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-4-ReasoningRP-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Phi-4-ReasoningRP-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Phi-4-ReasoningRP-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Phi-4-ReasoningRP-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Phi-4-ReasoningRP-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

plato-9b-f16-GGUF

9B 8K ctx
FP16
18GB file 20.15GB

plato-9b-IQ4_XS-GGUF

9B 8K ctx
Q4_XS
5.06GB file 7.21GB

plato-9b-Q2_K-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

plato-9b-Q3_K_L-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB

plato-9b-Q3_K_M-GGUF

9B 8K ctx
Q3_K_M
3.94GB file 6.09GB

plato-9b-Q3_K_S-GGUF

9B 8K ctx
Q3_K_S
3.94GB file 6.09GB

plato-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

plato-9b-Q4_K_S-GGUF

9B 8K ctx
Q4_K_S
5.06GB file 7.21GB

plato-9b-Q5_K_M-GGUF

9B 8K ctx
Q5_K_M
6.19GB file 8.34GB

plato-9b-Q5_K_S-GGUF

9B 8K ctx
Q5_K_S
6.19GB file 8.34GB

plato-9b-Q6_K-GGUF

9B 8K ctx
Q6_K
7.31GB file 9.46GB

plato-9b-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

q-2.5-deepseek-r1-veltha-v0.3-Q2_K-GGUF

671B 8K ctx
Q2_K
209.69GB file 222.68GB

q-2.5-deepseek-r1-veltha-v0.3-Q3_K_L-GGUF

671B 8K ctx
Q3_K_L
293.56GB file 306.55GB

q-2.5-deepseek-r1-veltha-v0.3-Q3_K_M-GGUF

671B 8K ctx
Q3_K_M
293.56GB file 306.55GB

q-2.5-deepseek-r1-veltha-v0.3-Q4_K_M-GGUF

671B 8K ctx
Q4_K_M
377.44GB file 390.43GB

q-2.5-deepseek-r1-veltha-v0.3-Q4_K_S-GGUF

671B 8K ctx
Q4_K_S
377.44GB file 390.43GB

q-2.5-deepseek-r1-veltha-v0.3-Q5_K_M-GGUF

671B 8K ctx
Q5_K_M
461.31GB file 474.3GB

q-2.5-deepseek-r1-veltha-v0.3-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2.5-1.5B-Open-R1-Distill-IQ4_XS-GGUF

15B 8K ctx
Q4_XS
8.44GB file 10.69GB

Qwen2.5-1.5B-Open-R1-Distill-Q2_K-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB

Qwen2.5-1.5B-Open-R1-Distill-Q3_K_L-GGUF

15B 8K ctx
Q3_K_L
6.56GB file 8.81GB

Qwen2.5-1.5B-Open-R1-Distill-Q3_K_M-GGUF

15B 8K ctx
Q3_K_M
6.56GB file 8.81GB

Qwen2.5-1.5B-Open-R1-Distill-Q3_K_S-GGUF

15B 8K ctx
Q3_K_S
6.56GB file 8.81GB

Qwen2.5-1.5B-Open-R1-Distill-Q4_K_M-GGUF

15B 8K ctx
Q4_K_M
8.44GB file 10.69GB

Qwen2.5-1.5B-Open-R1-Distill-Q4_K_S-GGUF

15B 8K ctx
Q4_K_S
8.44GB file 10.69GB

Qwen2.5-1.5B-Open-R1-Distill-Q5_K_M-GGUF

15B 8K ctx
Q5_K_M
10.31GB file 12.56GB

Qwen2.5-1.5B-Open-R1-Distill-Q5_K_S-GGUF

15B 8K ctx
Q5_K_S
10.31GB file 12.56GB

Qwen2.5-1.5B-Open-R1-Distill-Q6_K-GGUF

15B 8K ctx
Q6_K
12.19GB file 14.44GB

Qwen2.5-1.5B-Open-R1-Distill-Q8_0-GGUF

15B 8K ctx
Q8_0
15.94GB file 18.19GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-IQ3_M-GGUF

14B 8K ctx
Q3_M
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-i1-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-DeepSeek-R1-1M-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

Qwen2.5-14B-DeepSeek-R1-1M-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

Qwen2.5-14B-DeepSeek-R1-1M-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Qwen2.5-14B-DeepSeek-R1-1M-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-IQ3_S-GGUF

32B 8K ctx
Q3_S
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-IQ3_XS-GGUF

32B 8K ctx
Q3_XS
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

Qwen2.5-32B-DeepSeek-R1-Instruct-i1-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

Qwen2.5-32b-Erudite-Writer-i1-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

Qwen2.5-32b-Erudite-Writer-i1-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

Qwen2.5-32b-Erudite-Writer-i1-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

Qwen2.5-7B-Instruct-1M-f16-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-1M-IQ3_M-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-1M-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-1M-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen2.5-7B-Instruct-1M-Q3_K_L-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-1M-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-1M-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-1M-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-1M-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-1M-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Qwen2.5-7B-Instruct-1M-Q5_K_S-GGUF

7B 8K ctx
Q5_K_S
4.81GB file 6.92GB

Qwen2.5-7B-Instruct-1M-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Qwen2.5-7B-Instruct-1M-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-7B-Instruct-Uncensored-f16-GGUF

7B 8K ctx
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Uncensored-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-Uncensored-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen2.5-7B-Instruct-Uncensored-Q3_K_L-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-Uncensored-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-Uncensored-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-Uncensored-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Qwen2.5-7B-Instruct-Uncensored-Q5_K_S-GGUF

7B 8K ctx
Q5_K_S
4.81GB file 6.92GB

Qwen2.5-7B-Instruct-Uncensored-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Qwen2.5-7B-Instruct-Uncensored-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-7B-olm-v1.4-i1-IQ3_M-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-IQ3_S-GGUF

7B 8K ctx
Q3_S
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-IQ3_XS-GGUF

7B 8K ctx
Q3_XS
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Qwen2.5-7B-olm-v1.4-i1-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen2.5-7B-olm-v1.4-i1-Q3_K_L-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

Qwen2.5-7B-olm-v1.4-i1-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Qwen2.5-7B-olm-v1.4-i1-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

Qwen2.5-7B-olm-v1.4-i1-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Qwen2.5-7B-olm-v1.4-i1-Q5_K_S-GGUF

7B 8K ctx
Q5_K_S
4.81GB file 6.92GB

Qwen2.5-7B-olm-v1.4-i1-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Qwen2.5-Coder-14B-Instruct-Uncensored-IQ4_XS-GGUF

14B 8K ctx
Q4_XS
7.88GB file 10.11GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q2_K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q3_K_L-GGUF

14B 8K ctx
Q3_K_L
6.13GB file 8.36GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q3_K_M-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q3_K_S-GGUF

14B 8K ctx
Q3_K_S
6.13GB file 8.36GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q4_K_M-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q4_K_S-GGUF

14B 8K ctx
Q4_K_S
7.88GB file 10.11GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q5_K_M-GGUF

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q5_K_S-GGUF

14B 8K ctx
Q5_K_S
9.63GB file 11.86GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q6_K-GGUF

14B 8K ctx
Q6_K
11.38GB file 13.61GB

Qwen2.5-Coder-14B-Instruct-Uncensored-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

QwQ-32B-Preview-abliterated-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

QwQ-32B-Preview-abliterated-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

QwQ-32B-Preview-abliterated-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

QwQ-32B-Preview-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q3_K_L-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q3_K_M-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q3_K_S-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q4_0-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB

QwQ-32B-Preview-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q4_K_S-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q5_0-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB

QwQ-32B-Preview-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q6_K-GGUF

32B 8K ctx
Q6_0
26GB file 28.52GB
FP16
64GB file 66.52GB

QwQ-32B-Preview-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-IQ3_S-GGUF

32B 8K ctx
Q3_S
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-IQ3_XS-GGUF

32B 8K ctx
Q3_XS
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q3_K_L-GGUF

32B 8K ctx
Q3_K_L
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

R1-Qwen2.5-32B-Instruct-1k-i1-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

R1-Qwen2.5-32B-Instruct-1k-IQ4_XS-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB

R1-Qwen2.5-32B-Instruct-1k-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

R1-Qwen2.5-32B-Instruct-1k-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-Q3_K_S-GGUF

32B 8K ctx
Q3_K_S
14GB file 16.52GB

R1-Qwen2.5-32B-Instruct-1k-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

R1-Qwen2.5-32B-Instruct-1k-Q5_K_S-GGUF

32B 8K ctx
Q5_K_S
22GB file 24.52GB

R1-Qwen2.5-32B-Instruct-1k-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

ReaderLM-v2-Q2_K-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q3_K_L-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q3_K_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q3_K_S-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

ReaderLM-v2-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q5_0-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB

ReaderLM-v2-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q5_K_S-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB

ReaderLM-v2-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Reasoning-Llama-3.1-CoT-RE1-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Reasoning-Llama-3.1-CoT-RE1-i1-IQ3_M-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB

Reasoning-Llama-3.1-CoT-RE1-i1-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Reasoning-Llama-3.1-CoT-RE1-i1-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

Reasoning-Llama-3.1-CoT-RE1-i1-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

Reasoning-Llama-3.1-CoT-RE1-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

Reasoning-Llama-3.1-CoT-RE1-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Reasoning-Llama-3.1-CoT-RE1-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

Reasoning-Llama-3.1-CoT-RE1-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

Reasoning-Llama-3.1-CoT-RE1-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

Reasoning-Llama-3.1-CoT-RE1-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Reasoning-Llama-3.1-CoT-RE1-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

Reasoning-Llama-3.1-CoT-RE1-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Reasoning-Llama-3.1-CoT-RE1-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

Reasoning-Llama-3.1-CoT-RE1-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

RuadaptQwen2.5-32B-Pro-Beta-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

RuadaptQwen2.5-32B-Pro-Beta-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

RuadaptQwen2.5-32B-Pro-Beta-Q4_K_M-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB

RuadaptQwen2.5-32B-Pro-Beta-Q5_K_M-GGUF

32B 8K ctx
Q5_K_M
22GB file 24.52GB

RuadaptQwen2.5-32B-Pro-Beta-Q6_K-GGUF

32B 8K ctx
Q6_K
26GB file 28.52GB

RuadaptQwen2.5-32B-Pro-Beta-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

saiga_nemo_12b_gguf-Q2_K-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

saiga_nemo_12b_gguf-Q3_K_M-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB

saiga_nemo_12b_gguf-Q3_K_S-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB

saiga_nemo_12b_gguf-Q4_K_M-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

saiga_nemo_12b_gguf-Q4_K_S-GGUF

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB

saiga_nemo_12b_gguf-Q5_K_M-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB

saiga_nemo_12b_gguf-Q5_K_S-GGUF

12B 8K ctx
Q5_K_S
8.25GB file 10.45GB

saiga_nemo_12b_gguf-Q6_K-GGUF

12B 8K ctx
Q6_K
9.75GB file 11.95GB

saiga_nemo_12b_gguf-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

Selene-1-Mini-Llama-3.1-8B-f16-GGUF

8B 8K ctx
FP16
16GB file 18.13GB

Selene-1-Mini-Llama-3.1-8B-IQ3_M-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB

Selene-1-Mini-Llama-3.1-8B-IQ3_XS-GGUF

8B 8K ctx
Q3_XS
3.5GB file 5.63GB

Selene-1-Mini-Llama-3.1-8B-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

Selene-1-Mini-Llama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Selene-1-Mini-Llama-3.1-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

Selene-1-Mini-Llama-3.1-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

Selene-1-Mini-Llama-3.1-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Selene-1-Mini-Llama-3.1-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

Selene-1-Mini-Llama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Selene-1-Mini-Llama-3.1-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Selene-1-Mini-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

SILMA-Kashif-2B-Instruct-v1.0-i1-IQ3_M-GGUF

2B 8K ctx
Q3_M
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-IQ3_S-GGUF

2B 8K ctx
Q3_S
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-IQ3_XS-GGUF

2B 8K ctx
Q3_XS
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-IQ4_XS-GGUF

2B 8K ctx
Q4_XS
1.13GB file 3.16GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_L-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_M-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_S-GGUF

2B 8K ctx
Q3_K_S
0.88GB file 2.91GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q4_K_M-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q4_K_S-GGUF

2B 8K ctx
Q4_K_S
1.13GB file 3.16GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_M-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_S-GGUF

2B 8K ctx
Q5_K_S
1.38GB file 3.41GB

SILMA-Kashif-2B-Instruct-v1.0-i1-Q6_K-GGUF

2B 8K ctx
Q6_K
1.63GB file 3.66GB

SJT-Moe2x7.5B-IQ4_XS-GGUF

7.5B 8K ctx
Q4_XS
4.22GB file 6.34GB

SJT-Moe2x7.5B-Q2_K-GGUF

7.5B 8K ctx
Q2_K
2.34GB file 4.46GB

SJT-Moe2x7.5B-Q3_K_L-GGUF

7.5B 8K ctx
Q3_K_L
3.28GB file 5.4GB

SJT-Moe2x7.5B-Q3_K_M-GGUF

7.5B 8K ctx
Q3_K_M
3.28GB file 5.4GB

SJT-Moe2x7.5B-Q3_K_S-GGUF

7.5B 8K ctx
Q3_K_S
3.28GB file 5.4GB

SJT-Moe2x7.5B-Q4_K_M-GGUF

7.5B 8K ctx
Q4_K_M
4.22GB file 6.34GB

SJT-Moe2x7.5B-Q4_K_S-GGUF

7.5B 8K ctx
Q4_K_S
4.22GB file 6.34GB

SJT-Moe2x7.5B-Q5_K_M-GGUF

7.5B 8K ctx
Q5_K_M
5.16GB file 7.28GB

SJT-Moe2x7.5B-Q5_K_S-GGUF

7.5B 8K ctx
Q5_K_S
5.16GB file 7.28GB

SJT-Moe2x7.5B-Q6_K-GGUF

7.5B 8K ctx
Q6_K
6.09GB file 8.21GB

SJT-Moe2x7.5B-Q8_0-GGUF

7.5B 8K ctx
Q8_0
7.97GB file 10.09GB

SKYCAVE-R1-32B-v0.1-i1-IQ3_M-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB

SKYCAVE-R1-32B-v0.1-i1-Q2_K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

SKYCAVE-R1-32B-v0.1-i1-Q3_K_M-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB

SKYCAVE-R1-32B-v0.1-i1-Q4_K_S-GGUF

32B 8K ctx
Q4_K_S
18GB file 20.52GB

Slush-Sunfall-Rocinante-GGLD-12B-IQ4_XS-GGUF

12B 8K ctx
Q4_XS
6.75GB file 8.95GB

Slush-Sunfall-Rocinante-GGLD-12B-Q2_K-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_L-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB

Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_M-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB

Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_S-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB

Slush-Sunfall-Rocinante-GGLD-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB

Slush-Sunfall-Rocinante-GGLD-12B-Q4_K_S-GGUF

12B 8K ctx
Q4_K_S
6.75GB file 8.95GB

Slush-Sunfall-Rocinante-GGLD-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB

Slush-Sunfall-Rocinante-GGLD-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_K_S
8.25GB file 10.45GB

Slush-Sunfall-Rocinante-GGLD-12B-Q6_K-GGUF

12B 8K ctx
Q6_K
9.75GB file 11.95GB

Slush-Sunfall-Rocinante-GGLD-12B-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

SmallThinker-3B-Preview-IQ3_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-IQ3_XXS-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-IQ4_XS-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q3_K_L-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q3_K_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q3_K_S-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

SmallThinker-3B-Preview-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q5_0-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB

SmallThinker-3B-Preview-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q5_K_S-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

SmallThinker-3B-Preview-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

TunnedLlama-3.1-8B_v2-IQ4_XS-GGUF

8B 8K ctx
Q4_XS
4.5GB file 6.63GB

TunnedLlama-3.1-8B_v2-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

TunnedLlama-3.1-8B_v2-Q3_K_L-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB

TunnedLlama-3.1-8B_v2-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

TunnedLlama-3.1-8B_v2-Q3_K_S-GGUF

8B 8K ctx
Q3_K_S
3.5GB file 5.63GB

TunnedLlama-3.1-8B_v2-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

TunnedLlama-3.1-8B_v2-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

TunnedLlama-3.1-8B_v2-Q5_K_S-GGUF

8B 8K ctx
Q5_K_S
5.5GB file 7.63GB

TunnedLlama-3.1-8B_v2-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

TunnedLlama-3.1-8B_v2-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Virtuoso-Lite-f16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Virtuoso-Lite-IQ4_XS-GGUF

Unknown 8K ctx
Q4_XS
0GB file 2GB

Virtuoso-Lite-Q3_K_L-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB

Virtuoso-Lite-Q3_K_S-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB

Virtuoso-Lite-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Virtuoso-Lite-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

Virtuoso-Lite-Q5_K_M-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB

Virtuoso-Lite-Q5_K_S-GGUF

Unknown 8K ctx
Q5_K_S
0GB file 2GB

Virtuoso-Lite-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Wayfarer-12B-Q2_K-GGUF

12B 8K ctx
Q2_0
3.75GB file 5.95GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q3_K_L-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q3_K_M-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q3_K_S-GGUF

12B 8K ctx
Q3_0
5.25GB file 7.45GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q4_0-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB

Wayfarer-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q4_K_S-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q5_0-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB

Wayfarer-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Wayfarer-12B-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

YuE-s1-7B-anneal-en-cot-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

YuE-s1-7B-anneal-en-cot-Q3_K_L-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB

YuE-s1-7B-anneal-en-cot-Q3_K_M-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

YuE-s1-7B-anneal-en-cot-Q3_K_S-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB

YuE-s1-7B-anneal-en-cot-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

YuE-s1-7B-anneal-en-cot-Q4_K_S-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB

YuE-s1-7B-anneal-en-cot-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

YuE-s1-7B-anneal-en-cot-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
R

Rolex0775

1 models

Qwen3-Coder-30B-A3B-Instruct-DQ-abliterated-GGUF

30B 8K ctx
FP16
60GB file 62.49GB