All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Islamsaad

1 models

Phi-3-mini-128k-instruct-Q3_K_L-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
I

Islamytchaev

1 models

autotrain-h21ao-zct4v

7B 8K ctx
Q8_0
7.44GB file 9.55GB
I

Ismailea04

1 models

medgemma-night-sentinel

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
I

Isox

1 models

Qwen3-14B-HomeAssistant-ru-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
I

Israellaguan

1 models

tinyllama-1.1b-chat-dpo-full-Q8_0-GGUF

1.1B 8K ctx
Q8_0
1.17GB file 3.19GB
I

Itac85V3

1 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
I

Itaprac

1 models

MG_DS_TEST-F16-GGUF

1B 8K ctx
FP16
2GB file 4.02GB
I

Itayl

5 models

dictalm2.0-instruct-Q2_K-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB

dictalm2.0-instruct-Q5_K_M-GGUF

2.0B 8K ctx
Q5_K_M
1.38GB file 3.41GB

dictalm2.0-instruct-Q8_0-GGUF

2.0B 8K ctx
Q8_0
2.13GB file 4.16GB

Hebatron-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Hebrew-gemma-GGUF

Unknown 8K ctx
Q5_K
0GB file 2GB
I

Itcen Entec

1 models

gemma-3-4b-tax-law-lora-gguf

4B 8K ctx
FP16
8GB file 10.07GB
I

Itlwas

205 models

Ahma-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Ahma-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Ahma-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Ahma-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

AMD-OLMo-1B-SFT-DPO-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

AMD-OLMo-1B-SFT-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Arch-Function-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Arch-Function-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Arch-Function-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Azure_Dusk-v0.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

BioMistral-7B-DARE-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

BioMistral-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

BioMistral-7B-SLERP-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

BioMistral-7B-TIES-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

ChatWaifu_12B_v2.0-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

ChatWaifu_v1.0-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

ChatWaifu_v1.2.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

ChatWaifu_v1.3.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

ChatWaifu_v1.4-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

ChatWaifu_v2.0_22B-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB

ChatYuan-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Codepy-Deepthink-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Crimson_Dawn-v0.2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Custom-KoLLM-13B-v1-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v2-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v3-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v4-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v5-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v6-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v7-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Custom-KoLLM-13B-v8-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Deepthink-Reasoning-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Devple-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

EXAONE-3.5-2.4B-Instruct-Q4_K_M-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
FP16
4.8GB file 6.84GB

EXAONE-3.5-7.8B-Instruct-Q4_K_M-GGUF

7.8B 8K ctx
Q4_0
4.39GB file 6.52GB
FP16
15.6GB file 17.73GB

EXAONE-Deep-2.4B-Q4_K_M-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
FP16
4.8GB file 6.84GB

EXAONE-Deep-7.8B-Q4_K_M-GGUF

7.8B 8K ctx
Q4_0
4.39GB file 6.52GB
FP16
15.6GB file 17.73GB

fialka-7B-v2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

fialka-7B-v2.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

fialka-7B-v3-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

gemma-2-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-27b-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

ghost-8b-beta-1608-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Gistral-16B-Q4_K_M-GGUF

16B 8K ctx
Q4_0
9GB file 11.26GB
FP16
32GB file 34.26GB

granite-3.0-1b-a400m-base-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.1-2b-instruct-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-3.1-3b-a800m-base-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3.1-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3b-code-base-128k-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3b-code-base-2k-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3b-code-instruct-128k-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

granite-3b-code-instruct-2k-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

GWQ-9B-Preview-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GWQ-9B-Preview2-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GWQ2b-Q4_K_M-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

Hiber-Multi-10B-Instruct-Q4_K_M-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB

HuatuoGPT-o1-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

HuatuoGPT-o1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-1_8b-chat-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-1_8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-20b-chat-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2_5-20b-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2_5-7b-chat-1m-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

internlm2_5-7b-chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

internlm2-math-20b-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2-math-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

llama-160m-base-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

llama-160m-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-Tulu-3-8B-DPO-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-Tulu-3-8B-SFT-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-Taiwan-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

llama-68m-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Llama-Deepsync-1B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-Guard-3-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-Guard-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

LlamaGuard-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

magnum-v2-12b-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

magnum-v4-22b-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB

meno-tiny-0.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Meta-Llama-Guard-2-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

MiniCPM3-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB

Mistral-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

OLMo-2-1124-13B-Instruct-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

OmniLing-V1-12b-experimental-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

OmniLing-V1-8b-experimental-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

openbuddy-yi1.5-34b-v21.3-32k-Q4_K_M-GGUF

34B 8K ctx
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

openchat_3.5-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

openchat-3.5-0106-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

openchat-3.5-1210-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

OpenCoder-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Orca-2-13b-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Orca-2-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

phi-1_5-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

phi-1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen1.5-0.5B-Chat-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen1.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen1.5-1.8B-Chat-Q4_K_M-GGUF

1.8B 8K ctx
Q4_0
1.01GB file 3.04GB
FP16
3.6GB file 5.63GB

Qwen1.5-1.8B-Q4_K_M-GGUF

1.8B 8K ctx
Q4_0
1.01GB file 3.04GB
FP16
3.6GB file 5.63GB

Qwen1.5-14B-Chat-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen1.5-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen1.5-32B-Chat-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen1.5-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen1.5-4B-Chat-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen1.5-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen1.5-7B-Chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen1.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-Math-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-Math-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-Math-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-Math-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-Coder-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Math-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-0.6B-Base-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

Qwen3-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

QWQ-500M-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

QwQ-Math-IO-500M-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

QwQ-MathOct-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

shieldgemma-27b-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

shieldgemma-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

shieldgemma-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Skywork-Critic-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Skywork-o1-Open-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

SmallThinker-3B-Preview-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

SmolLM2-1.7B-Instruct-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

SmolLM2-360M-Instruct-FT-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

SmolLM2-360M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Triangulum-10B-it-Q4_K_M-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB

Triangulum-10B-Q4_K_M-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB

Triangulum-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Triangulum-5B-it-Q4_K_M-GGUF

5B 8K ctx
Q4_0
2.81GB file 4.89GB
FP16
10GB file 12.08GB

Triangulum-5B-Q4_K_M-GGUF

5B 8K ctx
Q4_0
2.81GB file 4.89GB
FP16
10GB file 12.08GB

Trillion-7B-preview-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

UwU-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Violet_Twilight-v0.2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Yi-Coder-9B-Chat-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Yi-Coder-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

YuLan-Mini-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB