All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Bwza

2 models

Gemma-2-9B-It-SPPO-Iter3-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Llama3-Med42-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
B

Bxj0619

1 models

QwQ-32B-Q3_K_M-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB
B

Byeolki

1 models

Llama-KoEmpathy

8B 8K ctx
Q8_0
8.5GB file 10.63GB
B

Byroneverson

9 models

gemma-2-27b-it-abliterated-gguf

27B 8K ctx
Q4_0
15.19GB file 17.63GB
Q6_0
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

glm-4-9b-chat-abliterated-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

internlm2_5-20b-chat-abliterated-gguf

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2_5-7b-chat-abliterated-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

LongWriter-glm4-9b-abliterated-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Mistral-Small-Instruct-2409-abliterated-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Yi-1.5-34B-Chat-abliterated-gguf

34B 8K ctx
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

Yi-1.5-9B-Chat-16K-abliterated-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Yi-1.5-9B-Chat-abliterated-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
B

Byt Arch

1 models

BytArch-Lumina-0.6B

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB
B

Bytecodehr

2 models

qwen3-8b-rails

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

qwen3-coder-30b-rails

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
B

Byteshape

5 models

Devstral-Small-2-24B-Instruct-2512-GGUF

24B 8K ctx
Q2_S
7.5GB file 9.89GB
Q3_S
10.5GB file 12.89GB
Q4_XS
13.5GB file 15.89GB
BF16
48GB file 50.39GB

Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q3_S
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB

Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q3_S
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_K_S
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q2_S
1.25GB file 3.32GB
Q3_S
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_XS
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_S
2.75GB file 4.82GB

Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q3_K_M
13.13GB file 15.62GB
Q3_S
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_XS
16.88GB file 19.37GB
C

C A L I S T A I N D U S T R Y

3 models

gemma_3_1B_reasoning_en_ft_v1

1B 8K ctx
FP16
2GB file 4.02GB

Gemma3_1B_Reasoning_En_FT_R64_LA64

1B 8K ctx
FP16
2GB file 4.02GB

Llama_3.2_3B_Reasoning_En_FT_R32_LA32

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
C

C Broot A

1 models

Qwen-MediCare-BD

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
C

C C S S N E

4 models

cyberneurova-CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q2_K
0GB file 2GB

jacehoi-Qwen3.5-35B-A3B-Uncensored-Claude-Opus-4.6-Affine

35B 8K ctx
Q4_XS
19.69GB file 22.26GB

LuffyTheFox-Qwen3.5-9B-Claude-4.6-Opus-Uncensored-Distilled-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

tarruda-Qwen3.5-397B-A17B-heretic-smol-IQ2_XS-GGUF

397B 8K ctx
Q2_XS
124.06GB file 132.56GB