All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Blademax45

1 models

Llama-3.2-3b-bad-zenny-v3

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
B

Blank Html Page

5 models

Qwopus3.5-9B-v3.5-IQ4_XS-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Qwopus3.5-9B-v3.5-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Qwopus3.5-9B-v3.5-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Qwopus3.5-9B-v3.5-Q6_K-GGUF

9B 8K ctx
Q6_0
7.31GB file 9.46GB
FP16
18GB file 20.15GB

Qwopus3.5-9B-v3.5-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB
B

Blazerye

1 models

DrugAssist-7B

7B 8K ctx
FP16
14GB file 16.11GB
B

Blinkdotwav

1 models

Dolphin-Mistral-24B-Venice-Edition-Thinking-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_0
13.5GB file 15.89GB
Q5_K_S
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K
16.5GB file 18.89GB
Q5_1
16.5GB file 18.89GB
Q5_0
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB
B

Blizado

1 models

German_Mistral7B_merge_tests

7B 8K ctx
Q8_0
7.44GB file 9.55GB
B

Blobbybob

1 models

Nemotron-3-Super-120B-A12B-GGUF-Claude-4.6-Opus-Reasoning-Distilled

120B 8K ctx
Q4_0
67.5GB file 71.47GB
Q8_0
127.5GB file 131.47GB
FP16
240GB file 243.97GB
B

Bloce3An

1 models

qwen2.5-0.5B-entities-relationship-gguf

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
B

Blockblockblock

12 models

Yi-1.5-34B-Chat-bpw2.25-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw2.5-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw3-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw3.5-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw3.7-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw4-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw4.2-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw4.4-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw4.6-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw4.8-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw5-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

Yi-1.5-34B-Chat-bpw5.5-exl2

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB
B

Blogcncom

5 models

gemma-2-9b-it-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

Llama3-Med42-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Qwen2-7B-Instruct-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
B

Bloodhawk111

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB