All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Azimjon

3 models

Llama-3.1-8B-Instuct-Uz-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instuct-Uz-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instuct-Uz-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Azulian

1 models

zephyr-merged-7b-travellers-02-awq

7B 8K ctx
FP16
14GB file 16.11GB
A

Azzedde

1 models

llama3.1-8b-reasoning-grpo-gguf

8B 8K ctx
FP16
16GB file 18.13GB
B

B Encoder R T

1 models

medical_inference

8B 8K ctx
Q8_0
8.5GB file 10.63GB
B

B I C E N G

1 models

CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
B

B O G D A N I M A L

3 models

Qwen3-4B-RPG-Roleplay-V2

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-Jan-V1-4B-Grand-Horror-Day1-to-Day7-Evolved-Imatrix-GGUF

4B 8K ctx
Q2_M
1.25GB file 3.32GB
Q3_M
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_1
2.75GB file 4.82GB
B

B S C L T

2 models

ALIA-40b-instruct-2601-GGUF

40B 8K ctx
Q8_0
42.5GB file 45.16GB

salamandra-7b-instruct-tools-16k

7B 8K ctx
Q8_0
7.44GB file 9.55GB
B

B Sy Azyoa V Y S E2 V J Qkzx Ew6 U T E K S F Z Xrq5

1 models

Kraken-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
B

B U T F I T

3 models

csmpt-7B-RAGsum

7B 8K ctx
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

csmpt7b

7B 8K ctx
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

CSTinyLLama-1.2B-RAGsum

1.2B 8K ctx
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB
B

B4Lt

1 models

gemma4-loghub-e2b-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB