All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cof139

1 models

gpt-oss-6.0b-specialized-all-pruned-moe-only-7-experts-Q4_K_M-GGUF

6.0B 8K ctx
Q4_0
3.38GB file 5.48GB
FP16
12GB file 14.1GB
C

Coffeetitanofficial

1 models

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB
C

Cohere

1 models

Command R 35B

35B 131K ctx
Q4_K_M
19.85GB file 31GB
Q8_0
36.61GB file 47.8GB
C

Colabbear

3 models

A.X-4.0-Light-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

EXAONE-4.0.1-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

llama-3-sqlcoder-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
C

Colawolfie

1 models

Chen-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
C

Combatti

2 models

llama3.1-8b-reflection

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

llama3.2-3B-FunctionCalling

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q4_0
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
C

Combos

1 models

starcoder2-3b-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
C

Commencis

1 models

Commencis-LLM-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_0
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_0
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_M
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
C

Complexinteractive

1 models

openerotica-Occult-Roleplay-Mixtral-4x7b-GGUF

7B 8K ctx
Q5_K
4.81GB file 6.92GB
FP16
14GB file 16.11GB
C

Concedo

1 models

koboldcpp

Unknown 8K ctx
FP16
0GB file 2GB