All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cduk

1 models

gadsby

8B 8K ctx
Q4_K
4.5GB file 6.63GB
C

Ce Lery

1 models

japanese-mistral-300m-base

Unknown 8K ctx
FP16
0GB file 2GB
C

Celek

1 models

granite-3b-code-instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
C

Celeste Imperia

9 models

Gemma-2-2B-IT-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Llama-3-70B-Instruct-Platinum-GGUF

70B 8K ctx
Q3_K_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-3.1-8B-Instruct-Platinum-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-Platinum-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Platinum-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Mistral-Nemo-Instruct-Platinum-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Phi-3.5-mini-instruct-Platinum-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Qwen2.5-7B-Instruct-Platinum-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-7B-Instruct-Platinum-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
C

Cenfis

1 models

llama3-8b-tr-finetuned

8B 8K ctx
FP16
16GB file 18.13GB
C

Centara

6 models

gemma-4-E4B-it-OBLITERATED-Q2_K-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
FP16
8GB file 10.07GB

gemma-4-E4B-it-OBLITERATED-Q3_K_L-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB

gemma-4-E4B-it-OBLITERATED-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

gemma-4-E4B-it-OBLITERATED-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

gemma-4-E4B-it-OBLITERATED-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

gemma-4-E4B-it-OBLITERATED-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
C

Centerofcode

1 models

qwen2.5_tsql_gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
C

Cerebellum King

1 models

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q2_K-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
FP16
1GB file 3.01GB
C

Cernis Intelligence

1 models

precis-gguf

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_K_M
0GB file 2GB
C

Cetusian

1 models

pocket-atlas-0.8b

0.8B 8K ctx
Q4_0
0.45GB file 2.46GB
Q8_0
0.85GB file 2.86GB