All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cobrokerai

1 models

llama-3-1-8b

8B 8K ctx
Q8_0
8.5GB file 10.63GB
C

Code Is Abstract

2 models

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
C

Code Runner1306

1 models

recommendationmodel_gguf

Unknown 8K ctx
FP16
0GB file 2GB
C

Codegood

4 models

gemma-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Phi_3.5_mini_GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
Q3_0
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB
BF16
7.6GB file 9.66GB

phi-2-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
C

Coder423

1 models

mamba-370m-hf-turkish-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_0
0GB file 2GB
Q5_0
0GB file 2GB
Q4_0
0GB file 2GB
Q3_0
0GB file 2GB
Q2_0
0GB file 2GB
FP16
0GB file 2GB
C

Coderop12

1 models

gemma2b-nirf-lookup-gguf

2B 8K ctx
FP16
4GB file 6.03GB
C

Coders1

1 models

quantstudio-gemma4-e4b-quant-dsl-v0-1-lora-gguf

4B 8K ctx
FP16
8GB file 10.07GB
C

Codex Con O S

1 models

Amethyst-Core

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
C

Coding Toni

4 models

gemma-2-9b-it-Q6_K-GGUF

9B 8K ctx
Q6_0
7.31GB file 9.46GB
FP16
18GB file 20.15GB

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Nanbeige4.1-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
C

Codingwithlewis

1 models

mistralmeme

Unknown 8K ctx
FP16
0GB file 2GB