All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Chasedreaminf

1 models

TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf

1.1B 8K ctx
Q4_K_M
0.62GB file 2.64GB
C

Chat Error

3 models

Mistral-Kimiko-CSFT

Unknown 8K ctx
Q5_K_M
0GB file 2GB

ThisModelIsAMistakeButIStillHave30DolarInMyAzureAccount

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Tiny_Kimiko

Unknown 8K ctx
FP16
0GB file 2GB
C

Chatdb

1 models

natural-sql-7b-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q3_K_L
2.93GB file 5.04GB
Q3_K_M
2.93GB file 5.04GB
Q3_K_S
2.93GB file 5.04GB
Q4_0
3.77GB file 5.88GB
Q4_1
3.77GB file 5.88GB
Q4_K_M
3.77GB file 5.88GB
Q4_K_S
3.77GB file 5.88GB
Q5_0
4.61GB file 6.72GB
Q5_1
4.61GB file 6.72GB
Q5_K_M
4.61GB file 6.72GB
Q5_K_S
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB
C

Chatpig

2 models

gguf

Unknown 8K ctx
FP16
0GB file 2GB

llama-3.1-8b-encoder-gguf

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_1
5.5GB file 7.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
C

Cheeseman25

1 models

sploitgpt-7b-v5-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
C

Cheesybeam32

2 models

blue-personality

8B 8K ctx
FP16
16GB file 18.13GB

sky-personality

8B 8K ctx
FP16
16GB file 18.13GB
C

Chenboju

1 models

llama3_localtest

8B 8K ctx
FP16
16GB file 18.13GB
C

Chende2024

1 models

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
C

Chenggang

1 models

Qwen2.5-Sex-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
C

Chenhaodev

1 models

OpenBioLLM-Llama3-70B-GGUF

70B 8K ctx
Q3_K_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB