All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Astradzhao

3 models

Llama-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Qwen2.5-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
A

Astralyra

3 models

glm-4-9b-chat-hf-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MiniCPM3-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Phi-4-mini-instruct-abliterated-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB
A

Astro M Lab

1 models

AstroSage-8B-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
A

Astroa7M

1 models

llama-3-8b-full-chat-aou

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Astrom New

1 models

Dolphin-Mistral-24B-Venice-Edition-Q5_K_M-GGUF

24B 8K ctx
Q5_0
16.5GB file 18.89GB
FP16
48GB file 50.39GB
A

Asumansaree

1 models

trendyol_llm_7b_chat_v1_0_gguf

7B 8K ctx
FP16
14GB file 16.11GB
A

Asureu

1 models

Gemma-2-2b-Chinese-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
A

Aswanth1611

1 models

edu-hub

Unknown 8K ctx
Q2_K
0GB file 2GB
A

Aswdaegrhjklasdgfhjklasdgfhjkl

1 models

Llama-3.1-Tulu-3-8B-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB
A

Aswinaus

1 models

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB