All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Aldaris

13 models

Chat2DB-SQL-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Gemma-2-9B-Chinese-Chat-IQ4_NL-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-IQ4_NL-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GLM-4-32B-0414-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

GLM-4-9B-0414-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GLM-Z1-32B-0414-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

GLM-Z1-9B-0414-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Qwen2.5-3B-Instruct-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen3-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Aldigobbler

3 models

stt-qwen3-0.6b-merged-GGUF

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB
Q8_0
0.64GB file 2.65GB

stt-qwen3-1.7b-merged-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB

thinker-1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Alecccdd

1 models

transcription-fixer-gemma-3-12b-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
A

Aleche28

1 models

Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Alefalab

1 models

gemma-3-4b-it-Q4_K_M-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
A

Alejandro Du

1 models

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

Aleksanderstalk

1 models

saiga_mistral_7b_128k_lora-F16-GGUF

7B 8K ctx
FP16
14GB file 16.11GB
A

Aleksei Pravdin

2 models

KukulStanta-InfinityRP-7B-slerp

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

prometheus-7b-v2_0-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_1
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
A

Aleksey Calvin

2 models

Lyrical_MT_ru2en_IIb_Qwen3_4B_it_r256-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Lyrical_MT_ru2en_v2f_2epo_r256_Qwen3_4b_abliterated-Q4_K_S-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Aleksey Scorpi

3 models

llama_2_13b_vacancies_GGUF

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

saiga_llama3_vacancies_GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB

saiga_mistral_7b_vacancies_GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB