All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Yash Lulla

2 models

Legal_AI

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Legal_AI_Assistant

Unknown 8K ctx
FP16
0GB file 2GB
Y

Yash Rawal225

8 models

Instructiontune-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

Intel-3-7b-chat-finetune-german-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Intel-3-7b-chat-finetune-german2000-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

Llama-2-7b-chat-finetune-german-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

llama-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

New-3-7b-chat-finetune-german500-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB

NewfineFormatedData-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

TinyLlama-1.1B-Chat-v0.3-GGUF

1.1B 8K ctx
Q4_K
0.62GB file 2.64GB
Y

Yash1000

1 models

llama-3-8b-chat-doctor

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Y

Yashagra

4 models

Llama-2-7b-chat-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Instruct-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Y

Yasserrmd

3 models

Coder-GRPO-3B

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Fanar-1-9B-Instruct-gguf

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

glm5.1-distill-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
Y

Yasu Oh

9 models

ArrowNeo-AME-4x3B-v0.1-MoE-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB

Llama-3-SS-Infused-R1776-70B-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Llama-3-Swallow-Infused-R1776-70B-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Llama-3.3-Swallow-70B-Instruct-v0.4-GGUF

70B 8K ctx
Q4_XS
39.38GB file 42.53GB

Magistral-Small-2506-GGUF

2506B 8K ctx
Q4_K_M
1409.63GB file 1452.69GB
Q4_XS
1409.63GB file 1452.69GB
Q5_K_M
1722.88GB file 1765.94GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB

Qwen3-32B-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB

qwq-bakeneko-32b-GGUF

32B 8K ctx
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB

sarashina2.2-3b-instruct-v0.1-GGUF

3B 8K ctx
Q4_XS
1.69GB file 3.74GB
Y

Yasunai

1 models

llm-jp-3-7b-gguf

7B 8K ctx
FP16
14GB file 16.11GB
Y

Yasutoshi Lab

3 models

gpt-oss-20b-gguf

20B 8K ctx
FP16
40GB file 42.33GB

Llama-3.2-1B-Instruct-QA-v4-gguf

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-QA-v4-q4km-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
Y

Yaystevek

1 models

llama-3-8b-Instruct-OpenHermes-2.5-QLoRA-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Y

Yeahdongcn

1 models

WebDancer-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB