All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Ysingh Aiml

1 models

tinyllama-alpaca-lora-gguf

1.1B 8K ctx
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q8_0
1.17GB file 3.19GB
Y

Ysn Rfd

69 models

AceInstruct-1.5B-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

AceInstruct-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB

Arch-Function-Chat-3B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

BabyMistral-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q8_0
0GB file 2GB

BADMISTRAL-1.5B-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

beecoder-220M-python-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

bloomz-3b-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

calme-3.3-instruct-3b-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

calme-3.3-llamaloi-3b-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

CodeLlama-7b-Python-hf-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

CodeLlama-7b-Python-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

DAN-Qwen3-1.7B-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

EXAONE-Deep-2.4B-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
Q5_0
1.65GB file 3.69GB
Q8_0
2.55GB file 4.59GB

gemma-3-1b-it-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

gemma-3-4b-persian-v0-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

gpt-oss-10.8b-specialized-all-pruned-moe-only-15-experts-Q4_0-GGUF

10.8B 8K ctx
Q4_0
6.08GB file 8.26GB

gpt-oss-4.2b-specialized-all-pruned-moe-only-4-experts-Q8_0-GGUF

4.2B 8K ctx
Q8_0
4.46GB file 6.53GB

gpt-oss-4.2b-specialized-harmful-pruned-moe-only-4-experts-Q8_0-GGUF

4.2B 8K ctx
Q8_0
4.46GB file 6.53GB

gpt2-xl-conversational-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

gpt4all-falcon-Q2_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

h2o-danube3-4b-chat-Q4_0-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

h2o-danube3.1-4b-chat-Q4_0-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

h2o-danube3.1-4b-chat-Q5_0-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB

h2o-danube3.1-4b-chat-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

HelpingAI2.5-2B-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

HelpingAI2.5-5B-GGUF

5B 8K ctx
Q4_0
2.81GB file 4.89GB
Q5_0
3.44GB file 5.52GB
Q8_0
5.31GB file 7.39GB

Huihui-MoE-12B-A4B-abliterated-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

LFM2-8B-A1B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

LFM2-8B-A1B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Ling-Coder-lite-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

LlamaCorn-1.1B-Chat-GGUF

1.1B 8K ctx
Q4_0
0.62GB file 2.64GB
Q5_0
0.76GB file 2.78GB
Q8_0
1.17GB file 3.19GB

LLuMi_Think_3B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Ministral-3b-instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

mommygpt-3B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

NSFW-3B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

NSFW-3B-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

OLMo-2-1124-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

OlympicCoder-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Open-RS3-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

Open-RS3-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

openchat_3.5-GGUF

3.5B 8K ctx
Q4_0
1.97GB file 4.03GB
Q5_0
2.41GB file 4.47GB

openchat_3.5-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

openchat-3.5-0106-GGUF

0106B 8K ctx
Q4_0
59.63GB file 63.37GB
Q5_0
72.88GB file 76.62GB
Q8_0
112.63GB file 116.37GB

openchat-3.5-0106-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

OpenCoder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

openhands-lm-1.5b-v0.1-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

openhands-lm-7b-v0.1-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

PersianMind-v1.0-GGUF

1.0B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

PersianMind-v1.0-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

PersianMind-v1.0-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

ReaderLM-v2-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

ReaderLM-v2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Refact-1_6B-fim-GGUF

6B 8K ctx
Q4_0
3.38GB file 5.48GB
Q5_0
4.13GB file 6.23GB
Q6_0
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

SmolLM2-1.7B-Instruct-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

starcoder2-3b-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

TinySwallow-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

TinySwallow-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

txgemma-2b-predict-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

xLAM-1b-fc-r-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Z1-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
Y

Ystemsrx

3 models

Qwen2.5-Interpreter

0.5B 8K ctx
FP16
1GB file 3.01GB

Qwen2.5-Sex

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen3-Sex

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB
Y

Yu Ching Lin

1 models

Taiwan-Llama3-70B-Instruct

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Y

Yu Yu1015

2 models

Huihui-Qwen3.6-27B-abliterated-UD-Q4_K_XL-MTP-GGUF

27B 8K ctx
Q4_K_XL
15.19GB file 17.63GB

YuYu1015-Qwen3.5-0.8B-TW-CivicAligned-v1-GGUF

0.8B 8K ctx
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB
Y

Yuiseki

16 models

tinyllama-coder-dolphin-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-math-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-math-ja-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-math-ja-wikipedia-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-python-en-alpaca-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-python-ja-amenokaku-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-python-ja-wikipedia-amenokaku-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-sql-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-coder-wizardlm-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-fake-news-detector-en-1.5T-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-hate-speech-detector-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-ja-wikipedia-aya-1.5T-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-ja-wikipedia-databricks-dolly-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-ja-wikipedia-sakura-1.5T-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-sentiment-analyzer-en-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllama-sentiment-analyzer-ja-v0.1

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Y

Yukihamada

2 models

ElioChat-1.7B-Instruct-v3

1.7B 8K ctx
Q5_K_M
1.17GB file 3.2GB

Photon-1.7B-Instruct-v1

1.7B 8K ctx
Q5_K_M
1.17GB file 3.2GB
Y

Yuko29Hu

5 models

Qwen3-4B-Instruct-2507-Q3_K_M-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
Y

Yuliu1234

1 models

Meta-Llama-3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
Y

Yuna1126

5 models

Tema_Q-R-0.4B-GGUF

0.4B 8K ctx
Q4_K_M
0.23GB file 2.24GB

Tema_Q-X-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_K_M
2.25GB file 4.32GB

Tema_Q-X2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q4_K_M
1.13GB file 3.16GB

Tema_Q-X2-Thinking-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB

Tema_Q-X3-Thinking-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB