All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Ready O N

3 models

Berghof-ERP-7B-gguf

7B 8K ctx
Q3_XS
3.06GB file 5.17GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

karakuri-lm-8x7b-instruct-v0.1-gguf

7B 8K ctx
Q2_XS
2.19GB file 4.3GB
Q3_XS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Vecteus-V2-7B-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
R

Real Truth

4 models

bayling-13b-v1.1-Q8_0-GGUF

13B 8K ctx
Q8_0
13.81GB file 16.02GB

Llama3.1-8B-Chinese-Chat-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Qwen2.5-14B-Instruct-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

secgpt-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
R

Real Turf

1 models

SmolRP-135M-v0.9

Unknown 8K ctx
Q8_0
0GB file 2GB
R

Realoperator42

2 models

ministral-8B-Instruct-2410-abliterated-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
R

Realyc

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
R

Reaperdoesntknow

4 models

Qwen3-0.6B-Distilled-30B-A3B-Thinking-SFT-GGUF

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-Coder-Distilled-SFT-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q8_0
1.81GB file 3.84GB

Qwen3-1.7B-Distilled-30B-A3B-SFT-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q8_0
1.81GB file 3.84GB

SMOLM2Prover-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
R

Recaru

4 models

gemma-ko-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Llama-3-KoEn-8B-Instruct-preview-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Llama-3-KoEn-8B-Instruct-preview-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Llama-3-KoEn-8B-Instruct-preview-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
R

Recogna Nlp

2 models

bode-13b-alpaca-pt-br-gguf

13B 8K ctx
Q4_0
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

bode-7b-alpaca-pt-br-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
R

Recouper

4 models

Josiefied-Qwen3-8B-abliterated-v1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Josiefied-Qwen3-8B-abliterated-v1-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Qwen3-42B-A3B-Stranger-Thoughts-Deep20x-Abliterated-Uncensored-Q4_K_M-GGUF

42B 8K ctx
Q4_0
23.63GB file 26.32GB
FP16
84GB file 86.69GB

Qwen3-The-Xiaolong-Josiefied-Omega-Directive-22B-uncensored-abliterated-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
FP16
44GB file 46.36GB
R

Recursechat

3 models

DeepSeek-R1-Distill-Llama-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

phi-4-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q2_K
1.25GB file 3.32GB
Q3_K
1.75GB file 3.82GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_0
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB