All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Rollend

1 models

Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
R

Rollercoaster X

1 models

NewMes-v15-Q5_K_M-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
FP16
0GB file 2GB
R

Romarchive

9 models

gemma-3n-4b-it-distill-smollm2-360m-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB
BF16
8GB file 10.07GB
FP32
16GB file 18.07GB

gemma-4-31b-it-distill-qwen3-0.6b-lora-GGUF

31B 8K ctx
Q8_0
32.94GB file 35.45GB

LocoOperator-4B-GGUF

4B 8K ctx
Q3_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_0
4GB file 6.07GB
FP4
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen2-0.5B-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q1_0
0.5GB file 2.51GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q3_M
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q1_0
0.6GB file 2.61GB
FP4
0.6GB file 2.61GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3.5-0.8B-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_XSS
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q6_K
0.65GB file 2.66GB
Q1_0
0.8GB file 2.81GB
FP4
0.8GB file 2.81GB
Q8_0
0.85GB file 2.86GB
BF16
1.6GB file 3.61GB

Qwen3.5-2B-Base-GGUF

2B 8K ctx
Q3_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q1_0
2GB file 4.03GB
FP4
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB

Rain-100M-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
FP4
0GB file 2GB
Q1_0
0GB file 2GB
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB

toyllama-50m-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q2_0
0GB file 2GB
Q1_0
0GB file 2GB
BF16
0GB file 2GB
R

Rombodawg

1 models

NousCoder-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
R

Ronald888

1 models

fused-mistral-7b-v0.3-4bit

7B 8K ctx
FP16
14GB file 16.11GB
R

Ronny

2 models

Mistral-150M-Instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

xLAM-2-32b-fc-r-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
R

Ronyu21

1 models

OlympicCoder-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
R

Rookie

1 models

Llama-3-8B-Instruct-Chinese

8B 8K ctx
Q5_1
5.5GB file 7.63GB
R

Roopalgn

1 models

sahayak-tb-gemma4-e2b-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
R

Root Signals

1 models

RootSignals-Judge-Llama-70B

70B 8K ctx
Q8_0
74.38GB file 77.53GB