All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Rmehan

1 models

grandma-qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
R

Rmote6603

1 models

Fine-tune-llama

Unknown 8K ctx
FP16
0GB file 2GB
R

Rmoura92

1 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
R

Road To Nowhere

1 models

Qwen3-32B-abliterated-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
R

Roadus

2 models

Foundation-Sec-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Foundation-Sec-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
R

Rob X Ai

1 models

phi-2-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB
R

Robbiemu

2 models

salamandra-2b

2B 8K ctx
Q2_XS
0.63GB file 2.66GB
Q3_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

salamandra-2b-instruct

2B 8K ctx
Q2_M
0.63GB file 2.66GB
Q2_S
0.63GB file 2.66GB
Q3_M
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB
R

Robbwh

1 models

medgemma-27b-text-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB
R

Robert Br

1 models

model

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
R

Robert Finance

1 models

Dolphin3.0-Llama3.2-3B-GGUF

3B 8K ctx
Q2_K_L
0.94GB file 2.99GB
Q2_K
0.94GB file 2.99GB
Q2_M
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q4_1
1.69GB file 3.74GB
Q4_0
1.69GB file 3.74GB
Q4_K_L
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_S
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_L
2.06GB file 4.11GB
Q6_K_L
2.44GB file 4.49GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB