All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Recursivecurse

1 models

qwen2.5-coder-3b-vitest.Q4_K_M.gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
R

Recurv A I

1 models

Recurv-Medical-Lllama

8B 8K ctx
FP16
16GB file 18.13GB
R

Red Hen Labs

1 models

news-reporter-gguf

Unknown 8K ctx
FP16
0GB file 2GB
R

Red S Q I D

1 models

C4.1-Broken-Tutu-24B_b-Q3_K_S-GGUF

24B 8K ctx
Q3_0
10.5GB file 12.89GB
FP16
48GB file 50.39GB
R

Redarmee

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
R

Redgalaxy2

1 models

gemma-reformat_text-Finetune

Unknown 8K ctx
Q4_K_M
0GB file 2GB
R

Redhat6

3 models

Phi-3.5-mini-instruct-FP16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
R

Redneck B O T

1 models

typescript-slm-7b-reasoning-full

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
R

Redone99

2 models

EZO-Llama-3.2-3B-Instruct-dpoE-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

EZO-Llama-3.2-3B-Instruct-dpoE-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
R

Redponike

9 models

Apertus-70B-Instruct-2509-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB

Apertus-8B-Instruct-2509-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

KAT-Dev-72B-Exp-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q2_M
22.5GB file 25.68GB
Q2_S
22.5GB file 25.68GB
Q2_XXS
22.5GB file 25.68GB
Q3_K_L
31.5GB file 34.68GB
Q3_K_M
31.5GB file 34.68GB
Q3_K_S
31.5GB file 34.68GB
Q3_M
31.5GB file 34.68GB
Q3_S
31.5GB file 34.68GB
Q3_XS
31.5GB file 34.68GB
Q3_XXS
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_K_S
40.5GB file 43.68GB
Q4_NL
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB
Q5_K_M
49.5GB file 52.68GB
Q5_K_S
49.5GB file 52.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

Ling-mini-2.0-GGUF

2.0B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Ling-mini-2.0-GGUF-ik

2.0B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

MiniMax-M2-GGUF

2B 8K ctx
Q2_S
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_S
1.38GB file 3.41GB

Ring-flash-2.0-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB
Q2_M
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
FP4
2GB file 4.03GB

Ring-mini-2.0-GGUF

2.0B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Ring-mini-2.0-GGUF-ik

2.0B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB