All Supported Models

29681 AI models · 198875 quantization formats tracked

O

Orneyfish

1 models

Meta-Llama-3-8B_F_16.gguf

8B 8K ctx
FP16
16GB file 18.13GB
O

Ornfelt

2 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
O

Osanseviero

1 models

Reflection-Llama-3.1-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_K_L
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_L
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q6_K_L
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
O

Oscarwu217

1 models

Taiwan-LLM-13B-v2.0-base-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB
O

Osllmai

2 models

granite-3.0-3b-a800m-instruct-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

granite-3.0-8b-instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
O

Osllmai Community

2 models

granite-3.0-1b-a400m-instruct-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

granite-3.0-2b-instruct-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
O

Osmapi

3 models

Nidum-Gemma-2B-Uncensored-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB

Nidum-Llama-3.2-3B-Uncensored-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q1_0
3GB file 5.05GB

sarvam-30b-TQ3_1S-GGUF

30B 8K ctx
Q3_1S
13.13GB file 15.62GB
O

Osmosis Ai

1 models

Osmosis-Apply-1.7B

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB
O

Osukhoroslov Hw

2 models

starcoder-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

starcoder2-15b-Q5_K_M-GGUF

15B 8K ctx
Q5_0
10.31GB file 12.56GB
FP16
30GB file 32.25GB
O

Otakadelic

41 models

gemma-3-1b-it-abliterated-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

gemma-3-1b-it-abliterated-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

MT-Gen10-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Gen10-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Gen11-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Gen11-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Gen6-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Gen6-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Gen6fix-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Gen8-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Gen8-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Gen9-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Merge6-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Merge6-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT-Merge7-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT-Merge9-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT1-Gen10-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT1-Gen11-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT1-Gen12-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT1-Gen12-gemma-2-9B-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

MT1-Gen12-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT1-Gen6-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT1-Gen7-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT2-Gen11-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT2-Gen11-gemma-2-9B-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

MT2-Gen6-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT2-Gen6-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT2-Gen7-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT3-Gen10-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT3-Gen11-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT3-Gen6-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT3-Gen6-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT3-Gen7-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT3-Gen7-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT3-Gen8-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MT3-Gen8-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MT3-Gen9-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MTM-Merge1-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

MTM-Merge1-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MTMaMe-Merge_02012025163610-gemma-2-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MTMMe-Merge-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB