All Supported Models

29681 AI models · 198875 quantization formats tracked

O

Open L L M France

2 models

Lucie-7B-Instruct-human-data

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Lucie-7B-Instruct-v1.1-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
O

Open S U S E

1 models

CVE-Backport-Qwen2.5-Coder-32B

32B 8K ctx
Q8_0
34GB file 36.52GB
O

Open Your Mind

1 models

Qwopus3.5-122B-A10B-abliterated-uncensored-GGUF

122B 8K ctx
Q4_K_M
68.63GB file 72.63GB
Q8_0
129.63GB file 133.63GB
O

Open4Bits

19 models

EXAONE-3.5-7.8B-Instruct-GGUF

7.8B 8K ctx
Q2_K
2.44GB file 4.57GB
Q4_K_M
4.39GB file 6.52GB

EXAONE-4.0-1.2B-gguf

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-270m-it-gguf

1B 8K ctx
Q3_M
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

GLM-4.7-Flash-GGUF

Unknown 8K ctx
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_XXS
0GB file 2GB

Kai-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.1-8B-Instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB

Llama-3.2-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

llama-nexora-vector-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q4_0
0.06GB file 2.06GB
Q4_K_M
0.06GB file 2.06GB
Q4_K_S
0.06GB file 2.06GB
Q5_K_M
0.07GB file 2.07GB
Q5_K_S
0.07GB file 2.07GB
Q6_K
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB

llama3.2-1b-gguf

1B 8K ctx
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

LocoOperator-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

MiniMax-M2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

MiniMax-M2.5-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB
Q1_0
2.5GB file 4.54GB

Nanbeige4.1-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

nexora-vector-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_M
0.04GB file 2.04GB
Q3_XXS
0.04GB file 2.04GB
Q4_K_M
0.06GB file 2.06GB
Q4_NL
0.06GB file 2.06GB
Q4_XS
0.06GB file 2.06GB
Q5_K_S
0.07GB file 2.07GB
Q6_K
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB

Qwen3-0.6b-gguf

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q5_1
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

sarvam-1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Schematron-3B-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
O

Opena2A

1 models

nanomind-security-analyst

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
O

Openalchemy

1 models

MachFund

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB
O

Openbmb

10 models

BitCPM-CANN-0.5B-gguf

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
BF16
1GB file 3.01GB

BitCPM-CANN-1B-gguf

1B 8K ctx
Q2_0
0.31GB file 2.33GB
BF16
2GB file 4.02GB

BitCPM-CANN-3B-gguf

3B 8K ctx
Q2_0
0.94GB file 2.99GB
BF16
6GB file 8.05GB

BitCPM-CANN-8B-gguf

8B 8K ctx
Q2_0
2.5GB file 4.63GB

BitCPM4-0.5B-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q4_0
0.28GB file 2.29GB

BitCPM4-1B-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q4_0
0.56GB file 2.58GB

MiniCPM4-0.5B-QAT-Int4-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

MiniCPM4-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

MiniCPM4.1-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

MiniCPM5-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB
O

Openfree

4 models

Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

49B 8K ctx
Q4_0
27.56GB file 30.36GB
FP16
98GB file 100.8GB

Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

49B 8K ctx
Q6_0
39.81GB file 42.61GB
FP16
98GB file 100.8GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
O

Openmed Community

3 models

AFM-4.5B-OpenMed-GGUF

4.5B 8K ctx
Q2_0
1.41GB file 3.48GB
Q4_0
2.53GB file 4.6GB
Q8_0
4.78GB file 6.85GB

AFM-4.5B-OpenMed-RL-CoT-GGUF

4.5B 8K ctx
Q2_0
1.41GB file 3.48GB
Q4_0
2.53GB file 4.6GB
Q8_0
4.78GB file 6.85GB

granite-4.0-micro-OpenMed-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
O

Opensota

1 models

deepseek-v4-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q4_0
2.25GB file 4.32GB