All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Ai Coderv2

1 models

Lanz-ou

Unknown 8K ctx
FP16
0GB file 2GB
A

Ai Colombia

2 models

gemma4-e4b-job-searcher-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

qwen3_5-9b-job-searcher-gguf

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
BF16
18GB file 20.15GB
A

Ai Lab I M C S U L

2 models

EuroLLM-9B-Instruct-LVportals-15K

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB

Llama3.1-8B-Instruct-LVportals-15K

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB
A

Ai Sage

3 models

GigaChat3-10B-A1.8B-GGUF

10B 8K ctx
Q6_0
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB
BF16
20GB file 22.16GB

GigaChat3.1-10B-A1.8B-GGUF

10B 8K ctx
Q4_K_M
5.63GB file 7.79GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB
BF16
20GB file 22.16GB

GigaChat3.1-702B-A36B-GGUF

702B 8K ctx
Q4_K_M
394.88GB file 408.38GB
Q6_K
570.38GB file 583.88GB
Q8_0
745.88GB file 759.38GB
BF16
1404GB file 1417.5GB
A

Ai21Labs

1 models

AI21-Jamba-Reasoning-3B-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
A

Ai4Bharat

1 models

Airavata

Unknown 8K ctx
FP16
0GB file 2GB
A

Aicraftar

1 models

Tharo.G-Eco

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
A

Aifeifei798

6 models

C-Suite-CVO-gguf

30B 8K ctx
FP16
60GB file 62.49GB

Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-IQ4_NL-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-song-lyrics-1.1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Aifeifei799

3 models

insomnia_v2-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Phi-3-mini-128k-instruct-abliterated-v3-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-abliterated-v3-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Aifoundry Org

7 models

Amber-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

granite-8b-code-instruct-128k-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

OLMo-1B-0724-hf-Quantized

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_S
0.31GB file 2.33GB
Q3_K
0.44GB file 2.46GB
Q4_K
0.56GB file 2.58GB
Q5_K
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB

OLMo-7B-0424-hf-Quantized

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
Q8_K
7.44GB file 9.55GB

OLMo-7B-0724-hf-Quantized

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

OLMo-7B-0724-Instruct-hf-Quantized

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

OLMo-7B-0724-SFT-hf-Quantized

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB