All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Ilayaraja3

1 models

llama-3-8b-instruct-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB
I

Ilhansertelli

1 models

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
I

Ilintar

2 models

Dhanishtha-2.0-preview-0825-Q3_K_M-GGUF

Unknown 8K ctx
Q3_0
0GB file 2GB
FP16
0GB file 2GB

Llama-3-1-Nemotron-Nano-8B-v1-i-GGUF

8B 8K ctx
Q3_XXS
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_XS
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
I

Ill Ness

2 models

Supertron1-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Supertron1-4B-Q5_0-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
I

Illeatmyhat

1 models

gemma-2-9b-it-Q6_K-GGUF

9B 8K ctx
Q6_0
7.31GB file 9.46GB
FP16
18GB file 20.15GB
I

Illegalcall

1 models

Qwen3.5-9B-RYS-0-4-GGUF

9B 8K ctx
FP16
18GB file 20.15GB
I

Ilopezluna

1 models

something

7B 8K ctx
FP16
14GB file 16.11GB
I

Ilsp

1 models

Llama-Krikri-8B-Instruct-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
I

Ilya Gusev

5 models

saiga_llama3_8b_gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q4_K
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

saiga_mistral_7b_gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

saiga2_13b_gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q4_K
7.31GB file 9.52GB
Q5_K
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB

saiga2_70b_gguf

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q4_1
39.38GB file 42.53GB

saiga2_7b_gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
I

Ilya626

3 models

Qwen3.5-27B-Heretic-SDFT-v1-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB

Qwen3.5-4B-Heretic-SDFT-v1

4B 8K ctx
Q5_K_M
2.75GB file 4.82GB

Qwen3.5-9B-Heretic-SDFT-v1

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB