All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Inflatebot

1 models

helide-alpha-r5-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
I

Infohound

2 models

cogito-14b-voice-GGUF

14B 8K ctx
Q3_XS
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q4_XS
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB

ha-voice-7b-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
I

Infosys Enterprise

1 models

NT-Java-1.1B-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_0
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q5_0
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB
FP16
2.2GB file 4.22GB
I

Infra620

1 models

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
I

Ingenio

1 models

llama-2-medqa-finetuned

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
I

Inlest

1 models

OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf

20B 8K ctx
Q4_NL
11.25GB file 13.58GB
Q5_1
13.75GB file 16.08GB
Q8_0
21.25GB file 23.58GB
I

Inno157

1 models

Mistral-Nemo-12B-R1-v0.2-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB
I

Inoriqq

2 models

openthaigpt1.5-7b-instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

openthaigpt1.5-7b-instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
I

Inquiring Minds A I

1 models

LongCat-Flash-Lite-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q3_K_L
0GB file 2GB
BF16
0GB file 2GB
I

Inserloft

1 models

NaNo

Unknown 8K ctx
FP16
0GB file 2GB