All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Irinachengsc

1 models

Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
I

Irmma

5 models

ERNIE-4.5-21B-A3B-PT-Q4_K_S-GGUF

21B 8K ctx
Q4_0
11.81GB file 14.15GB
FP16
42GB file 44.34GB

gemma-3-4b-novision-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

GLM-4-9B-0414-abliterated-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GLM-Z1-9B-0414-abliterated-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

GLM-Z1-9B-0414-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
I

Ironbcc

1 models

gemma-4-26B-A4B-it-MTP-GGUF

26B 8K ctx
Q2_K
8.13GB file 10.56GB
Q4_K_M
14.63GB file 17.06GB
Q8_0
27.63GB file 30.06GB
I

Ironlanderl

2 models

gemma-2-2b-it-Q5_K_M-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB

Phi-3-mini-4k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB
I

Irresistiblegrace97

3 models

Llama-2-7b-chat-hf-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
I

Is Asong

2 models

DeepSeek-R1-agriculture-New2

671B 8K ctx
Q4_0
377.44GB file 390.43GB
FP16
1342GB file 1354.99GB

DeepSeek-R1-miao-2

671B 8K ctx
FP16
1342GB file 1354.99GB
I

Isaiasnavarro

1 models

minemodel

Unknown 8K ctx
FP16
0GB file 2GB
I

Iscoolwilson

1 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
I

Ishaanlol

1 models

Aletheia-Llama-3.2-3B

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
I

Ishan93

1 models

Qwen-2.5-fine-tuned-meta-math-gguf

7B 8K ctx
FP16
14GB file 16.11GB