All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Invincible Jha

1 models

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_K_XL
0.84GB file 2.88GB
Q2_M
0.84GB file 2.88GB
Q2_XXS
0.84GB file 2.88GB
Q3_XXS
1.18GB file 3.22GB
Q3_S
1.18GB file 3.22GB
Q3_K_XL
1.18GB file 3.22GB
Q3_K_S
1.18GB file 3.22GB
Q3_K_M
1.18GB file 3.22GB
Q4_K_S
1.52GB file 3.56GB
Q4_K_XL
1.52GB file 3.56GB
Q4_NL
1.52GB file 3.56GB
Q4_XS
1.52GB file 3.56GB
Q4_K_M
1.52GB file 3.56GB
Q5_K_M
1.86GB file 3.9GB
Q5_K_S
1.86GB file 3.9GB
Q5_K_XL
1.86GB file 3.9GB
Q6_K
2.19GB file 4.23GB
Q6_K_XL
2.19GB file 4.23GB
Q1_M
2.7GB file 4.74GB
FP4
2.7GB file 4.74GB
Q8_0
2.87GB file 4.91GB
Q8_K_XL
2.87GB file 4.91GB
BF16
5.4GB file 7.44GB
I

Invincibleambuj

1 models

Ambuj-Tripathi-Indian-Legal-Llama-3B-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
I

Ipangbo

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
I

Ipapal

1 models

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
I

Ipsilondev

1 models

zetasepic-abliteratedV2-Qwen2.5-32B-Inst-BaseMerge-TIES-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
I

Irfanalee

3 models

code-review-critic-py-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

doc-intel-gpt-oss-20b

20B 8K ctx
FP4
20GB file 22.33GB

incident-responder-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
I

Irfanfadhullah

1 models

winagent-8b-Instruct-bnb-q4_k_m-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
I

Irfanuruchi

1 models

qwen2.5-1.5b-dsp-finetuned

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
I

Iricardoxd

2 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
I

Irie Dinamik

1 models

LiquidAI-LFM2-1.2B-Tool-GGUF

1.2B 8K ctx
Q4_K_M
0.67GB file 2.69GB
Q4_0
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB