All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Itod

1 models

Meta-Llama-3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
I

Its Me Dev Roland

1 models

OpenElla-NovelWriter-8B-V2-merged-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
I

Itsnebulalol

1 models

Llama-3.2-3B-Instruct-Alpaca

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
I

Itzmealvin

1 models

GGUF_Qwen3-2507-4B-IT-Q4KM

4B 8K ctx
FP16
8GB file 10.07GB
I

Itzune

5 models

Gemma-Kimu-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Gemma-Kimu-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

Gemma-Kimu-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-Kimu-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Latxa-Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
FP16
140GB file 143.15GB
I

Ivarro

2 models

Llama-3-Groq-8B-Tool-Use-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3-Groq-8B-Tool-Use-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
I

Iwakura Rein

2 models

Huihui-gpt-oss-20b-BF16-abliterated-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

Nemotron-3-Nano-30B-A3B-NVFP4-GGUF

30B 8K ctx
FP4
30GB file 32.49GB
I

Iwalton3

2 models

phoenix

4B 8K ctx
Q8_0
4.25GB file 6.32GB

sycofact

4B 8K ctx
Q8_0
4.25GB file 6.32GB
I

Iyadycb

1 models

phillama-3.8b-v0.1-gguf-imatrix

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q2_XS
1.19GB file 3.25GB
Q3_K
1.66GB file 3.72GB
Q3_S
1.66GB file 3.72GB
Q4_NL
2.14GB file 4.2GB
Q4_K
2.14GB file 4.2GB
Q5_K
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB
I

Izhanjafry

3 models

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB