All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Insomniactools

1 models

L3-Solana-8B-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
I

Inspirebek

1 models

qwen3-4b-uzbek-v2-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
I

Int2Eh

1 models

Phi-3-medium-128k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_K_M
2.61GB file 4.67GB
I

Intel

2 models

MiroThinker-v1.5-30B-gguf-q2ks-mixed-AutoRound

30B 8K ctx
Q2_K_S
9.38GB file 11.87GB

Qwen3-Coder-30B-A3B-Instruct-gguf-q4km-AutoRound

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB
I

Intelligent Estate

15 models

DeRanger-1.5B-iQ5_K_S-GGUF

1.5B 8K ctx
Q5_K_S
1.03GB file 3.05GB

Gambit-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

GQwexx-4B-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

Gqwexx-Qwen3-8B_q4_k_m.gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Israfel_Qwen2.6-iQ4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Keg_Party-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Keg_Party-DPO-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Oreal-R1-7b-q5_k_s-imat-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen3-4b-FireFly-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

ReasoningRabbit_QwenStar-7B-IQ4_XS-GGUF

7B 8K ctx
Q4_XS
3.94GB file 6.05GB

Replicant_Operator_ed-Qw25-Q8_0-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB

Replicant_Warder-QwenStar-3B-iQ5_K_S

3B 8K ctx
Q5_K_S
2.06GB file 4.11GB

Tangu-3B-Qwenstar-Q8-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Vega_QwQ-7B-Q5K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

VEGA-A-Rombos-QwC2.5-7B-iQ4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
I

Intelservice77

1 models

Qwen3.6-35B-A3B-Abliterated-Heretic-BF16-Q4_K_S-GGUF

35B 8K ctx
Q4_0
19.69GB file 22.26GB
I

Internlm

5 models

internlm2_5-1_8b-chat-gguf

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

internlm2_5-20b-chat-gguf

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
FP16
40GB file 42.33GB

internlm2_5-7b-chat-1m-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

internlm2_5-7b-chat-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

internlm3-8b-instruct-gguf

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
I

Intervitens Archive

1 models

internlm2-limarp-chat-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
I

Intrect

1 models

VELA

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
I

Introvoyz041

17 models

C2S-Scale-Gemma-2-27B-Q4_0-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB

C2S-Scale-Gemma-2-2B-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

ChartVerse-Coder-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

ChemLLM-20B-Chat-DPO-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

ChemLLM-20B-Chat-SFT-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

ether0-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

G1-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

G1-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Gliese-4B-OSS-0410-Q4_0-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

Jan-v1-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Logics-Qwen3-Math-4B-Q4_0-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

Omega-Herculis-7B-Prime2-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

phi-2-electrical-engineering-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Pyxidis-Manim-CodeGen-1.7B-Q4_0-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB

SmolLM2-1.7B-Instruct-Q4_0-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB

SmolLM2-135M-Instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

SmolLM2-360M-Instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB