All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jwiggerthale

7 models

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Llama-3.2-3B-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Llama-3.2-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Teuken-7B-instruct-commercial-v0.4-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Teuken-7B-instruct-commercial-v0.4-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
J

Jx11235

1 models

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
J

Jyotirmoy Cluster

1 models

llama3-FT

Unknown 8K ctx
FP16
0GB file 2GB
K

K B T G Labs

1 models

THaLLE-0.1-7B-fa-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
K

K Blue Leaf

12 models

DanTagGen-alpha

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB

DanTagGen-beta

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB

DanTagGen-delta

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB

DanTagGen-delta-rev2

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB

DanTagGen-gamma

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB

TIPO-100M

Unknown 8K ctx
FP16
0GB file 2GB

TIPO-200M

Unknown 8K ctx
FP16
0GB file 2GB

TIPO-200M-dev

Unknown 8K ctx
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

TIPO-200M-ft

Unknown 8K ctx
FP16
0GB file 2GB

TIPO-200M-ft2

Unknown 8K ctx
FP16
0GB file 2GB

TIPO-500M

Unknown 8K ctx
FP16
0GB file 2GB

TIPO-500M-ft

Unknown 8K ctx
FP16
0GB file 2GB
K

K H A N8816

1 models

PakistaniLawPhi-3

3.8B 8K ctx
FP16
7.6GB file 9.66GB
K

K I S T Robot Intelligence

3 models

ko-gemma-2-9b-it-GGUF-quantization

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_0
5.06GB file 7.21GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

KONI-Llama3-8B-Instruct-20240729-GGUF-Quantization

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen-14B-Chat-GGUF-Quantization

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_L
6.13GB file 8.36GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_0
7.88GB file 10.11GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
K

K K9922

1 models

Forge-Gemma-3-27B-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
K

K L M F O R E V E R

1 models

WizardLM-2-7B-GGUF-Q4-K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
K

K O N S T A N T I N8814

1 models

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB