All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Argearriojas

7 models

gemma-2-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Llama-3.2-1B-Instruct-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
A

Ari Weinstein

1 models

Meta-Llama-3-8B-GGUF-Qx_0-imatrix

8B 8K ctx
Q4_0
4.5GB file 6.63GB
A

Arian Universe

1 models

Sir-Thinksalot

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
A

Ariel Ml

2 models

PULI-LlumiX-32K-instruct-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q8_0
0GB file 2GB

SambaLingo-Hungarian-Chat-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
A

Arifsw

1 models

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Arisridwan

1 models

islamgpt-id-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
A

Arjunbroepic

1 models

edgy-commenter-GGUF

0.8B 8K ctx
Q8_0
0.85GB file 2.86GB
A

Arli A I

1 models

QwQ-32B-ArliAI-RpR-v4-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_L
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
FP16
64GB file 66.52GB
A

Arlindkadra

1 models

Llama-3.1-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
A

Arm G P T

1 models

ArmenianGPT-1.0-3B

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB