All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Aviad Dahan

2 models

Meta-Llama-3-8B-fp16-gguf

8B 8K ctx
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-fp16-gguf

8B 8K ctx
FP16
16GB file 18.13GB
A

Avikam

1 models

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Aviral Gusain

1 models

unity-debug-coach

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
A

Avlp12

2 models

Qwen3.5-35B-A3B-Alis-Ultra-GGUF

35B 8K ctx
FP16
70GB file 72.57GB

Qwen3.5-35B-A3B-Alis-Ultra-Slim-GGUF

35B 8K ctx
FP16
70GB file 72.57GB
A

Avrecum

1 models

mistral7b-v0.3-alpaca-cleaned

7B 8K ctx
FP16
14GB file 16.11GB
A

Awesomeluc

5 models

171Av4-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

171Av5-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

CompliAI_FullModel1-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

CompliAI171A_Base-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

CompliAI171A-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB
A

Awilliamson

1 models

wholism

1.1B 8K ctx
FP16
2.2GB file 4.22GB
A

Awjdn9

1 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Axcel1

1 models

Meta-Llama-3-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB
A

Axi0M X

1 models

SU-01-GGUF

01B 8K ctx
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB