All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Aminfri

1 models

Nemotron-Terminal-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Aminkhalafi

3 models

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Aminya0

1 models

Qwen2.5-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
A

Amirkhan Ak

1 models

xLAM-7b-r-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Amirm

2 models

Meta-Llama-3-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Amitbehura

1 models

philosophy-oracle-smollm2-360m

Unknown 8K ctx
Q8_0
0GB file 2GB
A

Amkkk

1 models

Gemma4_E2B_Abliterated_GGUF_HF_Ready

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
A

Ammad1 Ali

1 models

sql-code-gguf

Unknown 8K ctx
Q5_0
0GB file 2GB
FP16
0GB file 2GB
A

Amosh83

1 models

loralei-lora-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
A

Amritemperor123

1 models

PoC-demo

8B 8K ctx
Q8_0
8.5GB file 10.63GB