All Supported Models

29681 AI models · 198875 quantization formats tracked

H

Hienbm

1 models

gemma2-9b-it-for-tripadvisor-v3

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
BF16
18GB file 20.15GB
H

Hiepphambk

1 models

lab22-dpo-vn

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
H

Hierholzer

2 models

Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB

Llama-3.3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
H

Hieupt

2 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
H

Hieuvm4

1 models

Qwen2.5-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
H

Highendpc

2 models

Qwen3-4B-Thinking-2507-heretic-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-heretic-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
H

Higorgonlw

1 models

Qwen2.5-Coder-32B-Instruct-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
H

Hiiamboris

1 models

Darwin-28B-Coder-Q4_K_M-GGUF

28B 8K ctx
Q4_0
15.75GB file 18.21GB
FP16
56GB file 58.46GB
H

Himalaya Ai

1 models

himalayagpt-0.5b-it-gguf

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB
H

Himax33

1 models

Phi-4-mini-instruct-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB