All Supported Models

29681 AI models · 198875 quantization formats tracked

H

Hewengao

1 models

Qwen2.5-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
H

Hex Quant

1 models

Pars-Medical-o1-Llama-FFT-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
H

Heydari A I

1 models

Dorna-2-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB
H

Hf 100

1 models

Llama-3.1-Spellbound-StoryWriter-70b-instruct-0.3-q4_k_m

70B 8K ctx
FP16
140GB file 143.15GB
H

Hfl

2 models

chinese-llama-2-13b-gguf

13B 8K ctx
Q2_0
4.06GB file 6.27GB
Q3_0
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q6_0
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

chinese-llama-2-7b-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
H

Hflog

1 models

Nitral-AI-Nyanade_Stunna-Maid-7B

7B 8K ctx
FP16
14GB file 16.11GB
H

Hibikiass

1 models

Tsunami-1.0-14B-Instruct-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
H

Hiddenblue1

1 models

granite-34b-code-instruct-Q4_K_M-GGUF

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB
H

Hiddengamer007

1 models

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
H

Hide On House

1 models

Phi-3-mini-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB