All Supported Models

29681 AI models · 198875 quantization formats tracked

H

Hdnh2006

3 models

BSC-LT-salamandra-2b-instruct-gguf

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_S
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q4_K_S
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_1
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

BSC-LT-salamandra-7b-instruct-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_1
4.81GB file 6.92GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_0
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q5_0
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
H

He Rks T An

6 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Mistral-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
H

Hearsid

1 models

DarkIdol-Llama-3.1-8B-Instruct-1.3-Uncensored-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_K_M
8.5GB file 10.63GB
FP16
16GB file 18.13GB
H

Heatw4Ve

2 models

gemma-2-text-rewriter-gguf

9B 8K ctx
FP16
18GB file 20.15GB

Qwen3-4B-Instruct-2507-rewriter-gguf

4B 8K ctx
FP16
8GB file 10.07GB
H

Heavens Hack Dev

2 models

Gear-1-160m

Unknown 8K ctx
FP16
0GB file 2GB

Gear-2-500m

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
H

Heavylildude

1 models

magnus-coder

Unknown 8K ctx
Q4_K_M
0GB file 2GB
H

Heegyu

1 models

KoSafeGuard-8b-0503

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
H

Heisenbug

1 models

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
H

Heitong

1 models

openchat-3.6-8b-20240522-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
H

Helenk

2 models

gemma-4-E2B-finetune-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

gemma-4-E4B-finetune-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB