All Supported Models

29681 AI models · 198875 quantization formats tracked

3

3Ndetz

2 models

fred-t5-xl-remastered-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q5_K_M
0GB file 2GB

zoomerlm-gemma4-e2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
BF16
4GB file 6.03GB
4

44M0N

1 models

llama-guard-3-sensitive-data-0-1-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
4

4513 P

1 models

deepseek-for-my-bishe

8B 8K ctx
FP16
16GB file 18.13GB
4

4Maan4Hmad

1 models

Mistral-finetuned-productidentifier-v2.0

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
4

4Rc4N4

1 models

qwen2.5-7b-rellm

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
5

5Fp

2 models

Meta-Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
6

6Ms

1 models

DeepSeek-V4-Flash-MXFP4-GGUF

4B 8K ctx
FP4
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
7

754Geg

1 models

kpok

22B 8K ctx
Q1_S
22GB file 24.36GB
7

7Z4Rk7

3 models

CodeLlama-34b-hf-Q4_K_M-GGUF

34B 8K ctx
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-FP8-Dynamic-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB

Qwen3-Coder-REAP-25B-A3B-Q4_K_M-GGUF

25B 8K ctx
Q4_0
14.06GB file 16.47GB
FP16
50GB file 52.41GB
8

893790183 L Z W

13 models

bloom-1b7-Q3_K_S-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

bloom-1b7-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

bloom-1b7-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

bloom-7b1-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

bloom-7b1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

bloom-7b1-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

bloom-7b1-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-2-7b-hf-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Llama-2-7b-hf-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB