All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Grupo4 Bisite

4 models

CodeLlama-7b-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

CodeLlama-7b-Instruct-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
G

Gsayak

1 models

Phi-3-mini-4k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
G

Gsegato

1 models

brevity

8B 8K ctx
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
G

Gsoaresbaptista

1 models

themis-instruct-qa

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB
G

Gsoloupis

1 models

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
G

Gsxrchris

5 models

Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

OlympicCoder-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

wavecoder-ultra-6.7b-Q4_K_M-GGUF

6.7B 8K ctx
Q4_0
3.77GB file 5.88GB
FP16
13.4GB file 15.51GB
G

Gtg489P

1 models

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
G

Guardwall A I

4 models

Llama-Guard-3-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-Guard-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-Guard-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

shieldgemma-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
G

Gubee

1 models

fine-tuned-model

3B 8K ctx
FP16
6GB file 8.05GB
G

Gufett0

1 models

unsloth-llama3B

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB