All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Grey28

1 models

Jan-v1-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
G

Grimjim

36 models

cuckoo-starling-32k-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

fireblossom-32K-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

infinite-lemonade-SLERP-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

kalomaze_qwen2-7b-magpie300k_filtered_epoch2-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kitsunebi-v1-Gemma2-8k-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

kukulemon-32K-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kukulemon-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kukulemon-spiked-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

kukulemon-v3-soul_mix-32k-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kunoichi-lemon-royale-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kunoichi-lemon-royale-v2-32K-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kunoichi-lemon-royale-v3-32K-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

lemonade-rebase-32k-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

llama-3-experiment-v1-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Llama-3-Luminurse-v0.1-OAS-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Luminurse-v0.2-OAS-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama-3-Nephilim-v1-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama-3-Nephilim-v2-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama-3-Nephilim-v2.1-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama-3-Nephilim-v3-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Instruct-abliterated_via_adapter-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-Nephilim-Metamorphosis-v1-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

madwind-wizard-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Magnolia-Mell-v1-12B-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Magnolia-v1-12B-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Magnolia-v3-medis-remix-12B-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Magnolia-v3b-12B-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Magot-v1-Gemma2-8k-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Magot-v2-Gemma2-8k-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Magrathic-12B-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

MagTie-v1-12B-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Modicum-of-Doubt-v1-24B-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

rogue-enchantress-32k-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

SauerHuatuoSkywork-o1-Llama-3.1-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

zephyr-wizard-kuno-royale-BF16-merge-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
G

Grimsen Clory

8 models

EXAONE-3.5-7.8B-Instruct-IQ4_NL-GGUF

7.8B 8K ctx
Q4_0
4.39GB file 6.52GB
FP16
15.6GB file 17.73GB

Llama-3.1-Nemotron-Nano-8B-v1-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

MiniCPM4-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

NVIDIA-Nemotron-Nano-12B-v2-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Seed-Coder-8B-Reasoning-bf16-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB

Skywork-SWE-32B-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

ZR1-1.5B-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB
G

Grohitraj

16 models

AAC_2E_train

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

AAC_FT_allstructures

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_Gemma_2_2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_R_Gemma_2_2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_R_Gemma_2_2b_10e

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_train

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_train_3E_3S

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Agri_train4

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Anthro_Gemma_2_2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Anthro_ontologies_out

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Anthro_train

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Chem_Gemma_2_2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Chem_ontologies_out

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Chem_train

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

gemma2-FT-epoch20

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Llama_UTK_Chatbot

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
G

Grouselcc

1 models

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Growcompany

2 models

gemma-3-270m-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
G

Groxaxo

1 models

Qwen3.5-122B-A10B-abliterix-UD-Q4_K_XL-GGUF

122B 8K ctx
Q4_0
68.63GB file 72.63GB
Q4_K_XL
68.63GB file 72.63GB
G

Grteam

1 models

Qwen3.6-35B-A3B-GRTEAM-MTP-Q5_K_M

35B 8K ctx
Q5_K_M
24.06GB file 26.63GB
G

Grumd0

1 models

NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4-GGUF

120B 8K ctx
FP4
120GB file 123.97GB
Q8_0
127.5GB file 131.47GB
G

Grupo Parquet I T E S O

1 models

recipe-llm-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB