All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Agga Min

1 models

llama-3-8b-Instruct-bnb-4bit-aiaustin-demo

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Aghorbani

1 models

h2o-danube2-1.8b-chat-gguf

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_M
0.79GB file 2.82GB
Q4_K_M
1.01GB file 3.04GB
Q5_K_M
1.24GB file 3.27GB
Q6_K
1.46GB file 3.49GB
A

Agnuxo

93 models

Agente-Director-Qwen2-7B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Agente-Director-Qwen2-7B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Agente-Director-Qwen2-7B-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

7B 8K ctx
Q5_K
4.81GB file 6.92GB

Agente-Director-Qwen2-7B-Instruct_CODE_Python-Spanish_English_GGUF_q6_k

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Agente-Director-Qwen2-7Bron-Instruct_CODE_Python_English_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Agente-GPT-Qwen-2.5-3B_GGUF_16bit

3B 8K ctx
FP16
6GB file 8.05GB

Agente-GPT-Qwen-2.5-3B-Spanish_English_GGUF_32bit

3B 8K ctx
FP16
6GB file 8.05GB

Agente-GPT-Qwen-2.5-7B_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Agente-GPT-Qwen-2.5-7B-Spanish_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Agente-GPT-Qwen-2.5-7B-Spanish_English_GGUF_32bit

7B 8K ctx
FP16
14GB file 16.11GB

Agente-GPT-Qwen-2.5-7B-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Agente-GPT-Qwen-2.5-7B-Spanish_English_GGUF_q5_k

7B 8K ctx
Q5_K
4.81GB file 6.92GB

Agente-GPT-Qwen-2.5-7B-Spanish_English_GGUF_q6_k

7B 8K ctx
Q6_K
5.69GB file 7.8GB

Agente-GPT-Qwen2.5-3B-Instruct-Spanish_8bit

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Agente-GPT-Qwen2.5-3B-Instruct-Spanish_English_GGUF_4bit

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Agente-GPT-Qwen2.5-3B-Instruct-Spanish_English_GGUF_q5_k

3B 8K ctx
Q5_K
2.06GB file 4.11GB

Agente-GPT-Qwen2.5-3B-Instruct-Spanish_English_GGUF_q6_k

3B 8K ctx
Q6_K
2.44GB file 4.49GB

Agente-Llama-3.1_GGUF_16bit

16B 8K ctx
FP16
32GB file 34.26GB

Agente-Llama-3.1-Spanish_8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Agente-Llama-3.1-Spanish_English_GGUF_32bit

32B 8K ctx
FP16
64GB file 66.52GB

Agente-Llama-3.1-Spanish_English_GGUF_4bit

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Agente-Llama-3.1-Spanish_English_GGUF_q5_k

8B 8K ctx
Q5_K
5.5GB file 7.63GB
BF16
16GB file 18.13GB

Agente-Llama-3.1-Spanish_English_GGUF_q6_k

8B 8K ctx
Q6_K
6.5GB file 8.63GB
BF16
16GB file 18.13GB

CAJAL-4B

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB

cajal-9b-v2-f16-gguf

9B 8K ctx
FP16
18GB file 20.15GB

cajal-9b-v2-q4_k_m

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

cajal-9b-v2-q5_k_m

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

cajal-9b-v2-q6_k

9B 8K ctx
Q6_K
7.31GB file 9.46GB

cajal-9b-v2-q8_0

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gemma-2-2b-instruct-python_CODE_assistant-GGUF_16bit

2B 8K ctx
FP16
4GB file 6.03GB

gemma-2-2b-instruct-python_CODE_assistant-GGUF_4bit

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
BF16
4GB file 6.03GB

gemma-2-2b-Python_CODE_assistant-GGUF_8bit

2B 8K ctx
Q8_0
2.13GB file 4.16GB

Llama-3.1-Minitron-4B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Llama-3.1-Minitron-4B-Instruct_CODE_Python-Spanish_English_GGUF_16bit

4B 8K ctx
FP16
8GB file 10.07GB

Llama-3.1-Minitron-4B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
BF16
8GB file 10.07GB

Llama-3.1-Minitron-4B-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

4B 8K ctx
Q5_K
2.75GB file 4.82GB
BF16
8GB file 10.07GB

Mamba-Codestral-7B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Mamba-Codestral-7B-Instruct_CODE_Python-Spanish_English_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Mamba-Codestral-7B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Mamba-Codestral-7B-v0.1-python_coding_assistant-GGUF_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Meta-Llama-3.1-8B-CODE-Alpaca-Python-8bit-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Mistral-Nemo-CODE-Python_assistant-GGUF_16bit

16B 8K ctx
FP16
32GB file 34.26GB

Mistral-Nemo-CODE-Python_assistant-GGUF_8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-16bit

8B 8K ctx
FP16
16GB file 18.13GB

Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3.5-mini-instruct-python_coding_assistant-GGUF_16bit

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3.5-mini-instruct-python_coding_assistant-GGUF_4bit

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Phi-3.5-mini-instruct-python_coding_assistant-GGUF_8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Qwen2_0.5B-GGUF_Spanish_English_raspberry_pi_8bit

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2_0.5B-Spanish_English_raspberry_pi_GGUF_16bit

0.5B 8K ctx
FP16
1GB file 3.01GB

Qwen2_0.5B-Spanish_English_raspberry_pi_GGUF_4bit

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB

Qwen2-1.5B-Instruct_MOE_assistant-GGUF_16bit

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_assistant-GGUF_4bit

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
BF16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_assistant-GGUF_8bit

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2-1.5B-Instruct_MOE_BIOLOGY_assistant-GGUF_16bit

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_BIOLOGY_assistant-GGUF_4bit

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
BF16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_BIOLOGY_assistant-GGUF_8bit

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2-1.5B-Instruct_MOE_CODE_assistant-GGUF_16bit

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_CODE_assistant-GGUF_4bit

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
BF16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_CODE_assistant-GGUF_8bit

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2-1.5B-Instruct_MOE_Director-GGUF_16bit

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_Director-GGUF_4bit

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
BF16
3GB file 5.02GB

Qwen2-1.5B-Instruct_MOE_Director-GGUF_8bit

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2-7B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2-7B-Instruct_CODE_Python-Spanish_English_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Qwen2-7B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
BF16
14GB file 16.11GB

Qwen2-7B-v2-Instruct_CODE_Python-GGUF_Spanish_English_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2-7B-v2-Instruct_CODE_Python-Spanish_English_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Qwen2-7B-v2-Instruct_CODE_Python-Spanish_English_GGUF_32bit

7B 8K ctx
FP16
14GB file 16.11GB

Qwen2-7B-v2-Instruct_CODE_Python-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
BF16
14GB file 16.11GB

tiny-llama-GGUF_Spanish_English_raspberry_pi_8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

tiny-llama-Spanish_English_raspberry_pi_GGUF_16bit

16B 8K ctx
FP16
32GB file 34.26GB

tiny-llama-Spanish_English_raspberry_pi_GGUF_4bit

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Tinytron-1B-TinyLlama-Instruct_CODE_Python-GGUF_Spanish_English_8bit

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Tinytron-1B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_16bit

1B 8K ctx
FP16
2GB file 4.02GB

Tinytron-1B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_4bit

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Tinytron-1B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

1B 8K ctx
Q5_K
0.69GB file 2.71GB
BF16
2GB file 4.02GB

Tinytron-1B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q6_k

1B 8K ctx
Q6_K
0.81GB file 2.83GB
BF16
2GB file 4.02GB

Tinytron-ORCA-3B-Instruct_CODE_Python_English_Asistant-16bit-v2

3B 8K ctx
FP16
6GB file 8.05GB

Tinytron-ORCA-3B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Tinytron-ORCA-3B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
BF16
6GB file 8.05GB

Tinytron-ORCA-3B-TinyLlama-Instruct_CODE_Python-extra_small_quantization_GGUF_3bit

3B 8K ctx
BF16
6GB file 8.05GB

Tinytron-ORCA-7B-Instruct_CODE_Python_English_GGUF_16bit

7B 8K ctx
FP16
14GB file 16.11GB

Tinytron-ORCA-7B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Tinytron-ORCA-7B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
BF16
14GB file 16.11GB

Tinytron-ORCA-7B-TinyLlama-Instruct_CODE_Python-extra_small_quantization_GGUF_3bit

7B 8K ctx
BF16
14GB file 16.11GB

Tinytron-TinyLlama-Instruct_CODE_Python-GGUF_Spanish_English_8bit

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Tinytron-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_16bit

16B 8K ctx
FP16
32GB file 34.26GB

Tinytron-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_4bit

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Tinytron-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

Unknown 8K ctx
BF16
0GB file 2GB
Q5_K
0GB file 2GB

Tinytron-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q6_k

Unknown 8K ctx
BF16
0GB file 2GB
Q6_K
0GB file 2GB
A

Agtian

1 models

llamas

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Ah Beyond

1 models

ERNIE-4.5-0.3B-Base-BF16-gguf

0.3B 8K ctx
BF16
0.6GB file 2.6GB
A

Ahashan Habib Eatl

2 models

bloomz-1b1-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.1-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Ahmad Abdo Shbat

1 models

TIA2.1-14B-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
A

Ahmadabdulnasir

1 models

NaijaPidgin-Qwen3-4B

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
A

Ahmedx Saad

1 models

Qwen3Guard-Gen-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Ai A F

4 models

bluey-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Midnight-Miqu-70B-v1.5_GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_1
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
FP16
140GB file 143.15GB

Pretrained-Merged-QLoRA-r9kilo-V1.1_Ckpt-80

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

rp-sft-merged_1000_GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB