All Supported Models

29681 AI models · 198875 quantization formats tracked

E

Electron Rare

2 models

mistral-large-opus-Q4_K_M-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Qwen3.6-35B-A3B-Q4_K_M-gguf

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
E

Electron271

4 models

graig-alpha

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

graig-code-turbo-fast-slow-4.5-mini

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

graig-experiment-2

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

graig-experiment-3

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
E

Eleonord

1 models

Learnia-Empathic-v2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
E

Elichen Skymizer

60 models

DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

gemma-3-1b-pt-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

gemma-3-1b-pt-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

gemma-3-1b-pt-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

gemma-3-1b-pt-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

granite-3.1-1b-a400m-base-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.1-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q3_K_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q3_K_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-1.5B-Q3_K_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB

Qwen2.5-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen3-0.6B-Base-Q3_K_M-GGUF

0.6B 8K ctx
Q3_0
0.26GB file 2.27GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Base-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Base-Q5_K_M-GGUF

0.6B 8K ctx
Q5_0
0.41GB file 2.42GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Base-Q6_K-GGUF

0.6B 8K ctx
Q6_0
0.49GB file 2.5GB
FP16
1.2GB file 3.21GB

Qwen3-30B-A3B-Instruct-2507-Q3_K_M-GGUF

30B 8K ctx
Q3_0
13.13GB file 15.62GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Qwen3-30B-A3B-Thinking-2507-Q3_K_M-GGUF

30B 8K ctx
Q3_0
13.13GB file 15.62GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q5_K_M-GGUF

30B 8K ctx
Q5_0
20.63GB file 23.12GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Qwen3-4B-Instruct-2507-Q3_K_M-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-Q3_K_M-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Q6_K-GGUF

4B 8K ctx
Q6_0
3.25GB file 5.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
E

Elichen3051

2 models

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
E

Eligapris

2 models

Qwen2.5-Coder-32B-Instruct-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
E

Eligiall

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
E

Elijah Kulpinski

4 models

Mistral-7B-OpenOrca-EduText

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-OpenOrca-UWPInstruct

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-OpenOrca-UWPInstruct-UWPSecurityInstruct

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-OpenOrca-UWPInstructWSecurity

7B 8K ctx
FP16
14GB file 16.11GB
E

Elijahbodden

1 models

eliGPTv1.1

Unknown 8K ctx
Q5_K_M
0GB file 2GB
E

Elise T123

1 models

LFM2-24B-A2B-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB