All Supported Models

29681 AI models · 198875 quantization formats tracked

E

Ericflo

12 models

Llama-3.1-8B-ContinuedTraining

8B 8K ctx
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.1-8B-ContinuedTraining2-FFT

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-RLHF-v0.1

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Llama-3.2-3B-COT

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Llama-3.2-3B-COTv2

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Llama-3.2-3B-COTv2.1

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Llama-3.2-3B-COTv2.2

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Llama-3.2-3B-COTv3

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Qwen2.5-7B-Think-KTO-v0.1

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Qwen2.5-7B-Think-KTO-v0.2

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

unnaturalhermes-v0.1

Unknown 8K ctx
Q8_0
0GB file 2GB

unnaturalhermes-v0.2

Unknown 8K ctx
Q8_0
0GB file 2GB
E

Ericliu2007

2 models

Qwen2.5-14B-Instruct-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

Qwen2.5-32B-Instruct-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB
E

Ericnunes1

1 models

phi4-r1

4B 8K ctx
Q8_0
4.25GB file 6.32GB
E

Ericpandev

1 models

Crumb-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
E

Ericwang

2 models

OpenReasoning-Nemotron-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

ReaderLM-v2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
E

Erik Feng

1 models

DeepSeek-R1-Distill-Llama-70B-Science-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
E

Erik51

1 models

Shifa-1.5-physical

Unknown 8K ctx
FP16
0GB file 2GB
E

Erinda

1 models

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
E

Ermiaazarkhalili

19 models

Carnice-9B-Function-Calling-xLAM-Unsloth-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q8_0
9.56GB file 11.71GB

Carnice-9B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Gemma4-E2B-Function-Calling-xLAM-Unsloth-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

Gemma4-E2B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

Gemma4-E4B-Function-Calling-xLAM-Unsloth-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

LFM2-1.2B-GRPO-NuminaMath-10K-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
FP16
2.4GB file 4.42GB

LFM2-350M-GRPO-NuminaMath-10K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

LFM2-700M-GRPO-NuminaMath-10K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

LFM2.5-1.2B-Function-Calling-xLAM-Unsloth-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2.5-1.2B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

LFM2.5-350M-Function-Calling-xLAM-Unsloth-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Qwen3-4B-Function-Calling-xLAM-Unsloth-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-8B-Function-Calling-xLAM-Unsloth-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3.5-0.8B-Function-Calling-xLAM-Unsloth-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_M
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

Qwen3.5-0.8B-SFT-Claude-Opus-Reasoning-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_M
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

Qwen3.5-0.8B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_M
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

Qwen3.5-2B-Function-Calling-xLAM-Unsloth-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Qwen3.5-4B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-9B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
E

Ernaz

1 models

llama2-kazakh-7b-GGUF

7B 8K ctx
Q4_K
3.94GB file 6.05GB