All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Joseph195410

1 models

Mistral-7B-Instruct-v0.3-GGUF

7B 8K ctx
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_K
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_S
7GB file 9.11GB
Q1_M
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
J

Josephgflowers

13 models

140M-TinyLLama-Mini-Cinder-With-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

3BigReasonCinder

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Cinder-Phi-2-STEM-2.94B-Test

2.94B 8K ctx
FP16
5.88GB file 7.93GB

Cinder-Phi-2-Test-1

Unknown 8K ctx
FP16
0GB file 2GB

Cinder-Phi-2-V1-F16-gguf

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3-mini-4k-instruct-Cinder-llamafied-with-16bit-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3-mini-4k-instruct-Cinder-with-16bit-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Tinyllama-1.3B-Cinder-Reason-Test

1.3B 8K ctx
Q8_0
1.38GB file 3.4GB

Tinyllama-1.3B-Cinder-Reason-Test-2

1.3B 8K ctx
Q8_0
1.38GB file 3.4GB

Tinyllama-1.5B-Cinder-New-Test-1-with-gguf

1.5B 8K ctx
FP16
3GB file 5.02GB

TinyLlama-3T-Cinder-v1.2

8B 8K ctx
Q8_0
8.5GB file 10.63GB

TinyLlama-3T-Cinder-v1.3

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Tinyllama-616M-Cinder-DPO-With-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
J

Josephmayo

2 models

qwen-2-5-coder-3b-elm-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Qwen2.5-0.5B-Unfettered

0.5B 8K ctx
FP16
1GB file 3.01GB
J

Josh X T

3 models

AGiXT-Qwen3-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB

AGiXT-Qwen3-VL-2B-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB

AGiXT-Qwen3-VL-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
J

Josharsh

1 models

harshell

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
J

Joshnader

10 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Mistral-7B-Instruct-v0.2-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

rho-math-7b-interpreter-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

rho-math-7b-interpreter-v0.1-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

rho-math-7b-v0.1-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
J

Joshuawong1

1 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
J

Josiahdavis

3 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
J

Josoa Test

1 models

fine-tuned-llama-3.2-3binstruct-v01

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
J

Josoroma

1 models

gemma-4-codigo-trabajo-gguf

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
BF16
62GB file 64.51GB