All Supported Models

29681 AI models · 198875 quantization formats tracked

J

Jelawless

8 models

Phi-4-mini-instruct-IQ3_XXS-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-IQ4_NL-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-IQ4_XS-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-4-mini-instruct-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen3-0.6B-Base-Q4_0-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
J

Jelldps

1 models

malaysian-mistral-7b-32k-instructions-v4-gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
J

Jeney

1 models

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_XXS
0.19GB file 2.2GB
Q2_M
0.19GB file 2.2GB
Q2_K_XL
0.19GB file 2.2GB
Q2_K_L
0.19GB file 2.2GB
Q2_K
0.19GB file 2.2GB
Q3_XXS
0.26GB file 2.27GB
Q3_K_XL
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q4_0
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q4_K_XL
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_XL
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q6_K_XL
0.49GB file 2.5GB
Q1_M
0.6GB file 2.61GB
Q1_S
0.6GB file 2.61GB
Q8_0
0.64GB file 2.65GB
Q8_K_XL
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB
J

Jenhseb

2 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
J

Jeradf

1 models

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
J

Jerem62

1 models

Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB
J

Jeremierostan

3 models

gemma-2-2b-it-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB
BF16
4GB file 6.03GB

Meta-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
BF16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
BF16
16GB file 18.13GB
J

Jeremygracey Ai

1 models

FetchMerck_AI

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
J

Jerkar

2 models

LFM2-8B-A1B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

MiroThinker-v1.5-30B-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB
J

Jerryzhuang

1 models

gpt-oss-120b-GGUF

120B 8K ctx
Q2_K_L
37.5GB file 41.47GB
Q2_K
37.5GB file 41.47GB
Q3_K_S
52.5GB file 56.47GB
Q3_K_M
52.5GB file 56.47GB
Q4_0
67.5GB file 71.47GB
Q4_1
67.5GB file 71.47GB
Q4_K_M
67.5GB file 71.47GB
Q4_K_S
67.5GB file 71.47GB
Q4_K_XL
67.5GB file 71.47GB
Q5_K_M
82.5GB file 86.47GB
Q5_K_S
82.5GB file 86.47GB
Q6_K
97.5GB file 101.47GB
Q6_K_XL
97.5GB file 101.47GB
Q8_0
127.5GB file 131.47GB
Q8_K_XL
127.5GB file 131.47GB