All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mylaux

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
M

Mylesgoose

1 models

Llama-3.2-1B-Instruct-abliterated3-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
M

Mymyuer

1 models

Qwen2.5-Coder-14B-Instruct-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
FP16
28GB file 30.23GB
M

Myrall

1 models

turtle-llama-3-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
M

Myunghoonse

1 models

SOLAR-10.7B-v1.0-Instruct-gguf

10.7B 8K ctx
FP16
21.4GB file 23.58GB
M

Mzweilin

1 models

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
M

Mzwing

1 models

NSFW_13B_sft-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_K_M
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB
N

N Bot Int

11 models

ElaNore3-4B-GGUFF

4B 8K ctx
FP16
8GB file 10.07GB

MiniMaid_L1-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

MiniMaid_L2-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

MiniMaid_L3-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

OpenElla-NovelWriter-8B-V2-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

OpenElla-StoryWriter-TypeB-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q8_0
0GB file 2GB

OpenElla3-Llama3.2-GGUF

3.2B 8K ctx
Q8_0
3.4GB file 5.45GB

OpenElla3-Llama3.2A

3B 8K ctx
Q8_0
3.19GB file 5.24GB

OpenElla3-Llama3.2B-GGUF

3.2B 8K ctx
Q4_K_M
1.8GB file 3.85GB
Q5_K_M
2.2GB file 4.25GB
Q8_0
3.4GB file 5.45GB

OpenElla3-Llama3.2B-V2-GGUF

3.2B 8K ctx
Q4_K_M
1.8GB file 3.85GB
Q5_K_M
2.2GB file 4.25GB
Q8_0
3.4GB file 5.45GB

ZoraBetaA2-Q16

Unknown 8K ctx
FP16
0GB file 2GB
N

N Fvolient

1 models

Qwen2-Boundless-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
N

N I C E B O Y S

1 models

ko-gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB