All Supported Models

29681 AI models · 198875 quantization formats tracked

X

Xufofox

1 models

gemma-2-2b-it-test-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
X

Xuhuanxinkong

1 models

Qwopus-3.5-27B-gguf

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
X

Xusilak

1 models

gemma-2-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB
X

Xwcoco

1 models

Peach-9B-8k-Roleplay-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
X

Xxll222557

1 models

Nuo-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
X

Xxxx Yyyy

1 models

MAXWELL-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
X

Xxxxrshx12

1 models

tcs-philosophy-llama3.2-3b-qlora

3B 8K ctx
Q8_0
3.19GB file 5.24GB
X

Xxxxxccc

7 models

1CPT_mediaDescr_2epoch_Mistral-Nemo-Base-2407_model

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

2CPT_mediaDescr_2epoch_Mistral-Nemo-Base-2407_model

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

climate_framestance_5epoch_Mistral-Nemo-Base-2407_model

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

mediaDescr_2epoch_Mistral-Nemo-Base-2407_model

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

news_boilerplate_llama31_8b_model

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

news_boilerplate_Mistral-Nemo-Base-2407_model

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

news_tech_Qwen2_7b_4bit_model

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB
X

Xyottax

3 models

Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
X

Xythic K

8 models

Amber-Fable-1.0-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

DictaLM-3.0-24B-Base-GGUF

24B 8K ctx
Q2_0
7.5GB file 9.89GB
Q3_0
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q6_0
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

ERNIE-4.5-21B-A3B-Thinking-GGUF

21B 8K ctx
Q2_K
6.56GB file 8.9GB
Q2_K_L
6.56GB file 8.9GB
Q2_K_XL
6.56GB file 8.9GB
Q2_M
6.56GB file 8.9GB
Q2_XXS
6.56GB file 8.9GB
Q3_K_M
9.19GB file 11.53GB
Q3_K_S
9.19GB file 11.53GB
Q3_K_XL
9.19GB file 11.53GB
Q3_XXS
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_1
11.81GB file 14.15GB
Q4_K_M
11.81GB file 14.15GB
Q4_K_S
11.81GB file 14.15GB
Q4_NL
11.81GB file 14.15GB
Q4_XS
11.81GB file 14.15GB
Q5_K_M
14.44GB file 16.78GB
Q6_K
17.06GB file 19.4GB
Q1_M
21GB file 23.34GB
Q1_S
21GB file 23.34GB
Q8_0
22.31GB file 24.65GB
BF16
42GB file 44.34GB

Lovelace-1-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mag-Mell-R1-Uncensored-21B-GGUF

21B 8K ctx
Q2_0
6.56GB file 8.9GB
Q3_0
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q5_0
14.44GB file 16.78GB
Q6_0
17.06GB file 19.4GB
Q8_0
22.31GB file 24.65GB

Plano-Orchestrator-30B-A3B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

qwen-coder-14b-vulrepair-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q2_K_XL
0.53GB file 2.56GB
Q2_M
0.53GB file 2.56GB
Q2_XXS
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_XXS
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_XL
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_XL
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q6_K_XL
1.38GB file 3.41GB
Q1_M
1.7GB file 3.73GB
Q1_S
1.7GB file 3.73GB
Q8_0
1.81GB file 3.84GB
Q8_K_XL
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB