All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Adityabhushannagar

1 models

Qwen-3.5-9B-Gemini-Opus-merge-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_S
5.06GB file 7.21GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q5_0
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
A

Adityadhakal

1 models

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Adityakum667388

3 models

lumichat_coder-v2.1

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB

lumichats-v1.1

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

lumichats-v1.2-7b-bnb-4bit

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
A

Admijgjtjtjtjjg

5 models

dfdfdf

Unknown 8K ctx
FP16
0GB file 2GB

fgfgfg

Unknown 8K ctx
FP16
0GB file 2GB

hhjgjguhh

Unknown 8K ctx
Q8_0
0GB file 2GB

Qwen3-0.6B-Micro-5M

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

rwkv-xd

Unknown 8K ctx
FP16
0GB file 2GB
A

Admiralakber

3 models

gemma-3-270m-it-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

gemma-3-270m-it-qat-q4_0-unquantized-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

gemma-3-270m-it-qat-q4_0-unquantized-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
A

Adnan Riaz107

3 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

starcoder-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

Adoaskdaoskd

1 models

Tiny-LLM-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Adonald

1 models

Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB
A

Adorjanwhite

1 models

open_llama_7b_v2_q5_k_m

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
A

Adrianmm12

2 models

fact-judge-1.7b

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

Qwen-1.5B-Query-Generator

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB