All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Serkandyck

1 models

Trendyol-LLM-7b-chat-v1.8-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
S

Sertipan

1 models

ruadapt_qwen2.5_3B_ext_u48_instruct_v4_gguf

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
S

Sethuiyer

1 models

SynthIQ_GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
S

Sethut

2 models

openchat-3.5-1210-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

openchat-3.6-8b-20240522-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
S

Seungwon12

2 models

Llama-2-7b-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
S

Seven Of Nine

1 models

Aura-4o-Gemma-4-31B-GGUF

31B 8K ctx
Q5_K_M
21.31GB file 23.82GB
S

Severian

5 models

Llama-3-IMPACTS-2x8B-64k-GGUF

8B 8K ctx
FP16
16GB file 18.13GB

Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nexus-IKM-Hermes-2-Pro-Mistral-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nexus-IKM-Mistral-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nexus-IKM-RolePlay-StoryWriter-Hermes-2-Pro-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
S

Sg At Srijan Us Kg

2 models

Qwen2.5-Coder-32B-Instruct-128k-yarn-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-128k-yarn-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
S

Sgerhart

2 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Sguann

1 models

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB