All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sdrshn Nmbr

1 models

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
S

Sds Ai

1 models

Yee-R1-mini-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_S
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_M
0.74GB file 2.77GB
Q3_S
0.74GB file 2.77GB
Q3_XS
0.74GB file 2.77GB
Q3_XXS
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB
S

Sdyy

2 models

Qwen2.5-14B-Instruct-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
S

Sea9016

1 models

gemma-3-4b-it-item-mechanics-generator-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
S

Seandearnaley

1 models

mistral-7b-sentiment-may-18-2024-1epoch

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
S

Seasparks

1 models

Llama-3.1-8B-Instruct-LegalCite-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Seawolf2357

4 models

cerberus-llama-3-8b-instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Meta-Llama-3-70B-Instruct-Q4_K_M-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
S

Sebas6K

3 models

AESA_FAQs_Sebas_30epochs

Unknown 8K ctx
Q4_K_M
0GB file 2GB

BITEXT_2epochLlama3

Unknown 8K ctx
Q4_K_M
0GB file 2GB

llama-3-8b-chat-doctor

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
S

Sebastian221 Art

1 models

bell-motor

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
S

Sebrom1156

2 models

Qwen2.5-Coder-7B-Instruct-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB