All Supported Models

29681 AI models · 198875 quantization formats tracked

S

S3Dev Ai

23 models

Falcon-H1-7B-Instruct-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Falcon-H1R-7B-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Falcon3-10B-Instruct-gguf

10B 8K ctx
Q2_K
3.13GB file 5.29GB
Q4_K_M
5.63GB file 7.79GB
Q5_K_M
6.88GB file 9.04GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB
BF16
20GB file 22.16GB

Falcon3-7B-Instruct-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

gemma-3-12b-it-gguf

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

gemma-3-1b-it-gguf

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-270m-it-gguf

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-4b-it-gguf

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-4-26B-A4B-it-gguf

26B 8K ctx
Q2_K
8.13GB file 10.56GB
Q4_K_M
14.63GB file 17.06GB
Q5_K_M
17.88GB file 20.31GB
Q6_K
21.13GB file 23.56GB
Q8_0
27.63GB file 30.06GB
BF16
52GB file 54.43GB

gemma-4-31B-it-gguf

31B 8K ctx
Q2_K
9.69GB file 12.2GB
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB
BF16
62GB file 64.51GB

gemma-4-E2B-it-gguf

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

gemma-4-E4B-it-gguf

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Ministral-3-14B-Instruct-2512-gguf

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Ministral-3-14B-Reasoning-2512-gguf

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Ministral-3-3B-Instruct-2512-gguf

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Ministral-3-3B-Reasoning-2512-gguf

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Ministral-3-8B-Instruct-2512-gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Ministral-3-8B-Reasoning-2512-gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Ministral-8B-Instruct-2410-gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Mistral-7B-Instruct-v0.2-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Mistral-7B-Instruct-v0.3-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Mistral-Nemo-Instruct-2407-gguf

2407B 8K ctx
Q2_K
752.19GB file 793.63GB
Q4_K_M
1353.94GB file 1395.38GB
Q5_K_M
1654.81GB file 1696.25GB
Q6_K
1955.69GB file 1997.13GB
Q8_0
2557.44GB file 2598.88GB
BF16
4814GB file 4855.44GB

Mistral-Small-3.1-24B-Instruct-2503-gguf

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB
S

S3Nh

179 models

abacusai-Giraffe-13b-32k-v3-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

abideen-x-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

AdaptLLM-finance-LLM-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

AdaptLLM-law-LLM-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

AdaptLLM-medicine-LLM-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Aeryth-7B-v0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ajibawa-2023-Uncensored-Jordan-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

ajibawa-2023-Uncensored-Jordan-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

akjindal53244-Arithmo-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ALMA-13B-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

ALMA-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

arkanbima-Aethizin-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

AtAndDev-ShortKing-3b-v0.2-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

AthenaImaniMaven-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

azale-ai-Starstreak-7b-alpha-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Azazelle-Maylin-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Azazelle-Tippy-Toppy-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Azazelle-Yuna-7b-Merge-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

beberik-Lonepino-11B-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q3_K_S
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q8_0
11.69GB file 13.87GB

bibidentuhanoi-BMO-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Blurred-Beagle-7b-slerp-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Chikuma_10.7B-GGUF

10.7B 8K ctx
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

cockatrice-7b-v0.3-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Crunchy-onion-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

CrystalMistral_7b_v.01-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Cybertron-UNA-11b-v2-GGUF

11B 8K ctx
Q4_K_M
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB

Daisuke-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

DaringLotus-GGUF

Unknown 8K ctx
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

DaringLotus-v2-10.7b-GGUF

10.7B 8K ctx
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

decapoda-research-Antares-11b-v1-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q3_K_S
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q8_0
11.69GB file 13.87GB

Delcos-Velara-11B-V2-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q3_K_S
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q8_0
11.69GB file 13.87GB

diffnamehard-Psyfighter2-Noromaid-ties-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

DistilabelBeagle14-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

DopeorNope-Mark1-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

DopeorNope-SOLARC-M-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Dr_Samantha-7b-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

DuckDB-NSQL-7B-v0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Edentns-DataVortexM-7B-Instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ehartford-WizardLM-1.0-Uncensored-Llama2-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

elonmollusk-neuralogix-neural-chat-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_S
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

elonmollusk-neuralogix-openhermes-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

EstopianMaid-13B-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Evangelion-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Faraday-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

FlagAlpha-Llama2-Chinese-13b-Chat-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

flux-7b-v0.2-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

fnlp-moss-base-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Fredithefish-CanarY-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

functionary-small-v2.2-GGUF

2.2B 8K ctx
Q3_K_S
0.96GB file 3GB
Q4_K_M
1.24GB file 3.28GB
Q5_K_M
1.51GB file 3.55GB
Q6_K
1.79GB file 3.83GB
Q8_0
2.34GB file 4.38GB

garage-bAInd-Stable-Platypus2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

GEITje-7B-ultra-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

GeneZC-MiniChat-2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

gizmo-ai-Starling-LM-7B-alpha-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

GOAT-Finance-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

golaxy-gogpt2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Gorgon-7b-v0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Gryphe-MythoMax-L2-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Guilherme34-Samantha-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

HamSter-0.2-GGUF

0.2B 8K ctx
Q3_K_S
0.09GB file 2.09GB
Q4_K_M
0.11GB file 2.11GB
Q5_K_M
0.14GB file 2.14GB
Q6_K
0.16GB file 2.16GB
Q8_0
0.21GB file 2.21GB

Henk717-spring-dragon-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Hermaid-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

HiTZ-GoLLIE-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

HiTZ-GoLLIE-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

hunkim-NousResearch-Llama-2-7b-hf-ko-7-koalpaca-v1.1a-kopen-platypus-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

intfloat-e5-mistral-7b-instruct-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

jan-hq-supermario-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

jeff31415-TinyLlama-1.1B-1.5T-OpenOrca-Alpha-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

jeonsworld-CarbonVillain-10.7B-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Ketak-ZoomRx-Drug_Ollama_v3-2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

koala-7B-slerp-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunocchini-7b-128k-test-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunoichi-DPO-v2-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

latxa-13b-v1-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

latxa-7b-v1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Lelantos-Maid-DPO-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

likenneth-honest_llama2_chat_7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Llama-2-13b-chat-dutch-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

lmsys-longchat-7b-v1.5-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Loquace-tiny-1.1B-GGUF

1.1B 8K ctx
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

MarkrAI-MarK2-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Masterjp123-Clover3-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Masterjp123-NeuralMaid-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MathLLM-MathCoder-CL-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MathLLM-MathCoder-L-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MaziyarPanahi-Seraph-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MedChat3.5-GGUF

3.5B 8K ctx
Q3_K_S
1.53GB file 3.59GB
Q4_K_M
1.97GB file 4.03GB
Q5_K_M
2.41GB file 4.47GB
Q6_K
2.84GB file 4.9GB
Q8_0
3.72GB file 5.78GB

Metabird-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mhm-7b-v1.3-DPO-1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

migtissera-Synthia-7B-v1.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MiniCPM-2B-dpo-fp32-GGUF

2B 8K ctx
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Mistral_Sonyichi-7B-slerp-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Mistral-7B-Evol-Instruct-Chinese-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-7B-Instruct-v0.2-Neural-Story-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mistral-7b-lamia-v0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mistral-7b-lamia-v0.1b-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mlabonne-Marcoro14-7B-slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mlabonne-Marcoro14-7B-ties-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mlabonne-NeuralPipe-7B-slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

multimaster-7b-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

NarutoDolphin-10B-GGUF

10B 8K ctx
Q3_K_S
4.38GB file 6.54GB
Q4_K_M
5.63GB file 7.79GB
Q5_K_M
6.88GB file 9.04GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB

NeuralBeagle-11B-GGUF

11B 8K ctx
Q3_K_S
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q8_0
11.69GB file 13.87GB

NeuralDaredevil-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

NeuralNovel-Tanuki-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

neuronovo-7B-v0.3-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Neuronovo-neuronovo-7B-v0.3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

NeverSleepHistorical-Noromaid-7B-0.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Newton-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

NexoNimbus-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Noromaid-Aeryth-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Novocode7b-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Novocode7b-v3-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

nsfw-noromaid-mistral-instruct-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB

NSFW-Panda-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Obrolin-Kesehatan-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

occultml-Helios-10.7B-v2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

OEvortex-HelpingAI-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Open-Orca-OpenOrca-Preview1-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

openerotica-cockatrice-7b-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Patronum-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

phanerozoic-Mistral-Pirate-7b-v0.3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Photolens-OpenOrcaxOpenChat-2-13b-langchain-chat-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

PistachioAlt-Noromaid-Bagel-7B-Slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Rhino-Mistral-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

s3nh-Finance-Noromaid-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

s3nh-Law-Noromaid-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

s3nh-Medicine-Noromaid-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

s3nh-Noromaid-Panda-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

s3nh-nsfw-noromaid-zephyr-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

s3nh-Sonya-Panda-7B-slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

SanjiWatsuki-Lelantos-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

SanjiWatsuki-Silicon-Maid-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

SanjiWatsuki-Sonya-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Sao10K-Sensualize-Solar-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Sao10K-Stheno-L2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Sao10K-Winterreise-m7-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

sethuiyer-Dr_Samantha_7b_mistral-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

sethuiyer-SynthIQ-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB

SnowLotus-v2-10.7B-GGUF

10.7B 8K ctx
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Sonya-Panda-7B-slerp-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Spanicin-Fulcrum-7B-slerp-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

stabilityai-japanese-stablelm-base-gamma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

stabilityai-japanese-stablelm-instruct-gamma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Sydney_Pirate_Mistral_7b-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Synatra-7B-v0.3-dpo-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

TachyHealth-Thealth-SLERP-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

TencentARC-LLaMA-Pro-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Tensoic-TinyLlama-1.1B-2.5T-openhermes-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

Tensoic-TinyLlama-1.1B-3T-openhermes-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

Tess-10.7B-v1.5b-GGUF

10.7B 8K ctx
Q3_K_S
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

Thespis-Mistral-7b-Alpha-v0.7-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Thespis-Mistral-7b-v0.7-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Tiger-7b-v0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

TIGER-Lab-TIGERScore-7B-V1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

TinyDolphin-2.8-1.1b-GGUF

1.1B 8K ctx
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

TinyGauss-1.1B-GGUF

1.1B 8K ctx
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

TinyLlama-1.1B-32k-GGUF

1.1B 8K ctx
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

TinyLlama-de-stage2-v0.7-GGUF

0.7B 8K ctx
Q3_K_S
0.31GB file 2.32GB
Q4_K_M
0.39GB file 2.4GB
Q5_K_M
0.48GB file 2.49GB
Q6_K
0.57GB file 2.58GB
Q8_0
0.74GB file 2.75GB

ToolBench-ToolLLaMA-2-7b-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ToolBench-ToolLLaMA-2-7b-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

totally-not-an-llm-AlpacaCielo2-7b-8k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Unbabel-TowerInstruct-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Undi95-Unholy-v2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

UTENA-7B-NSFW-V2-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

UTENA-7B-UNA-V2-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

UTENA-7B-V3-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Velara-11B-V2-GGUF

11B 8K ctx
Q4_K_M
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB

vickt-LLama-chinese-med-chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Vikhr-7b-0.1-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Voldemort-10B-DPO-GGUF

10B 8K ctx
Q3_K_S
4.38GB file 6.54GB
Q4_K_M
5.63GB file 7.79GB
Q5_K_M
6.88GB file 9.04GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB

Wernicke-7B-dpo-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

WestLake-7B-v2-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

WestSeverus-7B-DPO-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

whiterabbitneo-WhiteRabbitNeo-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

WSB-GPT-7B-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Yash21-SuperChat-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Yash21-TinyYi-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

YeungNLP-firefly-llama-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

zephyr-speakleash-007-pl-8192-32-16-0.05-GGUF

0.05B 8K ctx
Q3_K_S
0.02GB file 2.02GB
Q4_K_M
0.03GB file 2.03GB
Q5_K_M
0.03GB file 2.03GB
Q6_K
0.04GB file 2.04GB
Q8_0
0.05GB file 2.05GB
S

S4Sch

3 models

Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-gguf-q8

11B 8K ctx
Q5_K_M
7.56GB file 9.74GB

Open-Hermes-2.5-neural-chat-3.1-InterlaceMerge-14b

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB

zephyr-neural-chat-frankenmerge11b-gguf-q5

11B 8K ctx
Q5_K_M
7.56GB file 9.74GB
S

S6135

2 models

L3-Super-Nova-RP-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen2.5-1.5B-Instruct_FT-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
S

Saadxsalman

3 models

Q-SS-0.5B-Reasoning-Math-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB

SS-Talk-2-Bash

Unknown 8K ctx
Q8_0
0GB file 2GB

SS-Talk-2-Bash-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
S

Saattrupdan

1 models

munin-7b-alpha-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
S

Sabafallah

6 models

Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

Qwen3-4B-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

reader-lm-0.5b-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
S

Sabine812

1 models

Qwen3-14B-128K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB
S

Sabomako

4 models

gpt-oss-120b-heretic-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

gpt-oss-120b-ultra-heretic-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

NVIDIA-Nemotron-3-Super-120B-A12B-BF16-heretic-v2-GGUF

120B 8K ctx
FP4
120GB file 123.97GB
BF16
240GB file 243.97GB

Qwen3.5-35B-A3B-heretic-v2-GGUF

35B 8K ctx
FP4
35GB file 37.57GB
S

Sabre Code

1 models

tinyllamafullprecision20k.Q4_K_M

Unknown 8K ctx
Q4_K_M
0GB file 2GB