All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Nikhil1581

2 models

qwen3-4b-instruct-2507.Q4_K_M-excel-finetuning-1.2kdataset

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

qwen3.5-2b.Q4_K_M-excel_fine_tuning

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
N

Nikhilkeetha

1 models

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
N

Nikinetrahutama

1 models

afx-issue-llama-model

Unknown 8K ctx
Q4_1
0GB file 2GB
N

Nikita Baramiia

1 models

Llama-3.1-Storm-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
N

Nikitadimitrov

1 models

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
N

Nikitos Key

3 models

Merge-Math-Coder-7B-v1

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Merge-Math-Coder-7B-v2

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Merge-Math-Coder-7B-v3

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
N

Nikity

1 models

lille-130m-instruct

Unknown 8K ctx
Q8_0
0GB file 2GB
N

Nikolay Kozloff

386 models

0x-lite-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

0x-lite-Q5_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

AceInstruct-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

AceMath-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

AceReason-Nemotron-1.1-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

AceReason-Nemotron-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

AceReason-Nemotron-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

AceReason-Nemotron-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

AI21-Jamba-Reasoning-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Alphacode-MALI-11B-Q8_0-GGUF

11B 8K ctx
Q8_0
11.69GB file 13.87GB

Alphacode-MALI-9B-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

amoral-gemma3-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

amoral-gemma3-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

amoral-gemma3-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

amoral-gemma3-12B-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

amoral-gemma3-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

ArmenianGPT-0.1-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

ArmenianGPT-0.1-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

ArmenianGPT-0.5-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

ArmenianGPT-0.5-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

ArmenianGPT-0.5-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

ArmenianGPT-0.5-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

ARWKV-R1-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

badseek-v2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

BeagleCatMunin-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

bella-1-8b-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

bella-2-8b-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

BgGPT-Gemma-2-2.6B-IT-v1.0-Q8_0-GGUF

2.6B 8K ctx
Q8_0
2.76GB file 4.8GB

BgGPT-Gemma-2-27B-IT-v1.0-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

BgGPT-Gemma-2-9B-IT-v1.0-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

BitCPM4-CANN-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

BitCPM4-CANN-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

BitCPM4-CANN-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

BitCPM4-CANN-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Carrot-Ko-2.1B-Instruct-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

CataLlama-v0.1-Instruct-DPO-Q8_0-GGUF

0.1B 8K ctx
Q8_0
0.11GB file 2.11GB

CataLlama-v0.1-Instruct-SFT-Q8_0-GGUF

0.1B 8K ctx
Q8_0
0.11GB file 2.11GB

ChatFrame-Instruct-Persian-Small-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

CodeQwen1.5-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

cogito-v1-preview-llama-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

cogito-v1-preview-llama-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

cogito-v1-preview-qwen-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

cogito-v1-preview-qwen-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

cogito-v1-preview-qwen-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Czech-GPT-2-XL-133k-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB

Dans-PersonalityEngine-V1.3.0-12b-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Dans-PersonalityEngine-V1.3.0-12b-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Dans-PersonalityEngine-V1.3.0-12b-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Datarus-R1-14B-preview-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Datarus-R1-14B-preview-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Dhanishtha-2.0-preview-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Dhanishtha-2.0-preview-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Dhanishtha-2.0-preview-Q5_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

dictalm2-it-qa-fine-tune-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

dictalm2.0-instruct-Q6_K-GGUF

2.0B 8K ctx
Q6_K
1.63GB file 3.66GB

dictalm2.0-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

DNA-R1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

DNA-R1-Q5_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

dolphin-2.9-llama3-8b-flashback-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

ERNIE-4.5-0.3B-PT-Q8_0-GGUF

0.3B 8K ctx
Q8_0
0.32GB file 2.32GB

ERNIE-4.5-21B-A3B-Thinking-Q2_K-GGUF

21B 8K ctx
Q2_0
6.56GB file 8.9GB
FP16
42GB file 44.34GB

ERNIE-4.5-21B-A3B-Thinking-Q3_K_M-GGUF

21B 8K ctx
Q3_0
9.19GB file 11.53GB
FP16
42GB file 44.34GB

ERNIE-4.5-21B-A3B-Thinking-Q3_K_S-GGUF

21B 8K ctx
Q3_0
9.19GB file 11.53GB
FP16
42GB file 44.34GB

EXAONE-3.5-2.4B-Instruct-Q8_0-GGUF

2.4B 8K ctx
Q8_0
2.55GB file 4.59GB

EXAONE-3.5-7.8B-Instruct-Q8_0-GGUF

7.8B 8K ctx
Q8_0
8.29GB file 10.42GB

EXAONE-Deep-2.4B-Q8_0-GGUF

2.4B 8K ctx
Q8_0
2.55GB file 4.59GB

EXAONE-Deep-7.8B-Q8_0-GGUF

7.8B 8K ctx
Q8_0
8.29GB file 10.42GB

gemma-2-27b-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

gemma-2-27b-Q3_K_S-GGUF

27B 8K ctx
Q3_0
11.81GB file 14.25GB
FP16
54GB file 56.44GB

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-2-2b-jpn-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Gemma-2-9B-It-SPPO-Iter3-IQ4_NL-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-2-9B-It-SPPO-Iter3-IQ4_XS-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-2-9B-It-SPPO-Iter3-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

Gemma-2-9B-It-SPPO-Iter3-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-2-9B-It-SPPO-Iter3-Q5_0-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB

Gemma-2-9B-It-SPPO-Iter3-Q5_K_S-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Gemma-2-9B-It-SPPO-Iter3-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gemma-2-9b-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gemma-3-1b-it-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

gemma-3-270m-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

gemma-portuguese-luana-2b-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma2-9B-sunfall-v0.5-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

ghost-8b-beta-1608-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

GigaChat3-10B-A1.8B-bf16-Q4_K_M-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB

GigaChat3-10B-A1.8B-bf16-Q4_K_S-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB

GigaChat3-10B-A1.8B-bf16-Q5_K_M-GGUF

10B 8K ctx
Q5_0
6.88GB file 9.04GB

GigaChat3-10B-A1.8B-bf16-Q5_K_S-GGUF

10B 8K ctx
Q5_0
6.88GB file 9.04GB

GigaChat3-10B-A1.8B-bf16-Q6_K-GGUF

10B 8K ctx
Q6_0
8.13GB file 10.29GB

GigaChat3-10B-A1.8B-bf16-Q8_0-GGUF

10B 8K ctx
Q8_0
10.63GB file 12.79GB

GigaChat3-10B-A1.8B-Q4_K_M-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB

GigaChat3-10B-A1.8B-Q4_K_S-GGUF

10B 8K ctx
Q4_0
5.63GB file 7.79GB
FP16
20GB file 22.16GB

GigaChat3-10B-A1.8B-Q5_K_M-GGUF

10B 8K ctx
Q5_0
6.88GB file 9.04GB
FP16
20GB file 22.16GB

GigaChat3-10B-A1.8B-Q5_K_S-GGUF

10B 8K ctx
Q5_0
6.88GB file 9.04GB
FP16
20GB file 22.16GB

GigaChat3-10B-A1.8B-Q6_K-GGUF

10B 8K ctx
Q6_0
8.13GB file 10.29GB
FP16
20GB file 22.16GB

GigaChat3-10B-A1.8B-Q8_0-GGUF

10B 8K ctx
Q8_0
10.63GB file 12.79GB

GLM-Z1-9B-0414-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Goedel-Prover-V2-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

gpt-oss-6.0b-specialized-all-pruned-moe-only-7-experts-Q8_0-GGUF

6.0B 8K ctx
Q8_0
6.38GB file 8.48GB

granite-20b-code-base-Q3_K_L-GGUF

20B 8K ctx
Q3_K_L
8.75GB file 11.08GB

granite-20b-code-instruct-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

granite-3.0-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3.1-2b-instruct-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

granite-3.1-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3.2-2b-instruct-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

granite-3.2-8b-instruct-preview-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3.2-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3.3-2b-instruct-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

granite-3.3-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-3b-code-base-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

granite-3b-code-instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

granite-8b-code-base-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-8b-code-instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

GreekLlama-1.1B-it-Q8_0-GGUF

1.1B 8K ctx
Q8_0
1.17GB file 3.19GB

Gromenauer-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Gromenauer-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

h2o-danube3-4b-base-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

h2o-danube3-500m-base-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

h2o-Llama-3-8B-Japanese-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Heidrun-Mistral-7B-chat-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

helium-1-2b-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

helium-1-2b-science-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

Human-Like-LLama3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Human-Like-Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

Human-Like-Mistral-Nemo-Instruct-2407-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Human-Like-Mistral-Nemo-Instruct-2407-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Human-Like-Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

HyGPT-10b-it-Q5_K_M-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB

HyGPT-10b-it-Q6_K-GGUF

2B 8K ctx
Q6_0
1.63GB file 3.66GB
FP16
4GB file 6.03GB

HyGPT-10b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

internlm2_5-20b-Q3_K_L-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2_5-20b-Q3_K_M-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2_5-20b-Q3_K_S-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2-math-plus-1_8b-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

internlm2-math-plus-20b-Q3_K_L-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2-math-plus-20b-Q3_K_M-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2-math-plus-20b-Q3_K_S-GGUF

20B 8K ctx
Q3_0
8.75GB file 11.08GB
FP16
40GB file 42.33GB

internlm2-math-plus-20b-Q4_0-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB

internlm2-math-plus-20b-Q4_K_S-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2-math-plus-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

internlm2-math-plus-7b-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

internlm2-math-plus-7b-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Irbis-7b-v0.1-Kazakh-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

jais-13b-chat-Q2_K-GGUF

13B 8K ctx
Q2_0
4.06GB file 6.27GB
FP16
26GB file 28.21GB

jais-13b-chat-Q3_K_L-GGUF

13B 8K ctx
Q3_0
5.69GB file 7.9GB
FP16
26GB file 28.21GB

jais-13b-chat-Q3_K_S-GGUF

13B 8K ctx
Q3_0
5.69GB file 7.9GB
FP16
26GB file 28.21GB

jais-13b-chat-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

jais-13b-chat-Q5_K_M-GGUF

13B 8K ctx
Q5_0
8.94GB file 11.15GB
FP16
26GB file 28.21GB

jais-13b-chat-Q6_K-GGUF

13B 8K ctx
Q6_0
10.56GB file 12.77GB
FP16
26GB file 28.21GB

Jan-nano-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

kakugo-3B-amh-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-bak-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-chv-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-cym-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-fao-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-gla-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-gle-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-glg-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-hau-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-kir-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-kmr-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-ltz-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-mlt-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-mon-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-swa-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-tat-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-tgk-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-tuk-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

kakugo-3B-ydd-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Ko-Llama-3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

kona2-12B-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

kona2-12B-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

kona2-12B-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

kona2-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

kona2-small-3.8B-Q8_0-GGUF

3.8B 8K ctx
Q8_0
4.04GB file 6.1GB

latxa-13b-v1.2-Q5_K_M-GGUF

13B 8K ctx
Q5_0
8.94GB file 11.15GB
FP16
26GB file 28.21GB

latxa-13b-v1.2-Q6_K-GGUF

13B 8K ctx
Q6_0
10.56GB file 12.77GB
FP16
26GB file 28.21GB

latxa-7b-v1.2-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

lb-reranker-0.5B-v1.0-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

LFM2-2.6B-Q8_0-GGUF

2.6B 8K ctx
Q8_0
2.76GB file 4.8GB

LFM2-8B-A1B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Ling-Coder-lite-Q3_K_L-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q3_0
0GB file 2GB

Ling-Coder-lite-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Ling-Coder-lite-Q4_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Llama-2-7b-dolphin-open_platypus-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-2-7b-Ukrainian-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3-8B-dutch-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-instruct-dansk-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-11525-03_6_2024-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-14375-08_06_2024-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-16000-11_6_2024-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-8200-29_5_2024-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-chekpoint-18833-1-epoch-15_6_2024-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Swedish-Norwegian-Danish-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-Instruct-8B-SPPO-Iter3-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3-Instruct-8B-SPPO-Iter3-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3-Instruct-8B-SPPO-Iter3-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3-Instruct-Neurona-8b-v2-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3-Instruct-Neurona-8b-v2-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama-3-KafkaLM-8B-v0.1-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-neoAI-8B-Chat-v0.1-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3-neoAI-8B-Chat-v0.1-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3-neoAI-8B-Chat-v0.1-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

llama-3-Nephilim-v3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-Oasis-v1-OAS-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Llama-3-Oasis-v1-OAS-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama-3-Open-Ko-8B-Instruct-preview-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3-portuguese-Tom-cat-8b-instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

llama-3-typhoon-v1.5-8b-instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Llama-3.1-8B-Instruct-abliterated_via_adapter-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Instruct-bnb-4bit-shqip-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Instruct-Reasoner-1o1_v0.3-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Instuct-Uz-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-Hawkish-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-Nemotron-Nano-4B-v1.1-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Llama-3.1-Nemotron-Nano-8B-v1-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.1-Tulu-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Llama-3.2-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

llama-3b-finnish-v2-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

llama-7b-finnish-v2-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-DNA-1.0-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

llama-estllm-prototype-0825-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Llama-eus-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

LLaMA-Mesh-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Llama-portuguese-13b-Luana-v0.2-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

llama3_8b_chat_brainstorm-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

Llama3-DocChat-1.0-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llammas-base-Estonian-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB

LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Magiq-3-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

magnum-12b-v2.5-kto-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

magnum-12b-v2.5-kto-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

MATH-BG-v1-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Meltemi-7B-Instruct-v1.5-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Meltemi-7B-v1.5-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Meraj-Mini-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Minerva-1B-base-v1.0-Q6_K-GGUF

1B 8K ctx
Q6_K
0.81GB file 2.83GB

Minerva-350M-base-v1.0-Q6_K-GGUF

Unknown 8K ctx
Q6_K
0GB file 2GB

Minerva-3B-Instruct-v1.0-Q5_K_M-GGUF

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB

MiniCPM4.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

MiniCPM4.1-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

MiniCPM4.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

MiniCPM4.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Mistral-7B-Instruct-Uz-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Mistral-portuguese-luana-7b-Mathematics-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nanbeige2-16B-Chat-Q4_0-GGUF

16B 8K ctx
Q4_0
9GB file 11.26GB

Nanbeige2-16B-Chat-Q4_K_M-GGUF

16B 8K ctx
Q4_0
9GB file 11.26GB
FP16
32GB file 34.26GB

Nanbeige2-16B-Chat-Q4_K_S-GGUF

16B 8K ctx
Q4_0
9GB file 11.26GB
FP16
32GB file 34.26GB

Nanbeige2-16B-Chat-Q5_0-GGUF

16B 8K ctx
Q5_0
11GB file 13.26GB

Nanbeige2-16B-Chat-Q5_K_M-GGUF

16B 8K ctx
Q5_0
11GB file 13.26GB
FP16
32GB file 34.26GB

Nanbeige2-16B-Chat-Q5_K_S-GGUF

16B 8K ctx
Q5_0
11GB file 13.26GB
FP16
32GB file 34.26GB

Nanbeige4-3B-Thinking-2511-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nanbeige4.1-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nemotron-Cascade-14B-Thinking-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Nemotron-Cascade-14B-Thinking-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Nemotron-Cascade-14B-Thinking-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

NextCoder-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

NextCoder-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

NextCoder-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

NextCoder-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

NousCoder-14B-Q3_K_L-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

NousCoder-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

NousCoder-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

NousCoder-14B-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

NousCoder-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

NuminaMath-7B-TIR-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

NuminaMath-7B-TIR-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

NuminaMath-7B-TIR-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

NuminaMath-7B-TIR-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

NVIDIA-Nemotron-Nano-12B-v2-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

NVIDIA-Nemotron-Nano-12B-v2-Q5_K_S-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

NVIDIA-Nemotron-Nano-12B-v2-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Nxcode-CQ-7B-orpo-Q6_K-GGUF

7B 8K ctx
Q6_K
5.69GB file 7.8GB

NxMobileLM-1.5B-SFT-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

OlympicCoder-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

OmniLing-V1-12b-experimental-Q5_K_M-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
FP16
24GB file 26.2GB

OmniLing-V1-12b-experimental-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

OmniLing-V1-8b-experimental-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

oneirogen-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

oneirogen-7B-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

openchat-3.6-8b-20240522-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

OpenCoder-1.5B-Base-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

OpenCoder-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

OpenCoder-8B-Base-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

OpenCoder-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

OpenCoder-8B-Instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

OpenCoder-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

OpenCoder-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

OpenCodeReasoning-Nemotron-1.1-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

OpenCodeReasoning-Nemotron-1.1-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

OpenCodeReasoning-Nemotron-1.1-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

OpenCodeReasoning-Nemotron-1.1-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

OpenReasoning-Nemotron-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

OpenReasoning-Nemotron-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

OREAL-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Phi-3-Large-5.6b-Q8_0-GGUF

5.6B 8K ctx
Q8_0
5.95GB file 8.04GB

Phi-3-medium-128k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-medium-128k-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_K_S
2.14GB file 4.2GB

Phi-3-medium-128k-instruct-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

Phi-3-medium-128k-instruct-Q5_K_S-GGUF

3.8B 8K ctx
Q5_K_S
2.61GB file 4.67GB

Phi-3-medium-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-medium-4k-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_K_S
2.14GB file 4.2GB

Phi-3-medium-4k-instruct-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

Phi-3-medium-4k-instruct-Q5_K_S-GGUF

3.8B 8K ctx
Q5_K_S
2.61GB file 4.67GB

Phi-3-medium-4k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB

Phi-3-medium-4k-instruct-sq-LORA-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

32B 8K ctx
FP16
64GB file 66.52GB

Phi-3-mini-4k-instruct-latest_version-July_2024-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

32B 8K ctx
FP16
64GB file 66.52GB

Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-3-portuguese-tom-cat-4k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-4-mini-reasoning-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-4-reasoning-plus-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-reasoning-plus-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-reasoning-plus-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Phi-4-reasoning-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-reasoning-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-reasoning-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Piaget-0.6B-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Piaget-1.7B-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

Piaget-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Piaget-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

pip-code-bandit-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

pip-library-etl-1.3b-Q8_0-GGUF

1.3B 8K ctx
Q8_0
1.38GB file 3.4GB

q1-3B-PRIME-Q8_0-GGUF

3B 8K ctx
Q1_0
3GB file 5.05GB

Qwen-portuguese-luana-7b-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2-7B-Instruct-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Instruct-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2-7B-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

Qwen2-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2-7B-Q5_K_S-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2-7B-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Qwen2-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2-Math-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-0.6B-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

Qwen3-14B-Base-Uzbek-Cyrillic-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-14B-Base-Uzbek-Cyrillic-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-14B-Base-Uzbek-Cyrillic-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen3-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-14B-Q4_K_S-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-14B-Q5_K_S-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen3-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Reverb-7b-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

shotor-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Solar-Ko-Recovery-11B-Q6_K-GGUF

11B 8K ctx
Q6_0
8.94GB file 11.12GB
FP16
22GB file 24.18GB

Solar-Ko-Recovery-11B-Q8_0-GGUF

11B 8K ctx
Q8_0
11.69GB file 13.87GB

Stable-DiffCoder-8B-Base-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Stable-DiffCoder-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

strela-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

strela-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

Tesser-Llama-3-Ko-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Tesser-Llama-3-Ko-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Trendyol-LLM-7b-chat-v1.8-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Trendyol-LLM-7b-chat-v1.8-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Trendyol-LLM-7b-chat-v1.8-Q5_0-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

Turkish-Llama-8b-Instruct-v0.1-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

tweety-7b-italian-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

tyr-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

UserLM-8b-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

UwU-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

VibeThinker-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

WEBGEN-4B-Preview-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

xLAM-7b-r-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
N

Nil471

2 models

Llama-2-7b-hf-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
N

Nilarnabdebnath

1 models

qwen3-1.7b-gsm8k-sft

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB