All Supported Models

29681 AI models · 198875 quantization formats tracked

T

Tellang

1 models

session-vault-qwen35-9b-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
BF16
18GB file 20.15GB
T

Telugu L L M Labs

2 models

Indic-gemma-2b-finetuned-sft-Navarasa-2.0-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
FP16
4GB file 6.03GB

Indic-gemma-7b-finetuned-sft-Navarasa-2.0-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
FP16
14GB file 16.11GB
T

Tencent

1 models

Youtu-LLM-2B-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
T

Tendie Labs

3 models

Capybara-31B-GGUFS

31B 8K ctx
Q4_0
17.44GB file 19.95GB
Q4_1
17.44GB file 19.95GB
Q4_K_M
17.44GB file 19.95GB
Q4_K_S
17.44GB file 19.95GB
Q4_NL
17.44GB file 19.95GB
Q4_XS
17.44GB file 19.95GB
Q5_0
21.31GB file 23.82GB
Q5_1
21.31GB file 23.82GB
Q5_K_M
21.31GB file 23.82GB
Q5_K_S
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB

Frank-26B-A4B-GGUFs

26B 8K ctx
Q4_0
14.63GB file 17.06GB
Q4_1
14.63GB file 17.06GB
Q4_K_M
14.63GB file 17.06GB
Q4_K_S
14.63GB file 17.06GB
Q4_NL
14.63GB file 17.06GB
Q4_XS
14.63GB file 17.06GB
Q8_0
27.63GB file 30.06GB

Frank-9B-GGUFs

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
T

Teneriffa

2 models

Qwen1.5-32B-Chat-Q4_0-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB

Qwen1.5-32B-Q4_0-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
T

Tensorblock

1438 models

0x-lite-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

2p8xx_Foundation-Sec-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

666-GGUF

666B 8K ctx
Q2_K
208.13GB file 221.04GB

7B-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

abhishek_autotrain-llama3-70b-math-v1-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

AceInstruct-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

AceInstruct-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

AceMath-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

AdaptLLM_medicine-LLM-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

agentica-org_DeepCoder-14B-Preview-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

agentica-org_DeepSWE-Preview-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

AgentPublic_LlaMAndement-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Ahma-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

AIDXteam_ktdsbaseLM-v0.15-onbased-llama3.1-GGUF

3.1B 8K ctx
Q2_K
0.97GB file 3.02GB
Q3_K_M
1.36GB file 3.41GB

aigrant_Llama3-8b-Legal-Mind-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Aira-2-1B1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Aira-2-1B5-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Aira-2-774M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

airoboros-2.2.1-y34b-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

aisingapore_Llama-SEA-LION-v2-8B-IT-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

aisingapore_Llama-SEA-LION-v3-70B-IT-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

AISquare-Instruct-llama2-koen-13b-v0.9.24-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

AISquare-Instruct-SOLAR-10.7b-v0.5.31-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

AISquare-Instruct-SOLAR-10.7b-v0.5.32-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

AISquare-Instruct-yi-ko-6b-v0.9.30-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

AITeamVN_GRPO-VI-Qwen2-7B-RAG-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

albertfares_DPO_MCQA_model_3_03_07_08-GGUF

08B 8K ctx
Q2_K
2.5GB file 4.63GB

albertfares_DPO_MCQA_model_3_06_04_08-GGUF

08B 8K ctx
Q2_K
2.5GB file 4.63GB

albertfares_DPO_MCQA_model-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

ALIA-40b-GGUF

40B 8K ctx
Q2_K
12.5GB file 15.16GB
Q3_K_M
17.5GB file 20.16GB

AliMaatouk_TinyLlama-1.1B-Tele-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

all-hands_openhands-lm-32b-v0.1-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

ALLaM-7B-Instruct-preview-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

allenai_OLMo-2-0425-1B-DPO-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

allenai_OLMo-2-0425-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

allenai_OLMo-2-0425-1B-RLVR1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Alphacode-MALI-11B_slowtest-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

Alphacode-MALI-11B-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

Alphacode-MALI-9B-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Alphallama3-8B_v2-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

AlphaMist7B-slr-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

AlphaMist7B-slr-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Alphatao_Affine-1855255-GGUF

1855255B 8K ctx
Q2_K
579767.19GB file 610165.69GB
Q3_K_M
811674.06GB file 842072.56GB

Alphatao_Affine-5246433-GGUF

5246433B 8K ctx
Q2_K
1639510.31GB file 1725469.87GB

Alphatao_Affine-7470548-GGUF

7470548B 8K ctx
Q2_K
2334546.25GB file 2456945.71GB

Alphatao_Affine-9459823-GGUF

9459823B 8K ctx
Q2_K
2956194.69GB file 3111186.43GB

Ambari-7B-base-v0.1-sharded-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Ambari-7B-Instruct-v0.1-sharded-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Amber-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

amd_PARD-Llama-3.2-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

amd_PARD-Qwen2.5-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

AMD-OLMo-1B-SFT-DPO-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

AMD-OLMo-1B-SFT-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

ANIMA-Cognitive-Mistral-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

apathi_norm-macdonald-ai-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Arabic-llama3.1-16bit-FT-GGUF

16B 8K ctx
Q2_K
5GB file 7.26GB
Q3_K_M
7GB file 9.26GB

Arabic-Orpo-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

arcee-ai_GLM-4-32B-Base-32K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Arch-Function-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Arch-Function-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Arch-Function-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Archaeo-12B-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

Argetsu-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

ArliAI_DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

ArliAI_Qwen3-30B-A3B-ArliAI-RpR-v4-Fast-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

ArliAI_QwQ-32B-ArliAI-RpR-v4-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

arshiaafshani_arshGpt-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Artemide-3.5-GGUF

3.5B 8K ctx
Q2_K
1.09GB file 3.15GB

Aspik101_StableBeluga-13B-instruct-PL-lora_unload-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Aspik101_trurl-2-13b-pl-instruct_unload-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Aspik101_vicuna-13b-v1.5-PL-lora_unload-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Aspik101_vicuna-7b-v1.3-instruct-pl-lora_unload-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Aspik101_Vicuzard-30B-Uncensored-instruct-PL-lora_unload-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

autotrain-2n9b3-mj6my-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

autotrain-llama3-70b-orpo-v2-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

AXCXEPT_EZO-Humanities-9B-gemma-2-it-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

badseek-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

baichuan-inc_Baichuan-13B-Base-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

baichuan-inc_Baichuan-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

base_7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

base-eval-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

BFS-Prover-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

BgGPT-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

2.6B 8K ctx
Q2_K
0.81GB file 2.85GB
Q3_K_M
1.14GB file 3.18GB

BgGPT-Gemma-2-9B-IT-v1.0-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

BioMistral-7B-DARE-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

BioMistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

BioMistral-7B-TIES-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

bitext_Mistral-7B-Banking-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

bloom-1b1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

bloom-1b7-fp32-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

bloom-1b7-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

bloom-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

bloom-560m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

bloom-7b1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

bloomz-1b1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

bloomz-1b7-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

bloomz-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

bloomz-3b-sft-chat-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

bloomz-560m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

bloomz-7b1-mt-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

bloomz-7b1-mt-sft-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Borea-Phi-3.5-mini-Instruct-Jp-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Breeze-7B-32k-Base-v1_0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Breeze-7B-Base-v1_0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Breeze-7B-Instruct-v0_1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Breeze-7B-Instruct-v1_0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

brianknowsai_Brian-Llama-3.2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

brucethemoose_CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

Bumblebee-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

ByteDance-Seed_Seed-Coder-8B-Reasoning-bf16-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

caisarl76_Mistral-7B-OpenOrca-Guanaco-accu16-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

caisarl76_Mistral-7B-orca-1k-platy-1k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

caisarl76_Mistral-7B-orca-platy-2k-ep4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Calcium-Opus-14B-Elite-1M-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

CalliopeDS-v2-L2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

calme-2.1-phi3-4b-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

calme-2.1-phi3.5-4b-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

calme-2.1-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

calme-2.2-llama3.1-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

calme-2.2-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

calme-2.3-llama3-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

calme-2.4-llama3-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

calme-2.4-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

calme-2.5-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

calme-2.6-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

calme-2.7-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

calme-2.8-qwen2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

calme-3.1-baguette-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

calme-3.1-instruct-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

calme-3.1-llamaloi-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

calme-3.1-qwenloi-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

calme-3.2-baguette-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

calme-3.2-instruct-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

calme-3.3-instruct-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

CantoneseLLM-6B-preview202402-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

CapyTessBorosYi-34B-200K-DARE-Ties-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

CarrotAI_Rabbit-Ko-15B-Instruct-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB

cepiloth_ko-llama2-finetune-ex2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

chat_gpt2_dpo-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

chat-gpt2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

ChatFrame-Uncensored-Instruct-Small-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

ChatMusician-Base-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

CHEMLLM-2b-1_5-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Chikuma_10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

chinoll_Yi-6b-200k-dpo-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Chocolatine-14B-Instruct-4k-DPO-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Chocolatine-14B-Instruct-DPO-v1.2-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Chocolatine-3B-Instruct-DPO-Revised-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Chocolatine-3B-Instruct-DPO-v1.2-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Clarus-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Clinical-BR-LlaMA-2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

code_gpt2_mini_model-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

code_gpt2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

CodeCalc-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

codegemma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

CodeLlama-13b-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

CodeLlama-13b-Python-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

CodeLlama-34b-hf-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

CodeLlama-34b-Python-hf-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

CodeLlama-70b-hf-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

CodeLlama-70b-Python-hf-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

CodeLlama-7b-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

CodeLlama-7b-Python-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

CodeQwen1.5-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

CodeSteer-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

CodeV-CL-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

COKAL_merged_test-v1-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

COKAL-DPO_test-v2-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

COKAL-DPO-13b-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

COLA3-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Cotype-Nano-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

CroissantCool-v0.2-GGUF

0.2B 8K ctx
Q2_K
0.06GB file 2.06GB

CroissantLLMChat-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_K_M
0.04GB file 2.04GB

CUBOX-SOLAR-10.7B-DPO-v0.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

Custom-KoLLM-13B-v1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Custom-KoLLM-13B-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Custom-KoLLM-13B-v7-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Custom-KoLLM-13B-v8-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

cyber-risk-llama-3-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

cyber-risk-llama-3-8b-instruct-sft-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Cygnus-II-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

cymist-2-v02-SFT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

cymist2-v01-SFT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

danielkty22_TARS-SFT-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

DaringMaid-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

DaringMaid-20B-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB

DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

dart-math-llama3-8b-prop2diff-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

datagemma-rag-27b-it-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB

datagemma-rig-27b-it-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

DataPilot_ArrowNeo-Neko-3B-instruct-v0.2-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

DataVortexM-7B-Instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

DataVortexS-10.7B-dpo-v1.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

DataVortexS-10.7B-dpo-v1.10-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.11-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

DataVortexS-10.7B-dpo-v1.12-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.3-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.4-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.5-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.6-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

DataVortexS-10.7B-dpo-v1.7-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-dpo-v1.8-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-v0.2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

DataVortexS-10.7B-v0.3-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexS-10.7B-v1.0-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

DataVortexTL-1.1B-v0.1-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB

DavidAU_Qwen3-30B-A6B-16-Extreme-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

DavidAU_Qwen3-8B-64k-Context-2X-Josiefied-Uncensored-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

davidkim205_komt-llama2-7b-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

davidkim205_komt-mistral-7b-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Deacon-20B-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB

Deacon-34B-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

Dear_My_best_Friends-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Dear_My_best_Friends-v2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

deepcogito_cogito-v1-preview-llama-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

deepcogito_cogito-v1-preview-llama-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

deepcogito_cogito-v1-preview-qwen-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

deepseek-r1-14b-cot-math-reasoning-full-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

DeepSeek-R1-Distill-Llama-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

DeepSeek-R1-Distill-Qwen-14B-Japanese-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

DeepSeek-R1-Distill-Qwen-32B-Japanese-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

deepseek-r1-distill-qwen2.5-bakeneko-32b-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

DeepSeek-R1-Qwen2.5-1.5b-SFT-R1-JSON-Unstructured-To-Structured-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

DeepSeek-V3-1B-Test-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

deepthought-8b-llama-v0.01-alpha-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Defne_llama3_2x8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Defne-llama3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

defog_sqlcoder-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

defog_sqlcoder2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Delcos_Mistral-Pygmalion-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Delta-Pavonis-Qwen-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Delta-Vector_GLM-4-32B-Tulu-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

deval-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

DialoGPT-medium-Loki-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

DialoGPT-small-garycoleman-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

dictalm2-it-qa-fine-tune-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

dictalm2.0-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB

dictalm2.0-instruct-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

dmis-lab_llama-3.1-medprm-reward-v1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

DNA-R1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

dnotitia_Smoothie-Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB

dnotitia_Smoothie-Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB

dnotitia_Smoothie-Qwen3-30B-A3B-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB

dnotitia_Smoothie-Qwen3-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

dnotitia_Smoothie-Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Dolphin3.0-Mistral-24B-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB

Dolphin3.0-R1-Mistral-24B-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB

dongguanting_Tool-Star-Qwen-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Dr_Samantha-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

DRT-o1-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

DRT-o1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

DRT-o1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

DT-SL-SOLAR-10.7B-v0.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

Dumb-Maidlet-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

dut-recipe-generator-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

easy-ko-Llama3-8b-Instruct-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

edumunozsala_llama-2-7b-int4-python-code-20k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

EEVE_ver_4.1_sft-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

ehristoforu_Falcon3-MoE-2x7B-Insruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Elita-1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

em_german_leo_mistral-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

EmojiLlama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Enceladus-14B-Exp-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

eternis_eternis_sft_tool_calling_Qwen0.6B_27jul_merged-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB

ethicalabs_Kurtis-E1.1-Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Evangelion-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

EXAONE-3.5-2.4B-Instruct-GGUF

2.4B 8K ctx
Q2_K
0.75GB file 2.79GB

EXAONE-3.5-2.4B-Instruct-Llamafied-GGUF

2.4B 8K ctx
Q2_K
0.75GB file 2.79GB

EXAONE-3.5-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

EXAONE-3.5-32B-Instruct-Llamafied-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

EXAONE-3.5-7.8B-Instruct-GGUF

7.8B 8K ctx
Q2_K
2.44GB file 4.57GB
Q3_K_M
3.41GB file 5.54GB

EXAONE-3.5-7.8B-Instruct-Llamafied-GGUF

7.8B 8K ctx
Q2_K
2.44GB file 4.57GB

EXAONE-Deep-2.4B-GGUF

2.4B 8K ctx
Q2_K
0.75GB file 2.79GB

EXAONE-Deep-7.8B-GGUF

7.8B 8K ctx
Q2_K
2.44GB file 4.57GB
Q3_K_M
3.41GB file 5.54GB

EXAONE3.5-2.5b-Instruct-128k-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB

Experiment31-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

EZO-Common-9B-gemma-2-it-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

EZO-gemma-2-2b-jpn-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

EZO-Qwen2.5-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

falcon-mamba-7b-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Falcon3-Mamba-R1-v0-GGUF

0B 8K ctx
Q2_K
0GB file 2GB

familidata_llama31-GGUF

31B 8K ctx
Q2_K
9.69GB file 12.2GB

familidata-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Faro-Yi-9B-DPO-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

fdtn-ai_Foundation-Sec-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Featherless-Chat-Models_llama2-13b-chat-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Featherless-Chat-Models_Mistral-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Featherless-Chat-Models_Mistral-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

FelixChao_vicuna-7B-chemical-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Felladrin_Minueza-2-96M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Felladrin_Qwen2-96M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Felladrin_TinyMistral-248M-Chat-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

fietje-2-chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

fietje-2-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

filipealmeida_Mistral-7B-Instruct-v0.1-sharded-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

FinMatcha-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Finnish-NLP_Ahma-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

fireballoon_baichuan-vicuna-chinese-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

FluentlyLM-Prinum-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Fox-1-1.6B-GGUF

1.6B 8K ctx
Q2_K
0.5GB file 2.53GB

FreedomIntelligence_HuatuoGPT-Vision-7B-Qwen2.5VL-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

ft-solar-10.7b-v2.1-dpo-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

FuseChat-7B-VaRM-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

FusionNet_34Bx2_MoE-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

FusionNet_linear-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

FusionNet_passthrough_v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB

FusionNet_passthrough-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

FusionNet_SOLAR-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

FusionNet-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

futurehouse_ether0-GGUF

0B 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

GAI-LLM_ko-en-llama2-13b-mixed-v1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

gair-prox_web-chunk-refining-lm-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Gauss-Opus-14B-R999-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

GEITje-7B-chat-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

GEITje-7B-ultra-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-2-27b-it-abliterated-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

gemma-2-27b-it-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB

gemma-2-27b-it-SimPO-37K-100steps-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

gemma-2-27b-it-SimPO-37K-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB

gemma-2-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2-2b-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2-2b-jpn-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2-2b-neogenesis-ita-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2-9b-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

gemma-2-9b-it-fix-system-role-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

Gemma-2-9B-It-SPPO-Iter1-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Gemma-2-9B-It-SPPO-Iter2-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

Gemma-2-9B-It-SPPO-Iter3-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

gemma-2-9b-it-tr-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

gemma-2-9b-neogenesis-ita-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

gemma-2-baku-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2-baku-2b-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2b-coder-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2b-ko-dev-pbc432-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

gemma-2b-ko-dev-pbmt192-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma-2b-ko-v0-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

gemma-2b-openhermes-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

gemma-3-1b-it-abliterated-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

gemma-7b-openhermes-v0.80-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-en-ko-7b-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-ko-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

gemma-ko-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

gemma-ko-7b-instruct-v0.50-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-ko-7b-instruct-v0.52-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-ko-7b-instruct-v0.71-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-ko-7b-it-v0.41-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-ko-v01-GGUF

01B 8K ctx
Q2_K
0.31GB file 2.33GB

gemma-mling-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gemma-portuguese-luana-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

gemma2-9b-cpt-sea-lionv3-base-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

gemma2-9b-cpt-sea-lionv3-instruct-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Gensyn_Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

german-r1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

germeo-7b-laser-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

gghfez_gemma-3-4b-novision-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

ghost-7b-alpha-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

ghost-7b-v0.9.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

ghost-7b-v0.9.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

ghost-8b-beta-1608-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

ghost-8b-beta-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Gigi-Llama3-8B-Chinese-zh-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

GiKAGraphy_ProductLlama-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

glm-4-9b-hf-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

GNER-LLaMA-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

go-bruins-v2.1-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB

Goekdeniz-Guelmez_Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Goekdeniz-Guelmez_Josiefied-Qwen3-30B-A3B-abliterated-v2-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Goekdeniz-Guelmez_Josiefied-Qwen3-4B-abliterated-v1-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

Goekdeniz-Guelmez_Josiefied-Qwen3-8B-abliterated-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

GoofyLM_N1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

google_gemma-3-1b-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

gpt2_camel_physics-platypus-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

gpt2_guanaco-dolly-platypus-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt2_open-platypus-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

gpt2_platypus-dolly-guanaco-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

gpt2-650k-stable-diffusion-prompt-generator-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt2-conversational-or-qa-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt2-dolly-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt2-therapist-finetuned-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt2-xl_lima-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

gpt2-xl-conversational-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

gpt3_125M_edu_hermes-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

gpt4all-falcon-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

granite-20b-code-base-8k-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB

granite-20b-code-base-r1.1-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB

granite-3.0-1b-a400m-base-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

granite-3.0-1b-a400m-instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

granite-3.0-2b-base-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

granite-3.0-3b-a800m-base-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

granite-3.0-3b-a800m-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3.0-8b-base-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-3.0-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-3.1-1b-a400m-base-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

granite-3.1-1b-a400m-instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

granite-3.1-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

granite-3.1-3b-a800m-base-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3.1-3b-a800m-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

granite-3.2-8b-instruct-preview-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-34b-code-base-8k-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

granite-34b-code-instruct-8k-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

granite-3b-code-base-128k-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3b-code-base-2k-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3b-code-instruct-128k-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-3b-code-instruct-2k-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

granite-7b-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

granite-7b-lab-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

granite-8b-code-base-4k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-8b-code-instruct-128k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-8b-code-instruct-4k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-guardian-3.0-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

granite-guardian-3.0-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

granite-guardian-3.2-3b-a800m-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

granite-guardian-3.2-5b-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q3_K_M
2.19GB file 4.27GB

GritLM-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

GritLM-7B-KTO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

GritLM-8x7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

GritLM-8x7B-KTO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Gromenauer-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Gryphe_Pantheon-Proto-RP-1.8-30B-A3B-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Guanaco-3B-Uncensored-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Guanaco-3B-Uncensored-v2-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

h2o-danube-1.8b-sft-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_M
0.79GB file 2.82GB

h2o-danube3-4b-chat-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

h2o-danube3-500m-base-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

h2o-danube3-500m-chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

h2oai_h2ogpt-gm-oasst1-en-2048-falcon-7b-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

h2ogpt-4096-llama2-13b-chat-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

h2ogpt-4096-llama2-7b-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

haebo_meow-clovax-v3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Half-NSFW_Noromaid-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Hastagaras_Qibil-4B-v0.1-RP-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

hdeldar_llama-2-7b-persian-text-1k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

heegyu_LIMA2-7b-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

HelpingAI-3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

hepu-o4zf-ravz-7-0-GGUF

0B 8K ctx
Q2_K
0GB file 2GB

Heshamproduct_gemma-3-12b-elderly-care-merged-v11-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

hf-ar-134000-GGUF

134000B 8K ctx
Q2_K
41875GB file 44072.46GB

Hf2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

HikariBloom-v0.3-RP-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

HiTZ_GoLLIE-34B-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

hkcode_llama3_8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

hkcode_solar_10.7b-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

hkcode-solar-youtube-merged-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

hongyin_informer-1b-4k-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

HridaAI_Hrida-T2SQL-3B-V0.1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

HuatuoGPT-o1-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

HuatuoGPT-o1-72B-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q3_K_M
31.5GB file 34.68GB

HuatuoGPT-o1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

HuatuoGPT-o1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

huihui-ai_Huihui-Qwen3-1.7B-abliterated-v2-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB

huihui-ai_Huihui-Qwen3-4B-abliterated-v2-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

hyokwan_familidata_gemma7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

hyokwan_llama3-ko-8b-hkcode-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

hyunseoki_ko-ref-llama2-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

I-SOLAR-10.7B-dpo-sft-v1.0-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

iamsahinemir_meta-llama-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

ibm-granite_granite-3.3-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

ibm-research_PowerMoE-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

inclusionAI_AReaL-boba-2-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Indic-gemma-2b-finetuned-sft-Navarasa-2.0-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Indic-gemma-7b-finetuned-sft-Navarasa-2.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

init-gpt2-120M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Instruct_Mixtral-8x7B-v0.1_Dolly15K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

internlm2_5-1_8b-chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

internlm2_5-1_8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

internlm2_5-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB

internlm2_5-7b-chat-1m-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

internlm2_5-7b-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

internlm2_5-step-prover-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

internlm2-1_8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

internlm2-chat-1_8b-sft-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

internlm2-chat-7b-sft-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

internlm2-math-plus-1_8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

internlm2-step-prover-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

itsliupeng_llama2_7b_mmlu-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

jamesdborin_LeoLM-hesseianai-13b-chat-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

janus-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

janus-orpo-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

japanese-stablelm-base-beta-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

japanese-stablelm-base-gamma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Jarvis1111_DoctorAgent-RL-SFT-1k-Thinking-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

jaskier-7b-dpo-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

jin05102518_Astral-7B-Instruct-v0.01-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-float32-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

judge-eus-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

JungZoona_T3Q-qwen2.5-14b-v1.0-e3-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Juniplayground_Mist_LLaMA-2-7B-1024_V3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

kakaocorp_kanana-1.5-15.7b-a3b-instruct-GGUF

15.7B 8K ctx
Q2_K
4.91GB file 7.17GB
Q3_K_M
6.87GB file 9.13GB

kakaocorp_kanana-1.5-2.1b-instruct-2505-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB
Q3_K_M
0.92GB file 2.95GB

kakaocorp_kanana-1.5-8b-instruct-2505-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

kakaocorp_kanana-safeguard-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

kakaocorp_kanana-safeguard-prompt-2.1b-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB
Q3_K_M
0.92GB file 2.95GB

kakaocorp_kanana-safeguard-siren-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

kanana-nano-2.1b-base-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB

katanemo_Arch-Router-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

knoveleng_Open-RS3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

ko-en-llama2-13b-finetune-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

ko-en-llama2-13b-mixed-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

ko-en-llama2-13b-mixed-v3-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

ko-gemma-2-9b-it-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

ko-Llama-3-8B-Instruct-sft-v1.0-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

ko-Llama-3-8B-sft-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

ko-llama2-finetune-ex4-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

ko-llama2-finetune-ex5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB

Ko-Llama3-Luxia-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Ko-PlatYi-6B-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Ko-PlatYi-6B-gu-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Ko-PlatYi-6B-kiwi-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_M
2.63GB file 4.73GB

ko-platypus-kiwi-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

ko-ref-llama2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

ko-wand-136M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

KoboldAI_Mistral-7B-Holodeck-1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Komodo-Llama-3.2-3B-v2-fp16-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

KONI-Llama3-8B-20240630-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

KONI-Llama3-8B-Instruct-20240729-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

KONI-Llama3.1-8B-Instruct-20241024-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

koquality-ko-ref-llama2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

KoR-Orca-Platypus-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

KOR-Orca-Platypus-13B-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Korean-OpenOrca-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Korean-OpenOrca-v3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

KoSOLAR-10.7B_DPO_Adapter_Attach-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

KoSOLAR-Platypus-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

KoSOLAR-v0.2-gugutypus-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

KoT-platypus2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

KurmaAI_AQUA-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

kyujinpy_Ko-PlatYi-6B-O-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

kyujinpy_Kosy-Platypus2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

kyujinpy_Kosy-platypus2-13B-v3-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

kyujinpy_Kosy-platypus2-13B-v4-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

kyujinpy_KoT-platypus2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

kyutai_helium-1-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

L3-Super-Nova-RP-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

L3-Umbral-Mind-RP-v0.3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Lamarck-14B-v0.6-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

latxa-7b-v1.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

latxa-7b-v1.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

law-chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

LDCC_LoRA_full-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

LDCC-SOLAR-gugutypus-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

legendary-river-koalpaca-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

lemon-mint_gemma-2b-translation-v0.90-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

lgaalves_gpt-2-xl_camel-ai-physics-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

lgaalves_llama-2-7b-hf_open-platypus-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

lgaalves_mistral-7b_open_platypus-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Light-R1-32B-DS-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Light-R1-7B-DS-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Linkbricks-Horizon-AI-Korean-Pro-12B-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

Lix-14B-v0.1-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Llama-160M-Chat-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

llama-160m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Llama-2-13b-chat-dutch-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Llama-2-13b-chat-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

llama-2-13b-chat-platypus-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Llama-2-13b-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

llama-2-13b-instruct-Y24-v1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

llama-2-13b-instruct-Y24-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

LLAMA-2-13b-ko-Y24_v2.0-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

LLAMA-2-13b-ko-Y24-DPO_v0.1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

LLAMA-2-13b-ko-Y24-DPO_v2.0-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

LLAMA-2-13b-ko-Y24-DPO_v2.1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

LLAMA-2-13b-koen-Y24_v1.0-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

llama-2-7b-Arabic-medical-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7B-Chat-fp16-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-chat-hf-30-sparsity-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-chat-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-gsm8k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-pruned50-retrained-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-7b-ultrachat200k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

llama-2-ko-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-2-ko-DPO-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Llama-2-ko-OpenOrca-gugugo-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Llama-3_1-Nemotron-51B-Instruct-GGUF

51B 8K ctx
Q2_K
15.94GB file 18.78GB
Q3_K_M
22.31GB file 25.15GB

Llama-3-13B-Instruct-v0.1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Llama-3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3-70B-Instruct-32k-v0.1-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3-70B-Instruct-Gradient-1048k-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

llama-3-8b-chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-dutch-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama-3-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama-3-8b-instruct-262k-chinese-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-8B-Instruct-DPO-v0.3-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Instruct-Finance-RAG-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

LLaMA-3-8B-Instruct-TR-DPO-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Instruct-v0.10-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Instruct-v0.4-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Instruct-v0.9-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-8B-Jonathan-aLLM-Instruct-v1.0-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

llama-3-debug-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Groq-8B-Tool-Use-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-Instruct-8B-SPPO-Iter1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-Instruct-8B-SPPO-Iter2-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-Instruct-8B-SPPO-Iter3-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Ko-8B-Instruct-AOG-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Ko-8B-OpenOrca-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-KoEn-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-KoEn-8B-Instruct-preview-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama-3-Nephilim-v3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Patronus-Lynx-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-Patronus-Lynx-8B-Instruct-v1.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama-3-sqlcoder-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Swallow-8B-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Taiwan-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3-Taiwan-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3-Trendyol-LLM-8b-chat-v2.0-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama-3-typhoon-v1.5x-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

Llama-3.1-70B-Japanese-Instruct-2407-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3.1-8B-bonito-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-8B-EZO-1.1-it-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-8B-Instruct-abliterated_via_adapter-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-8B-Instruct-Mental-Health-Classification-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-8B-MultiReflection-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-8B-R1-experimental-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-MedIT-SUN-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-Nemotron-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3.1-Nemotron-70B-Instruct-HF-bf16-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

Llama-3.1-Nemotron-Nano-8B-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-SuperSwallow-70B-Instruct-v0.1-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3.1-Swallow-8B-Instruct-v0.3-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-3.1-Swallow-8B-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-Swallow-8B-v0.2-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-Tulu-3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama-3.1-Tulu-3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-Tulu-3-8B-SFT-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.1-Tulu-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3.2-1B_synaptron-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Llama-3.2-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama-3.2-1B-Instruct-Frog-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

llama-3.2-1B-spinquant-hf-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama-3.2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Llama-3.2-3B-Overthinker-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Llama-3.2-Rabbit-Ko-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama-3.2-Rabbit-Ko-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Llama-3.2-SUN-2.5B-chat-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB
Q3_K_M
1.09GB file 3.13GB

Llama-68M-Chat-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

llama-7b-finnish-instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llama-8B-Distill-CoT-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-DNA-1.0-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-eus-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-Guard-3-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama-Guard-3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

LLaMA-Mesh-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Llama-OpenReviewer-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-PLLuM-8B-chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama-Primus-Merged-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Llama-Song-Stream-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

llama2_tifa_question_generation-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

llama2-13b.kor.v1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

llama2-13b.kor.v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

llama2-megamerge-dare-13b-v2-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Llama3_ko_4.2_sft-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Llama3-1B-Base-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama3-2B-Base-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Llama3-70B-Chinese-Chat-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama3-70B-Fireplace-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

Llama3-70B-ShiningValiant2-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama3-8B-Chinese-Chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama3-beomi-Open-Ko-8B-Instruct-preview-test6-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama3-ChatQA-1.5-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Llama3-ChatQA-1.5-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama3-ChatQA-2-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

llama3-instruct-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

llama3-instrucTrans-enko-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llama3-koen-sft-dpo-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Llama3-Med42-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

Llama3-Med42-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Llama3-TenyxChat-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

llama3.1_korean_v0.1_sft_by_aidx-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

llama3.1-8b-cpt-sea-lionv3-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama3.1-8B-ShiningValiant2-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

llama3.2-1b-Uncensored-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

llama3.2-typhoon2-1b-instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

llama3.2-typhoon2-3b-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

llama3.2-typhoon2-t1-3b-research-preview-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Llama3.3-70B-CogniLink-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

LLaMAntino-3-ANITA-8B-Inst-DPO-ITA-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

llamav2-LoRaco-7b-merged-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Llammas-base-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Llammas-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

llm-agents_tora-code-7b-v1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

LLM360_guru-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

LLM360_K2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

lmstudio-community_Qwen3-0.6B-MLX-bf16-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB

Locutusque_gpt2-large-conversational-retrain-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

LocutusqueXFelladrin-TinyMistral248M-Instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Lucie-7B-Instruct-v1.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

luel_gemma-3-4b-tigrinya-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

Lukamac_PlayPart-AI-Personal-Trainer-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Luminis-phi-4-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

LumiOpen_Llama-Poro-2-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

lunar-llm-tiny-llama-3epoch-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

lxcorp_lambda-1v-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

macbert4mdcspell_v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Macropodus_macbert4csc_v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

Magicoder-DS-6.7B-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB

Magicoder-S-DS-6.7B-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB

magnum-v2-12b-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

magnum-v2.5-12b-kto-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

magnum-v3-27b-kto-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

magnum-v4-12b-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

magnum-v4-22b-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q3_K_M
9.63GB file 11.99GB

magnum-v4-27b-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

magnum-v4-9b-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

MalayaLLM_7B_Instruct_v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

maldv_winter-garden-7b-alpha-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

manticore-13b-chat-pyg-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Marco-LLM-AR-V2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

marin-community_marin-8b-base-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

marin-community_marin-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

markrodrigo_Llama-3.1-8B-Instruct-Spatial-SQL-1.0-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

MARS-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Marx-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

MasterControlAIML_Qwen2.5-7B-Instruct-131K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

math_gpt2_sft-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

MathLLMs_MathCoder-L-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Maylin-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

maywell_Synatra-11B-Testbench-2-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

maywell_Synatra-7B-v0.3-base-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

MBZUAI-Paris_Atlas-Chat-2B-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

MBZUAI-Paris_Atlas-Chat-9B-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

MBZUAI-Paris_Nile-Chat-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

mCoT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

MD-Judge-v0_2-internlm2_7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Med_GPT2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Megatron-Opus-14B-2.1-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Meltemi-7B-Instruct-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Meltemi-7B-Instruct-v1.5-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Mengzi3-8B-Chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Menlo_Jan-nano-128k-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Menlo_Jan-nano-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Menlo_Lucy-128k-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Menlo_Lucy-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Mental-Health-FineTuned-Mistral-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Meraj-Mini-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

merlinite-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

merlinite-7b-lab-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

Meta-Llama-3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Meta-Llama-3-8B-hf-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Meta-Llama-3-8B-Instruct-hf-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Meta-Llama-3.1-70B-Instruct-bf16-CORRECTED-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

Meta-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Meta-Llama-3.2-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Meta-Llama-Guard-2-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

metharme-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

MFANN-llama3.1-abliterated-SLERP-v3.1-GGUF

3.1B 8K ctx
Q2_K
0.97GB file 3.02GB

Mia-001-GGUF

001B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

MIAOAI_qa-retailpro-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

microsoft_Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

migtissera_Synthia-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mims-harvard_TxAgent-T1-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Mini_DPO_test02-GGUF

02B 8K ctx
Q2_K
0.63GB file 2.66GB

Mini_Synatra_SFT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

MiniCPM-2B-128k-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

MiniCPM3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

MiniLlama-1.8b-Chat-v0.1-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_M
0.79GB file 2.82GB

MiniLLM-gpt2-120M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

MiniMaxAI_SynLogic-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

MiniMerlin-3b-v0.1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

MiniPLM-Qwen-200M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Ministral-3b-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Misted-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mistral-11b-128k-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

mistral-7B-forest-dpo-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7B-Instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Mistral-7B-Instruct-v0.2-Ko-S-Core-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7b-ITmodel-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7b-ko-Y24_v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7b-ko-Y24-DPO_v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7B-ProXMath-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

mistral-7b-uncensored-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Mistral-7B-v0.1-colab-sharded-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mistral-7b-wiki-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-instruct-DPO-Y24-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

Mistral-instruct-Y24-DPO-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Mistral-instruct-Y24-v5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB

Mistral-instruct-Y24-v6-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

mistral-ko-7b-tech-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-ko-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mistral-ko-7b-wiki-neft-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mistral-ko-exo-mrc-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

mistral-ko-exo-wiki-quiz-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

mistral-ko-OpenOrca-2000-GGUF

2000B 8K ctx
Q2_K
625GB file 659.77GB

mistral-ko-OpenOrca-Platypus-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

mistral-ko-OpenOrca-wiki-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

mistral-ko-tech-science-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Mistral-Nemo-12B-R1-v0.1-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

Mistral-Nemo-Japanese-Instruct-2408-GGUF

2408B 8K ctx
Q2_K
752.5GB file 793.95GB

Mistral-NeMo-Minitron-8B-Chat-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

mistral-orpo-capybara-7k-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

mistral-small-3.1-24b-instruct-2503-hf-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB

Mistral-Small-Instruct-2409-abliterated-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Mistral7B-PairRM-SPPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral7B-PairRM-SPPO-Iter1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral7B-PairRM-SPPO-Iter2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Mistral7B-PairRM-SPPO-Iter3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

MistralTrix-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Mixtral_AI_Cyber_2.0-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB

mixtral-megamerge-dare-8x7b-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mlabonne_Qwen3-4B-abliterated-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

mlabonne_Qwen3-8B-abliterated-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

mlx-community_DeepSeek-R1-0528-Qwen3-8B-bf16-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

mlx-community_Llama-3.2-1B-Instruct-bf16-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

mlx-community_Magistral-Small-2506-bf16-GGUF

16B 8K ctx
Q2_K
5GB file 7.26GB
Q3_K_M
7GB file 9.26GB

mlx-community_Mistral-Small-3.2-24B-Instruct-2506-bf16-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB

mlx-community_Qwen3-0.6B-bf16-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB

mlx-community_Qwen3-1.7B-bf16-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB

mlx-community_Qwen3-4B-bf16-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

mlx-community_Qwen3-8B-bf16-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

mncai_Mistral-7B-CollectiveCognition-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mncai_Mistral-7B-v0.1-orca_platy-1k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mncai_Mistral-7B-v0.1-orca-1k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mncai_Mistral-7B-v0.1-platy-1k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

MNCJ1hun_Mistral-7B-OP-u1k-ver0.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Monsoon-7B-exp-1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

mookiezi_Discord-Micae-Hermes-3-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Mozaic-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mrfakename_mistral-small-3.1-24b-base-2503-hf-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB

mrm8488_limstral-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

mt0-xxl-mt-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Multiverse4FM_Autogressive-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Multiverse4FM_Multiverse-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

muzammil-eds_tinyllama-2.5T-Clinical-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

mwitiderrick_open_llama_3b_code_instruct_0.1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

mythalion-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Nanbeige2-16B-Chat-GGUF

16B 8K ctx
Q2_K
5GB file 7.26GB

nano-phi-115M-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB

naver-hyperclovax_HyperCLOVAX-SEED-Text-Instruct-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

nayohan_llama3-8b-it-translation-sharegpt-en-ko-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

neural-chat-7b-v3-1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

neural-coder_finetuned-4-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

neural-coder_finetuned-5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q3_K_M
2.19GB file 4.27GB

neural-coder_gorilla-finetuned-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

neural-coder_xlam-finetuned-1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

neural-coder_xlam-finetuned-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

NeuralTurdusVariant1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

new1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

new3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

ngoan_Llama-2-7b-vietnamese-20k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

notadib_Mistral-7B-Instruct-v0.2-attention-sparsity-30-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

notus-7b-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

NuExtract-1.5-smol-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

NuExtract-1.5-tiny-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

NuExtract-tiny-v1.5-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

NuminaMath-7B-TIR-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Nusantara-0.8b-Indo-Chat-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_M
0.35GB file 2.36GB

nvidia_AceMath-RL-Nemotron-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

nvidia_AceReason-Nemotron-1.1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

nvidia_AceReason-Nemotron-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

nvidia_AceReason-Nemotron-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

nvidia_Llama-3.1-Minitron-4B-Depth-Base-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

nvidia_Minitron-4B-Base-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

nvidia_Minitron-8B-Base-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

nvidia_Nemotron-Mini-4B-Instruct-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

nvidia_OpenCodeReasoning-Nemotron-1.1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

nvidia_OpenReasoning-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

nvidia_OpenReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

nvidia_OpenReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

nvidia_OpenReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Nxcode-CQ-7B-orpo-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Obrolin_Kesehatan-7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

occiglot_occiglot-7b-de-en-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

occiglot-7b-de-en-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

occiglot-7b-es-en-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

occiglot-7b-es-en-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

occiglot-7b-fr-en-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

occiglot-7b-it-en-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

OCRonos-Vintage-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

OLMo-2-0325-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

OlympicCoder-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OmegLLaMA-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

ONS-SOLAR-10.7B-v1.2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

Oolel-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_K_M
0.04GB file 2.04GB

OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

open-llama-2-ko-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

open-llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Open-Orca_Mistral-7B-OpenOrca-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Open-Orca_Mistral-7B-SlimOrca-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OPEN-SOLAR-KO-10.7B-dpo-dedup-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

OPEN-SOLAR-KO-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

OPEN-SOLAR-KO-10.7B-mixed-v15-dedup-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

OPEN-SOLAR-KO-10.7B-mixed-v15-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

OPEN-SOLAR-KO-10.7B-S-Core-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

open-thoughts_OpenThinker3-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

openbmb_BitCPM4-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB

openbmb_MiniCPM4-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

openbmb_MiniCPM4-MCP-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

OpenBuddy_openbuddy-llama3.1-8b-v22.1-131k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

OpenBuddy_openbuddy-llemma-34b-v13.2-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

OpenBuddy_openbuddy-mistral-7b-v13-base-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OpenBuddy_openbuddy-openllama-7b-v12-bf16-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OpenBuddy_OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview0-QAT-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

openbuddy-deepseek-10b-v17.1-4k-GGUF

10B 8K ctx
Q2_K
3.13GB file 5.29GB
Q3_K_M
4.38GB file 6.54GB

openbuddy-deepseek-67b-v15.2-GGUF

67B 8K ctx
Q2_K
20.94GB file 24.04GB

openbuddy-llama3-70b-v21.2-32k-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

openbuddy-llama3-8b-v21.1-8k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

openbuddy-llama3.1-8b-v22.3-131k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

openbuddy-mistral-22b-v21.1-32k-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB

openbuddy-mistral-7b-v17.1-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mistral2-7b-v20.3-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mixtral-7bx8-v16.3-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mixtral-7bx8-v18.1-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mixtral-8x7b-v15.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mixtral-8x7b-v16.1-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-mixtral-8x7b-v16.2-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openbuddy-qwen1.5-14b-v21.1-32k-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

openbuddy-qwen1.5-32b-v21.1-32k-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

openbuddy-qwen1.5-32b-v21.2-32k-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

openbuddy-qwen2.5llamaify-14b-v23.1-200k-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

openbuddy-qwen2.5llamaify-7b-v23.1-200k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openchat_3.5-GGUF

3.5B 8K ctx
Q2_K
1.09GB file 3.15GB
Q3_K_M
1.53GB file 3.59GB

openchat-3.5-0106-GGUF

0106B 8K ctx
Q2_K
33.13GB file 36.87GB

openchat-3.5-1210-GGUF

1210B 8K ctx
Q2_K
378.13GB file 399.95GB

openchat-3.6-8b-20240522-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

OpenCodeInterpreter-DS-1.3B-GGUF

1.3B 8K ctx
Q2_K
0.41GB file 2.43GB

OpenCodeInterpreter-DS-33B-GGUF

33B 8K ctx
Q2_K
10.31GB file 12.85GB
Q3_K_M
14.44GB file 16.98GB

OpenCodeInterpreter-DS-6.7B-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB

OpenCoder-1.5B-Base-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

OpenCoder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

OpenCoder-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

opencsg-starcoder2-15b-v0.1-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB

OpenDolphinHermes_Llama2_7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

openinstruct-mistral-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

OpenLLM-France_Claire-Mistral-7B-0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OpenLLM-France_Lucie-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

OpenPipe_Deductive-Reasoning-Qwen-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

openthaigpt-1.0.0-beta-13b-chat-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

OpenThaiLLM-Prebuilt-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

OPI-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

optimum-internal-testing_tiny-random-internlm2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Optimus-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

orca_mini_3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Orca-2-13b-f16-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

OREAL-DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Orion-14B-Base-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Orion-14B-Chat-Plugin-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Orion-14B-Chat-RAG-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Orion-14B-Chat-RAG-safetensors-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

oscar128372_Qwen2.5-CoderX-7B-v0.5-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

ostorc_Conversational_Spanish_GPT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

oxy-1-small-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

p208p2002_llama-chinese-81M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

p208p2002_llama-traditional-chinese-120M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

palmer-002-GGUF

002B 8K ctx
Q2_K
0.63GB file 2.66GB

Paraphrase-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

pfnet_plamo-13b-instruct-nc-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

phi-1_5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q3_K_M
2.19GB file 4.27GB

phi-2-4bit-64rank-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

phi-2-audio-super-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

phi-2-pytdml-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

phi-2-super-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Phi-3-medium-128k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3-medium-4k-instruct-abliterated-v3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Phi-3-medium-4k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3-mini-128k-instruct-abliterated-v3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Phi-3-mini-128k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3-mini-4k-instruct-dequantized-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

Phi-3-mini-4k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3-mini-4k-instruct-LLaMAfied-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

phi-3-tiny-random-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3.5-mini-ITA-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_M
1.66GB file 3.72GB

Phi-3.5-MoE-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

phi-4-deepseek-R1K-RL-EZO-GGUF

671B 8K ctx
Q2_K
209.69GB file 222.68GB

phi-4-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

Phi-4-mini-instruct-abliterated-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

PhysicsWallahAI_Aryabhata-1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Pinkstack_Base-Roblox-coder-Llama-3.2-3B-vLLM-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

PiVoT-0.1-early-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

PiVoT-0.1-Evil-a-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

PiVoT-10.7B-Mistral-v0.2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

PiVoT-10.7B-Mistral-v0.2-RP-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

PiVoT-SOLAR-10.7B-RP-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

PKU-DS-LAB_FairyR1-14B-Preview-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

plamo-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

plamo-13b-instruct-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

PlatYi-34B-200k-Q-FastChat-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PlatYi-34B-200K-Q-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PlatYi-34B-Llama-Q-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PlatYi-34B-Llama-Q-v2-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PlatYi-34B-Llama-Q-v3-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

PlatYi-34B-LoRA-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PlatYi-34B-Q-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

PLLuM-12B-chat-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

PocketDoc_Dans-PersonalityEngine-V1.3.0-12b-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

POLAR-14B-DPO-v1.3-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

POLAR-14B-DPO-v1.4-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

POLAR-14B-HES-DPO-v1.5-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

POLAR-14B-SON-SFT-v0.1-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

polka-1.1b-chat-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB

polka-1.1b-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB

PowerLM-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

PowerMoE-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

PracticeLLM_Custom-KoLLM-13B-v5-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

prem-1B-SQL-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

Pretrain-Qwen-200M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

prithivMLmods_Bootes-Qwen3_Coder-Reasoning-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

prithivMLmods_Evac-Opus-14B-Exp-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

prithivMLmods_Ophiuchi-Qwen3-14B-Instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Proctora-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

prometheus-7b-v2.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

prometheus-8x7b-v2.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Psychotherapy-LLM_PsychoCounsel-Llama3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Puma-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

pygmalion-2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

pygmalion-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

pythia-1.4b-deduped-sharegpt-GGUF

1.4B 8K ctx
Q2_K
0.44GB file 2.46GB

Pythia-31M-Chat-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

pythia-31m-goodwiki-deduped-2048-scratch-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

pythia-31m-simplepile-lite-2048-scratch-2e-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

pythia-31m-simplewiki-2048-GGUF

2048B 8K ctx
Q2_K
640GB file 675.55GB

quantum-dpo-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB

quantum-v0.01-GGUF

0.01B 8K ctx
Q2_K
0GB file 2GB

Quble_Test_Model_v1_Pretrain-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Quyen-Pro-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB

Quyen-SE-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB

Qwen_Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB

Qwen_Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB

Qwen_Qwen3-1.7B-MLX-bf16-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB

Qwen_Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen_Qwen3-30B-A3B-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Qwen_Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Qwen_Qwen3-30B-A3B-Thinking-2507-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Qwen_Qwen3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

Qwen_Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Qwen_Qwen3-8B-MLX-bf16-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Qwen_Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

Qwen1.5-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen1.5-0.5B-h-world-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB

Qwen1.5-0.5B-vortex-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen1.5-1.8B-Chat-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_M
0.79GB file 2.82GB

Qwen1.5-1.8B-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_M
0.79GB file 2.82GB

Qwen1.5-14B-Chat-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen1.5-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen1.5-32B-Chat-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen1.5-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen1.5-4B-Chat-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

Qwen1.5-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB

Qwen1.5-7B-Chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen1.5-7B-Dutch-Chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen1.5-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen1.5-MoE-A2.7B-Chat-GGUF

2.7B 8K ctx
Q2_K
0.84GB file 2.88GB
Q3_K_M
1.18GB file 3.22GB

Qwen1.5-MoE-A2.7B-GGUF

2.7B 8K ctx
Q2_K
0.84GB file 2.88GB
Q3_K_M
1.18GB file 3.22GB

Qwen2-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB

Qwen2-57B-A14B-GGUF

57B 8K ctx
Q2_K
17.81GB file 20.74GB

Qwen2-57B-A14B-Instruct-GGUF

57B 8K ctx
Q2_K
17.81GB file 20.74GB
Q3_K_M
24.94GB file 27.87GB

Qwen2-Math-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

Qwen2-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Qwen2-Math-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen2.5-0.5B-Instruct-ITA-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Qwen2.5-1.5B-Instruct-w8a8-int-dynamic-weight-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

Qwen2.5-14B-Instruct-1M-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-14B-MegaMerge-pt2-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-Vimarckoso-v3-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-14B-Wernicke-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

Qwen2.5-32B-Instruct-abliterated-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-32B-Instruct-CFT-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen2.5-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-3B-Instruct-abliterated-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Qwen2.5-72B-Instruct-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q3_K_M
31.5GB file 34.68GB

Qwen2.5-7B-Instruct-131K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen2.5-7B-Instruct-1M-abliterated-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-1M-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-abliterated-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-abliterated-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-Instruct-Uncensored-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-7B-nerd-uncensored-v1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

qwen2.5-bakeneko-32b-instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

Qwen2.5-Coder-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB

Qwen2.5-Coder-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Qwen2.5-Coder-14B-Instruct-abliterated-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-Coder-14B-Instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-Coder-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-Coder-32B-Instruct-bf16-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-Coder-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Qwen2.5-Coder-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Qwen2.5-Lumen-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Qwen2.5-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Qwen2.5-Math-72B-Instruct-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q3_K_M
31.5GB file 34.68GB

qwen25-math-7b-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

QwQ-32B-bf16-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

QwQ-32B-Coder-Fusion-9010-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

QwQ-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

QwQ-32B-Preview-abliterated-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

qwq-bakeneko-32b-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

QwQ-Math-IO-500M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

raicrits_Hermes7b_ITA-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

rank1-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

reader-lm-1.5b-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

ReadyArt_Broken-Tutu-24B-Unslop-v2.0-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB

ReadyArt_The-Omega-Directive-Qwen3-14B-v1.1-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

Reasoning-SmolLM2-135M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

RedHatAI_granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

RedHatAI_Llama-2-7b-gsm8k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

RedHatAI_Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

redpajama-3b-chat-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

RedPajama-INCITE-Chat-Instruct-3B-V1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

Refact-1_6B-fim-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_M
2.63GB file 4.73GB

Reflection-Llama-3.1-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

rhaymison_Mistral-portuguese-luana-7b-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

rho-math-1b-v0.1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

rho-math-7b-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Rijgersberg_GEITje-7B-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

RoadQAQ_Qwen2.5-Math-1.5B-16k-think-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

robinsyihab_Sidrap-7B-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

RoguePlanet-DeepSeek-R1-Qwen-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

s1-0.5B-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB

Sadou_medgemma-4b-it-french-medical-assistant-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

sail_Sailor2-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Sailor2-20B-Chat-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB

SakanaAI_Llama-3-8B-Instruct-Coding-Expert-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

SakanaAI_TAID-LLM-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

Sakura-SOLAR-Instruct-DPO-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Sakura-SOLAR-Instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Sakura-SOLRCA-Math-Instruct-DPO-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Sakura-SOLRCA-Math-Instruct-DPO-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

salamandra-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

salamandra-7b-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Salesforce_Llama-xLAM-2-8b-fc-r-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Samantha2.0-Phi-3.5-mini-ITA-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

Samantha2.0-Phi3-Medium-ita-16bit-GGUF

16B 8K ctx
Q2_K
5GB file 7.26GB
Q3_K_M
7GB file 9.26GB

Samantha2.0-Phi4-ita-16bit-GGUF

16B 8K ctx
Q2_K
5GB file 7.26GB
Q3_K_M
7GB file 9.26GB

Samantha2.0-Qwen2.5-14B-ita-v2-16bit-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

sarashina2.2-1b-instruct-v0.1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

sarashina2.2-3b-instruct-v0.1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Saxo_Linkbricks-Horizon-AI-Korean-Pro-27B-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB

Saxo_Linkbricks-Horizon-AI-Korean-Superb-22B-GGUF

22B 8K ctx
Q2_K
6.88GB file 9.24GB
Q3_K_M
9.63GB file 11.99GB

scb10x_llama3.1-typhoon2-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

scb10x_typhoon2.1-gemma3-12b-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB

Secbone_llama-2-13B-instructed-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Selene-1-Mini-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

semcoder_1030-GGUF

1030B 8K ctx
Q2_K
321.88GB file 340.76GB

semcoder_s_1030-GGUF

1030B 8K ctx
Q2_K
321.88GB file 340.76GB

SEOKDONG_llama3.1_korean_v1.1_sft_by_aidx-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Serpens-Opus-14B-Exp-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

ServiceNow-AI_Apriel-Nemotron-15b-Thinker-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB

Severian_ANIMA-Phi-Neptune-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

sft-solar-10.7b-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

sft-solar-10.7b-v1.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

shallow6414_sn11-3-5-1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

shariar076_Llama-3.1-8B-Instruct-DPO-0R100L-PoliTune-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Shi-Ci_v3-Robin-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

shieldgemma-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

shieldgemma-9b-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

shivneri-marathi-llm-7b-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

shuttleai_shuttle-3.5-GGUF

3.5B 8K ctx
Q2_K
1.09GB file 3.15GB

Silicon-Medley-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

SILMA-9B-Instruct-v1.0-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

SILMA-Kashif-2B-Instruct-v1.0-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Sina-Loki-7b-Merge-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Sina-Odin-7b-Merge-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Sina-Thor-7b-Merge-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Sirius27_BeingWell_llama2_7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

SkkuDataScience-DPO-v2-440-ckpt-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

SkkuDataScience-DPO-v2-90-ckpt-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Skywork_Skywork-SWE-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Skywork-Critic-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

SlimMelodicMaid-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

smallcloudai_Refact-1_6-base-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

smalllocal-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

smallstepai_Misal-7B-instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

smol_bruin-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

smol_llama-81M-tied-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Smol-Llama-101M-Chat-v1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

SmolLM-prompt-generator-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB

SmolLM2-360M-Instruct-FT-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Snorkel-Mistral-PairRM-DPO-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

SOLAR-10.7B-dpo-v0.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-10.7B-dpo-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-10.7B-Instruct-Forest-DPO-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-10.7B-Instruct-STOCK_SOLAR-passthrough-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-10.7b-ko-Y24_v0.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-10.7b-ko-Y24_v1.0-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-10.7B-v1.1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-10.7B-v1.2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-10.7B-v1.3-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-10.7B-v1.5-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

Solar-Ko-Recovery-11B-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q3_K_M
4.81GB file 6.99GB

Solar-Ko-Recovery-11B-sft-v2-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

SOLAR-KOEN-10.8B-GGUF

10.8B 8K ctx
Q2_K
3.38GB file 5.56GB

solar-megamerge-dare-10.7b-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-Platypus-10.7B-v1-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-Platypus-10.7B-v2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLAR-tail-10.7B-instruct-v1.0-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLAR-tail-10.7B-Merge-v1.0-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB

SOLARC-M-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLARC-MOE-10.7Bx4-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

SOLARC-MOE-10.7Bx6-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

Sombrero-QwQ-32B-Elite11-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB

SON_Mistral-7B-QLoRA-Peft-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

soob3123_amoral-gemma3-12B-v2-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB

soob3123_amoral-qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

soob3123_GrayLine-Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

soob3123_GrayLine-Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Sparse-Llama-3.1-8B-2of4-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

speechless-code-mistral-7b-v1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

speechless-codellama-34b-v1.9-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

speechless-coding-7b-16k-tora-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

speechless-llama2-hermes-orca-platypus-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

speechless-llama2-hermes-orca-platypus-wizardlm-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

speechless-mistral-dolphin-orca-platypus-samantha-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

speechlessai_speechless-codellama-dolphin-orca-platypus-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

speechlessai_speechless-llama2-dolphin-orca-platypus-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

sqlcoder-34b-alpha-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

sqlcoder-70b-alpha-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB

stabilityai_japanese-stablelm-3b-4e1t-base-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

stabilityai_japanese-stablelm-3b-4e1t-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

stabilityai_StableBeluga1-Delta-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

StableBeluga-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

starcoder2-15b-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB

starcoder2-15b-instruct-v0.1-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB

starcoder2-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

starcoder2-3b-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

starcoder2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

starcoder2-7b-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

starcoder2-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

starmpcc_Asclepius-Llama2-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

starmpcc_Asclepius-Llama3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

SumayyaAli_tiny-llama-1.1b-chat-medical-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

summerstars_SolaraV2-coder-0511-GGUF

0511B 8K ctx
Q2_K
159.69GB file 170.06GB

sunblaze-ucb_Qwen2.5-3B-Intuitor-MATH-1EPOCH-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

SuperNeuralDreadDevil-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Swallow-13b-NVE-hf-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

Swallow-7b-instruct-hf-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Swallow-MS-7b-instruct-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

SWE-bench_SWE-agent-LM-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

SWE-Fixer-Retriever-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Synatra_TbST02M_IN01-GGUF

01B 8K ctx
Q2_K
0.31GB file 2.33GB

Synatra-11B-Tb2M_SM-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

Synatra-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Synatra-Yi-Ko-6B-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

SynthIA-7B-v1.3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

T.E-8.1-GGUF

8.1B 8K ctx
Q2_K
2.53GB file 4.66GB

T3Q-ko-solar-dpo-v3.0-GGUF

3.0B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

T3Q-ko-solar-dpo-v5.0-GGUF

5.0B 8K ctx
Q2_K
1.56GB file 3.64GB

T3Q-ko-solar-dpo-v6.0-GGUF

6.0B 8K ctx
Q2_K
1.88GB file 3.98GB

T3Q-ko-solar-sft-v1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

T3Q-ko-solar-sft-v2.0-GGUF

2.0B 8K ctx
Q2_K
0.63GB file 2.66GB

T3Q-ko-solar-sft-v3.0-GGUF

3.0B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

T3Q-LLM-sft1.0-dpo1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

T3Q-LLM-solar10.8-sft-v1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

T5_Paraphrase_Paws-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

TachyHealth_Gazal-R1-32B-sft-merged-preview-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Tadpole-Opus-14B-Exp-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

tarun7r_Finance-Llama-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

TeenyTinyLlama-160m-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

TeenyTinyLlama-460m-Chat-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Terminis-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

test-pb-v0-GGUF

0B 8K ctx
Q2_K
0GB file 2GB

testllm-c2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

Teuken-7B-instruct-commercial-v0.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Teuken-7B-instruct-research-v0.4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

text-2-sql-Llama-3.2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

TheCarBun_GPT-2-fine-tuned-mental-health-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

Theia-Llama-3.1-8B-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Thespis-Llama-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

THU-KEG_LongWriter-Zero-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

timpal0l_Mistral-7B-v0.1-flashback-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

tiny_starcoder_py-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

tiny-llama-miniguanaco-1.5T-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

TinyLlama-1.1B-32k-Instruct-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB

tinyllama-1.1b-chat-v0.3_platypus-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-1epch-airoboros3.1-1k-instruct-V1-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-2.2epochs-oasst1-top1-instruct-V1-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-3epochs-oasst1-top1-instruct-V1-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

tinyllama-15M-alpaca-finetuned-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

TinyLLama-4x1.1B-MoE-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB

tinyllama-oasst1-top1-instruct-full-lr1-5-v0.1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

TinyMistral-248M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

TinyMistral-248M-v2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB

Tinypus-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

TinySwallow-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

TinySwallow-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Tippy-Toppy-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

titulm-llama-3.2-3b-v1.1-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

tokyotech-llm_Llama-3.1-Swallow-8B-Instruct-v0.5-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Tongyi-Zhiwen_QwenLong-L1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB

Topxtral-4x7B-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

ToRoLaMa-7b-v1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

trendmicro-ailab_Llama-Primus-Reasoning-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Trendyol_Trendyol-LLM-8B-T1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Trendyol-LLM-7b-chat-v0.1-DPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Tsunami-0.5x-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Tucano-1b1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Tucano-1b1-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

Tucano-2b4-Instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB

Turkish-Llama-8b-Instruct-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Turkish-Llama-8b-v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

Twice-KoSOLAR-16.1B-test-GGUF

16.1B 8K ctx
Q2_K
5.03GB file 7.29GB
Q3_K_M
7.04GB file 9.3GB

typhoon-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

typhoon-7b-instruct-02-19-2024-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

typhoon2-qwen2vl-7b-vision-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Uncensored_llama_3.2_3b_safetensors-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB

UnfilteredAI_DAN-Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB

Unichat-llama3-Chinese-8B-28K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Unichat-llama3-Chinese-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

unsloth_Jan-nano-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

unsloth_Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB

unsloth_Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

unsloth_Phi-4-reasoning-plus-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB

unsloth_Qwen3-0.6B-Base-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB

unsloth_Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

upstage_llama-30b-instruct-2048-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB

urllm-ko_en-2.7b-GGUF

2.7B 8K ctx
Q2_K
0.84GB file 2.88GB

urllm-ko-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

uukuguy_speechless-code-mistral-orca-7b-v1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

uukuguy_speechless-codellama-dolphin-orca-platypus-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

uukuguy_speechless-codellama-orca-airoboros-13b-0.10e-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB

uukuguy_speechless-orca-platypus-coig-lite-4k-0.5e-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Vedant3907_Text-to-Sql-llama3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Velara-11B-V2-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB

Velara-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Vi-Qwen2-1.5B-RAG-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

Vinnnf_Thinkless-1.5B-RL-DeepScaleR-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB

Vinnnf_Thinkless-1.5B-Warmup-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

Violet_Twilight-v0.2-GGUF

0.2B 8K ctx
Q2_K
0.06GB file 2.06GB
Q3_K_M
0.09GB file 2.09GB

Viper-Coder-Hybrid-v1.3-GGUF

1.3B 8K ctx
Q2_K
0.41GB file 2.43GB
Q3_K_M
0.57GB file 2.59GB

Viper-Coder-HybridMini-v1.3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

Viper-Coder-v1.5-r999-GGUF

999B 8K ctx
Q2_K
312.19GB file 330.56GB
Q3_K_M
437.06GB file 455.43GB

Viper-OneCoder-UIGEN-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

ViraIntelligentDataMining_PersianLLaMA-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

viveriveniversumvivusvici_jiaforge-model-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

VMware_open-llama-7b-v2-open-instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Voicelab_trurl-2-13b-academic-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Voicelab_trurl-2-13b-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

Voicelab_trurl-2-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

wavecoder-ultra-6.7b-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q3_K_M
2.93GB file 5.04GB

WDKT_Xiangxin-2XL-Chat-1048k-Chinese-Llama3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

WebSquareAI-Instruct-KoSOLAR-10.7b-v0.5.34-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB

WebSquareAI-Instruct-llama-3-8B-v0.5.39-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

wenge-research_yayi-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

WildWest-Variant3-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

winglian_Llama-3-8b-64k-PoSE-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB

WiroAI-Finance-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

WisdomShell_RewardAnything-8B-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB

WizardMath-7B-V1.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

xDAN-SlimOrca-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Xenon1_Zenith-7B-dpo-v1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Xiangxin-2XL-Chat-1048k-Chinese-Llama3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB

xLAM-7b-r-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yam-peleg_Experiment25-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yam-peleg_Experiment26-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yam-peleg_Experiment27-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Yehia-7B-preview-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yentinglin_Taiwan-LLM-7B-v2.0-base-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yentinglin_Taiwan-LLM-7B-v2.0-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

yentinglin_Taiwan-LLM-7B-v2.0.1-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Yi-34B-200K-DARE-merge-v5-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

Yi-34B-Chat-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

Yi-34B-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

Yi-6B-200K-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_M
2.63GB file 4.73GB

Yi-6b-dpo-v0.2-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Yi-6B-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_M
2.63GB file 4.73GB

Yi-9B-200K-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Yi-9B-Forest-DPO-v1.0-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Yi-9B-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Yi-9b-v1-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Yi-Coder-9B-Chat-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB

Yi-Coder-9B-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB

Yi-Ko-34B-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K_M
14.88GB file 17.44GB

Yi-Ko-6B-dpo-v5-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Yi-Ko-6B-dpo-v6-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

Yi-Ko-6B-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_M
2.63GB file 4.73GB

Yi-Ko-6B-mixed-v15-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB

yi-ko-playtus-instruct-v0.2-GGUF

0.2B 8K ctx
Q2_K
0.06GB file 2.06GB

yongchao98_R1-Code-Interpreter-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB

You_can_cry_Snowman-13B-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

ypwang61_One-Shot-RLVR-Qwen2.5-Math-1.5B-pi1-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

ypwang61_One-Shot-RLVR-Qwen2.5-Math-1.5B-pi13-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB

ystemsrx_Qwen2-Boundless-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

YuE-s1-7B-anneal-en-cot-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

YuE-s1-7B-anneal-en-icl-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

YuE-s1-7B-anneal-jp-kr-cot-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

YuE-s1-7B-anneal-jp-kr-icl-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

YuE-s1-7B-anneal-zh-icl-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

YuE-s2-1B-general-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB

yujiepan_llama-3.3-tiny-random-dim64-GGUF

64B 8K ctx
Q2_K
20GB file 23.05GB

YuLan-Mini-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

yunsung-llama-2-koen-13b-linkbricks-sft-basic-v1-GGUF

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K_M
5.69GB file 7.9GB

zefiro-7b-base-ITA-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

zefiro-7b-beta-ITA-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

zefiro-7b-dpo-ITA-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

zefiro-7b-sft-qlora-ITA-v0.5-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

ZephRP-m7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Zephyr_RMU-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

zephyr-7b-beta-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

zephyr-7b-sft-full-SPIN-iter0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

zephyr-7b-sft-full-SPIN-iter1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB

zephyr-7b-sft-full-SPIN-iter2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

zephyr-7b-sft-full-SPIN-iter3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

zephyr-python-ru-merged-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB

ZeroAgency_Mistral-Small-3.1-24B-Instruct-2503-hf-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB

zhangchuheng123_llama2-alpaca-sft-2epoch-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

ZhangShenao_Llama-3.2-1B-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB

ZhangShenao_Llama-3.2-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB

Zigeng_R1-VeriThinker-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
T

Tensuai

1 models

Qwen3-0.6B-gguf

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q4_K
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q5_K
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
T

Tenzin Gayche

1 models

test-gguf

Unknown 8K ctx
FP16
0GB file 2GB
T

Teragron

1 models

buddhi-128k-chat-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
T

Terasut

1 models

typhoon-si-med-thinking-4b-research-preview-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB