All Supported Models

29681 AI models · 198875 quantization formats tracked

N

Notjjustnumbers

1 models

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
N

Notkelvin

1 models

VibeThinker-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
N

Notnotnotnoone

1 models

smartmathmatician-F16-GGUF

9B 8K ctx
FP16
18GB file 20.15GB
N

Nous Research

6 models

Hermes-2-Theta-Llama-3-70B-GGUF

70B 8K ctx
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB

Hermes-4.3-36B-GGUF

36B 8K ctx
Q3_K_M
15.75GB file 18.34GB
Q4_K_M
20.25GB file 22.84GB
Q5_K_M
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
Q8_0
38.25GB file 40.84GB

Meta-Llama-3-70B-GGUF

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Meta-Llama-3-8B-GGUF

8B 8K ctx
Q4_5
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
N

Nova Corp

2 models

Deflowered_MaidElla-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Scarface-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
N

Novachrono A I

2 models

LFM2.5-1.2B-Nova-Function-Calling-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

Nova-LFM-1.2B-Thinking-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
N

Novaciano

123 models

Aesir-3.2-1B-GRPO_MiniThinky_Q4_K_S-GGUF

1B 8K ctx
Q4_K_S
0.56GB file 2.58GB

Aesir-3.2-1B-GRPO-miniThinky_v1-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Aesir-3.2-GRPO-miniThinky_v1-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Amoral_Christmas-3.2-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

ANAL.DESTRUCTION-3.2-1B-Uncensored_V2-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

BADMISTRAL-1.5B-NSFW2-GGUF

1.5B 8K ctx
FP16
3GB file 5.02GB

Bellatrix-1B-R1_Erotiquant3_IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Bellatrix-1B-R1_Erotiquant3_Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

BLAST_PROCESSING-3.2-1B-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

BLAST_PROCESSING-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

BLAST_PROCESSING-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

BLAST_PROCESSING-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

BLAST_PROCESSING-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Capybara_Sex-3.2-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Chronos-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Dirty_Maid_Alice-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Dirty_Maid_Alice-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Distil-NPC-gemma-3-1b-it-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Distil-NPC-gemma-3-1b-it-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Doctor_Horror-3.2-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

EMO_SEX_V2-3.2-1B-IQ4_XS-iMatrix-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

EMO_SEX_V2-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q4_K_M-iMatrix-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q5_0-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB

EMO_SEX_V2-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q5_K_M-iMatrix-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

EMO_SEX_V2-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

EMO_SEX_V3-RP-3.2-1B-Q4_K_M-iMatrix-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

EMO_SEX_V3-RP-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Ero_Sama-3.2-1B-Q4_K_M_iMatrix-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Ero_Sama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Ero_Sama-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Gemma3-Catboros-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Gemma3-HADES-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Gemma3-Hereticsutra.Mixed-2B-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

GPT2-NOVA-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Granite-3.1-1b-ANAL_DESTRUCTION-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Granite-3.1-1b-NSFW_Amoral_Christmas-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Harmful-1B_GRPO_MiniThinky-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

HereticMaidX-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

JP-QWEN2.5-BIOHAZARD-1.5B-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Kraken-3.2-1B-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Kraken-3.2-1B-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

Kraken-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Kraken-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Kraken-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Kraken-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Kraken-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

L3.2-1b_SuperUncensored_V2-IQ4_XS-GGUF

1B 8K ctx
Q4_XS
0.56GB file 2.58GB

L3.2-1b_SuperUncensored_V2-Q4_K_M-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

L3.2-1b_SuperUncensored_V2-Q5_K_M-GGUF

1B 8K ctx
Q5_K_M
0.69GB file 2.71GB

L3.2-1B_Uncensored_ShortStories-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

L3.2-1b-SuperUncensored_V2-IQ3_XXS-GGUF

1B 8K ctx
Q3_XXS
0.44GB file 2.46GB

L3.2-1B-Uncensored_ShortStories_Q4_K_M-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

L3.2-2025_SuperUncensored_Q5-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

L3.2-2025-SuperUncensored-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Legal_RP-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Llama-3.2_1b_Erotiquant3_IQ4_XS_GGUF

1B 8K ctx
Q4_XS
0.56GB file 2.58GB

Llama-3.2_1b_Erotiquant3_Q4_K_M_GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Llama-3.2_1b_Erotiquant3_Q5_K_M_GGUF

1B 8K ctx
Q5_K_M
0.69GB file 2.71GB

Llama-3.2_1b_Jenna_Uncensored-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2_1b_Uncensored_RP_Aesir_GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2-1b_DeepSync_Aesir-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2-1b_NSFW_Amoral_Christmas-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2-1B-NSFW_Open_Erotic_GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Llama3.2_1b_NOVA-Castellano_y_Sin_Censura

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Magnum-1b-Short_Stories-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Magnum-1b-Short_Stories-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Magnum-1b-Short_Stories-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Magnum-1b-Short_Stories-Q5_K_S-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

MiniWaifu-glm-edge-1.5b-chat-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Mistral-1b-NSFW_Amoral_Christmas-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Nanopenis-68M_NSFW_RP-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Novaciano-SERIES-3.2-1B-Q4-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

NSFW_RP-3.2-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Pythia-1b-Unfiltered_NSFW-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Q5KM-Charcard-RP-1B-GRPO_MiniThinky-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Qwen2.5-0.5B-NSFW_Amoral_Christmas-GGUF

0.5B 8K ctx
FP16
1GB file 3.01GB

Qwen2.5-1.5B-NSFW_Amoral_Christmas-GGUF

1.5B 8K ctx
FP16
3GB file 5.02GB

Qwen2.5-Sex-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

RC.Outbreak-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

RPG-Neuro-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

RUN-WITH-SCISSORS-3.2-1B-IQ4_XS-iMat-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

RUN-WITH-SCISSORS-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

RUN-WITH-SCISSORS-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

RUN-WITH-SCISSORS-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

RUN-WITH-SCISSORS-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

salamandra-2b-instruct-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Sentimental_Sex-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Sentimental_Sex-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Sentimental_Sex-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Sentimental_Sex-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

Sentimental_Sex-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

SEX_ROLEPLAY_V3-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY_VICTORIA-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB

SEX_ROLEPLAY-2B-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB

SEX_ROLEPLAY-3.2-1B-IQ3_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-IQ3_XXS-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-IQ4_XS-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

SEX_ROLEPLAY-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-Q5_0-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB

SEX_ROLEPLAY-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-Q6_K-GGUF

1B 8K ctx
Q6_0
0.81GB file 2.83GB
FP16
2GB file 4.02GB

SEX_ROLEPLAY-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Sexting-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

SmolRP-135M-v0.9-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Sorete-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Spanish_ProtoRPG-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Spanish_RPG-3.2-1B-GGUF

1B 8K ctx
Q3_K_M
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
FP4
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Star.Wars_RP-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q3_K_M
0.44GB file 2.46GB

Star.Wars_Uncensored-3.2-1B-iMatrix-GGUF

1B 8K ctx
Q3_K_M
0.44GB file 2.46GB

Think.NPC-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

TinyBoludo-DPO-NSFW-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

TinyBoludo-V2-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Toxic.NPC-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Triangulum-1B-DPO_Roleplay_NSFW-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Uncensored-1b-Creative_Writing_RP-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Uroboros-2B-GGUF

1B 8K ctx
Q3_K_M
0.44GB file 2.46GB

Very_Dangerous-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB
N

Novatastic Ro Script

1 models

Atomight-2-1.5B-Thinking-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
N

Noway Wf

1 models

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
N

Noxinc

20 models

gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF-PTBR

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

gemma-portuguese-tom-cat-2b-it-Q5_K_M-GGUF-PTBR

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB

Llama-3-portuguese-Tom-cat-8b-instruct-Q2_K-GGUF-PTBR

8B 8K ctx
Q2_K
2.5GB file 4.63GB

Llama-3-portuguese-Tom-cat-8b-instruct-Q4_K_M-GGUF-PTBR

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Llama-3-portuguese-Tom-cat-8b-instruct-Q5_K_M-GGUF-PTBR

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB

Llama-3-portuguese-Tom-cat-8b-instruct-Q8_0-GGUF-PTBR

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Mistral-portuguese-luana-7b-chat-Q5_K_M-GGUF-PTBR

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Mistral-portuguese-luana-7b-chat-Q8_0-GGUF-PTBR

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Mistral-portuguese-luana-7b-Mathematics-Q5_K_M-GGUF-PTBR

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF-PTBR

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Mistral-portuguese-luana-7b-mental-health-Q8_0-GGUF-PTBR

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Mistral-portuguese-luana-7b-Q5_K_M-GGUF-PTBR

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Mistral-portuguese-luana-7b-Q8_0-GGUF-PTBR

7B 8K ctx
Q8_0
7.44GB file 9.55GB

phi-3-portuguese-tom-cat-4k-instruct-Q4_0-GGUF-PTBR

0B 8K ctx
Q4_0
0GB file 2GB

phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF-PTBR

3.8B 8K ctx
Q5_K_M
2.61GB file 4.67GB

portuguese-Phi3-Tom-Cat-128k-instruct-Q5_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB

Qwen2.5-32B-Instruct-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

Tucano-2b4-Q4_K_M-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Tucano-2b4-Q5_K_M-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB