All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Bond005

2 models

meno-lite-0.1-gguf

0.1B 8K ctx
Q3_M
0.04GB file 2.04GB
Q4_K_M
0.06GB file 2.06GB
Q5_K_M
0.07GB file 2.07GB
Q8_0
0.11GB file 2.11GB
FP16
0.2GB file 2.2GB

meno-tiny-0.1-gguf

0.1B 8K ctx
FP16
0.2GB file 2.2GB
B

Boo Radley

1 models

Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB
B

Boo1312

1 models

Llama-3.2-3B-original-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
B

Boobalamurugan

1 models

TN_Heritage_LLM

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
B

Bootkorea

1 models

HyperCLOVAX-SEED-Text-Instruct-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
B

Boricua

4 models

granite-7b-lab-ocp4.15-v0.3

7B 8K ctx
FP16
14GB file 16.11GB

merlinite-7b-ocp4.15-v0.1

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

merlinite-7b-ocp4.15-v0.3

7B 8K ctx
FP16
14GB file 16.11GB

shiftdocs-7b-ocp4.15-v0.3

7B 8K ctx
FP16
14GB file 16.11GB
B

Borjan

1 models

finki-gpt-140M

Unknown 8K ctx
Q4_K_M
0GB file 2GB
B

Boroll2347

3 models

medgemma-27b-text-heretic_med-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

medgemma-27b-text-heretic_med-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

medgemma-27b-text-heretic_med-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB
B

Bosco The Dog

18 models

Bessie_bitnet_instruct_100k_gguf

Unknown 8K ctx
FP16
0GB file 2GB

bitnet_b1_58-large_q8_0_gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

bitnet_b1_58-xl_q8_0_gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

bitnet-mistral.0.2-330m-v0.2-grokfast-v2.9_gguf

Unknown 8K ctx
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
Q3_K_L
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB

Danube_3-500M_Chat_GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_L
0GB file 2GB
Q2_K
0GB file 2GB
FP16
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

gemma_2_2b_it_Q4_gguf_chunked

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma_2b_sauerkraut_gguf_chunked

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma-2-9b-it-IQ2_S_gguf_chunked

9B 8K ctx
Q2_XS
2.81GB file 4.96GB

h2o-danube3-4b-chat-Q4_K_M_chunked

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

oneirogen_1_5b_Q4_0_gguf_chunked

5B 8K ctx
Q4_0
2.81GB file 4.89GB

phi_3_mini_128k_it_russian_Q4_K_M_chunked

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi_3_mini_128k_italian_v2_Q4_K_M_chunked

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi_3_mini_4k_it_french_alpaca_v1_Q4_K_M

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi_3_mini_4k_it_portuguese_tom_cat_Q4_K_M_chunked

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi_3_mini_4k_it_spanish_pofi_Q4_K_M

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi-3-mental-health_Q4_K_M_chunked

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB

SambaLingo_Hungarian_Chat_Q2_K_chunked

Unknown 8K ctx
Q2_K
0GB file 2GB

Ukranian_Q2_chunked

Unknown 8K ctx
Q2_K
0GB file 2GB
B

Bosmet

1 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB