All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Iamanishx

1 models

hf-test

Unknown 8K ctx
FP16
0GB file 2GB
I

Iambackup

4 models

Dolphin3.0-Llama3.1-8B-GGUF

8B 8K ctx
Q2_M
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_L
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.3-70B-Instruct-abliterated-GGUF

70B 8K ctx
Q2_XXS
21.88GB file 25.03GB
Q2_K
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_L
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_L
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Qwen2.5-MOE-2X7B-DeepSeek-Abliterated-UNCensored-19B-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

QwQ-32B-Preview-abliterated-GGUF

32B 8K ctx
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K
10GB file 12.52GB
Q3_M
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_L
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_L
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_L
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB
I

Iamcoder18

1 models

AceMath-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
I

Iamgm

1 models

magic-paste-gemma-3n-4b

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
I

Iamsatyapati

1 models

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
I

Iandennismiller

2 models

LLama-2-MedText-13b-GGUF

13B 8K ctx
Q3_K_L
5.69GB file 7.9GB
Q4_K_S
7.31GB file 9.52GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

mistral-v0.1-7b-GGUF

7B 8K ctx
Q4_K_S
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
I

Iapp

1 models

chinda-qwen3-4b-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
I

Ibbb

1 models

LLama-3-tryModel

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
I

Ibitato

2 models

c64-ministral-3-14b-thinking-c64-reasoning-gguf

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

c64-ministral-3-8b-thinking-c64-reasoning-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
I

Ibkya

1 models

Arden-World-3B

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB