VRAM
calc
Calculator
All Models
Calculator
›
All Models
All Supported Models
29681 AI models · 198875 quantization formats tracked
T
Tifin India
11 models
sarvam-m-24b-f16-gguf
24B
8K ctx
FP16
48GB file
50.39
GB
sarvam-m-24b-q2-k-gguf
24B
8K ctx
Q2_K
7.5GB file
9.89
GB
sarvam-m-24b-q3-k-gguf
24B
8K ctx
Q3_K
10.5GB file
12.89
GB
sarvam-m-24b-q3-k-l-gguf
24B
8K ctx
Q3_K_L
10.5GB file
12.89
GB
sarvam-m-24b-q3-k-m-gguf
24B
8K ctx
Q3_K_M
10.5GB file
12.89
GB
sarvam-m-24b-q3-k-s-gguf
24B
8K ctx
Q3_K_S
10.5GB file
12.89
GB
sarvam-m-24b-q4-k-m-gguf
24B
8K ctx
Q4_K_M
13.5GB file
15.89
GB
sarvam-m-24b-q4-k-s-gguf
24B
8K ctx
Q4_K_S
13.5GB file
15.89
GB
sarvam-m-24b-q5-1-gguf
24B
8K ctx
Q5_1
16.5GB file
18.89
GB
sarvam-m-24b-q5-k-m-gguf
24B
8K ctx
Q5_K_M
16.5GB file
18.89
GB
sarvam-m-24b-q6-k-gguf
24B
8K ctx
Q6_K
19.5GB file
21.89
GB
T
Tigres2526
1 models
CAI-20B-v2-GGUF
20B
8K ctx
Q4_K_M
11.25GB file
13.58
GB
Q4_K_S
11.25GB file
13.58
GB
Q5_K_M
13.75GB file
16.08
GB
Q8_0
21.25GB file
23.58
GB
T
Tihuang
1 models
Qwen2-7B-Instruct-Q5_K_M-GGUF
7B
8K ctx
Q5_0
4.81GB file
6.92
GB
FP16
14GB file
16.11
GB
T
Tiiny
2 models
SmallThinker-21BA3B-Instruct-GGUF
21B
8K ctx
Q3_K
9.19GB file
11.53
GB
Q3_K_S
9.19GB file
11.53
GB
Q4_0
11.81GB file
14.15
GB
Q4_1
11.81GB file
14.15
GB
Q4_K
11.81GB file
14.15
GB
Q4_K_M
11.81GB file
14.15
GB
Q4_K_S
11.81GB file
14.15
GB
Q4_NL
11.81GB file
14.15
GB
Q4_XS
11.81GB file
14.15
GB
Q5_K
14.44GB file
16.78
GB
Q6_K
17.06GB file
19.4
GB
Q8_0
22.31GB file
24.65
GB
SmallThinker-4BA0.6B-Instruct-GGUF
4B
8K ctx
Q3_K
1.75GB file
3.82
GB
Q3_K_S
1.75GB file
3.82
GB
Q4_0
2.25GB file
4.32
GB
Q4_1
2.25GB file
4.32
GB
Q4_K
2.25GB file
4.32
GB
Q4_K_S
2.25GB file
4.32
GB
Q4_NL
2.25GB file
4.32
GB
Q4_XS
2.25GB file
4.32
GB
Q5_K
2.75GB file
4.82
GB
Q6_K
3.25GB file
5.32
GB
Q8_0
4.25GB file
6.32
GB
T
Tiiuae
6 models
Falcon-H1-1.5B-Instruct-GGUF
1.5B
8K ctx
Q2_0
0.47GB file
2.49
GB
Q2_K
0.47GB file
2.49
GB
Q2_K_S
0.47GB file
2.49
GB
Q2_M
0.47GB file
2.49
GB
Q2_S
0.47GB file
2.49
GB
Q2_XS
0.47GB file
2.49
GB
Q2_XXS
0.47GB file
2.49
GB
Q3_K
0.66GB file
2.68
GB
Q3_K_L
0.66GB file
2.68
GB
Q3_K_M
0.66GB file
2.68
GB
Q3_K_S
0.66GB file
2.68
GB
Q3_M
0.66GB file
2.68
GB
Q3_S
0.66GB file
2.68
GB
Q3_XS
0.66GB file
2.68
GB
Q3_XXS
0.66GB file
2.68
GB
Q4_0
0.84GB file
2.86
GB
Q4_1
0.84GB file
2.86
GB
Q4_K
0.84GB file
2.86
GB
Q4_K_M
0.84GB file
2.86
GB
Q4_K_S
0.84GB file
2.86
GB
Q4_NL
0.84GB file
2.86
GB
Q4_XS
0.84GB file
2.86
GB
Q5_0
1.03GB file
3.05
GB
Q5_1
1.03GB file
3.05
GB
Q5_K
1.03GB file
3.05
GB
Q5_K_M
1.03GB file
3.05
GB
Q5_K_S
1.03GB file
3.05
GB
Q6_K
1.22GB file
3.24
GB
Q1_0
1.5GB file
3.52
GB
Q1_M
1.5GB file
3.52
GB
Q1_S
1.5GB file
3.52
GB
Q8_0
1.59GB file
3.61
GB
BF16
3GB file
5.02
GB
Falcon-H1-34B-Instruct-GGUF
34B
8K ctx
Q2_0
10.63GB file
13.19
GB
Q2_K
10.63GB file
13.19
GB
Q2_K_S
10.63GB file
13.19
GB
Q2_M
10.63GB file
13.19
GB
Q2_S
10.63GB file
13.19
GB
Q2_XS
10.63GB file
13.19
GB
Q2_XXS
10.63GB file
13.19
GB
Q3_K
14.88GB file
17.44
GB
Q3_K_L
14.88GB file
17.44
GB
Q3_K_M
14.88GB file
17.44
GB
Q3_K_S
14.88GB file
17.44
GB
Q3_M
14.88GB file
17.44
GB
Q3_S
14.88GB file
17.44
GB
Q3_XS
14.88GB file
17.44
GB
Q3_XXS
14.88GB file
17.44
GB
Q4_0
19.13GB file
21.69
GB
Q4_1
19.13GB file
21.69
GB
Q4_K
19.13GB file
21.69
GB
Q4_K_M
19.13GB file
21.69
GB
Q4_K_S
19.13GB file
21.69
GB
Q4_NL
19.13GB file
21.69
GB
Q4_XS
19.13GB file
21.69
GB
Q5_0
23.38GB file
25.94
GB
Q5_1
23.38GB file
25.94
GB
Q5_K
23.38GB file
25.94
GB
Q5_K_M
23.38GB file
25.94
GB
Q5_K_S
23.38GB file
25.94
GB
Q6_K
27.63GB file
30.19
GB
Q1_0
34GB file
36.56
GB
Q1_M
34GB file
36.56
GB
Q1_S
34GB file
36.56
GB
Q8_0
36.13GB file
38.69
GB
BF16
68GB file
70.56
GB
Falcon-H1R-7B-GGUF
7B
8K ctx
Q2_0
2.19GB file
4.3
GB
Q2_K
2.19GB file
4.3
GB
Q2_M
2.19GB file
4.3
GB
Q3_K
3.06GB file
5.17
GB
Q3_K_L
3.06GB file
5.17
GB
Q3_K_M
3.06GB file
5.17
GB
Q3_K_S
3.06GB file
5.17
GB
Q3_M
3.06GB file
5.17
GB
Q3_S
3.06GB file
5.17
GB
Q3_XS
3.06GB file
5.17
GB
Q3_XXS
3.06GB file
5.17
GB
Q4_0
3.94GB file
6.05
GB
Q4_1
3.94GB file
6.05
GB
Q4_K
3.94GB file
6.05
GB
Q4_K_M
3.94GB file
6.05
GB
Q4_K_S
3.94GB file
6.05
GB
Q4_NL
3.94GB file
6.05
GB
Q4_XS
3.94GB file
6.05
GB
Q5_0
4.81GB file
6.92
GB
Q5_1
4.81GB file
6.92
GB
Q5_K
4.81GB file
6.92
GB
Q5_K_M
4.81GB file
6.92
GB
Q5_K_S
4.81GB file
6.92
GB
Q6_K
5.69GB file
7.8
GB
Q1_0
7GB file
9.11
GB
Q8_0
7.44GB file
9.55
GB
BF16
14GB file
16.11
GB
Falcon3-10B-Instruct-GGUF
10B
8K ctx
Q2_0
3.13GB file
5.29
GB
Q3_0
4.38GB file
6.54
GB
Q4_0
5.63GB file
7.79
GB
Q5_0
6.88GB file
9.04
GB
Q6_0
8.13GB file
10.29
GB
Q8_0
10.63GB file
12.79
GB
Falcon3-1B-Instruct-GGUF
1B
8K ctx
Q2_0
0.31GB file
2.33
GB
Q3_0
0.44GB file
2.46
GB
Q4_0
0.56GB file
2.58
GB
Q5_0
0.69GB file
2.71
GB
Q6_0
0.81GB file
2.83
GB
Q8_0
1.06GB file
3.08
GB
Falcon3-7B-Instruct-GGUF
7B
8K ctx
Q2_0
2.19GB file
4.3
GB
Q3_0
3.06GB file
5.17
GB
Q4_0
3.94GB file
6.05
GB
Q5_0
4.81GB file
6.92
GB
Q6_0
5.69GB file
7.8
GB
Q8_0
7.44GB file
9.55
GB
T
Tiktemu
5 models
ByteShape___Devstral-Small-2-24B-Instruct-2512-GGUF
24B
8K ctx
Q2_S
7.5GB file
9.89
GB
Q3_S
10.5GB file
12.89
GB
Q4_XS
13.5GB file
15.89
GB
BF16
48GB file
50.39
GB
ByteShape___Llama-3.1-8B-Instruct-GGUF
8B
8K ctx
Q3_K_S
3.5GB file
5.63
GB
Q3_S
3.5GB file
5.63
GB
Q4_K_S
4.5GB file
6.63
GB
Q4_XS
4.5GB file
6.63
GB
ByteShape___Qwen3-30B-A3B-Instruct-2507-GGUF
30B
8K ctx
Q3_K_S
13.13GB file
15.62
GB
Q3_S
13.13GB file
15.62
GB
Q4_K_S
16.88GB file
19.37
GB
Q4_XS
16.88GB file
19.37
GB
ByteShape___Qwen3-4B-Instruct-2507-GGUF
4B
8K ctx
Q2_S
1.25GB file
3.32
GB
Q3_K_S
1.75GB file
3.82
GB
Q3_S
1.75GB file
3.82
GB
Q4_K_S
2.25GB file
4.32
GB
Q4_XS
2.25GB file
4.32
GB
Q5_K_S
2.75GB file
4.82
GB
ByteShape___Qwen3-Coder-30B-A3B-Instruct-GGUF
30B
8K ctx
Q3_K_M
13.13GB file
15.62
GB
Q3_K_S
13.13GB file
15.62
GB
Q3_S
13.13GB file
15.62
GB
Q4_XS
16.88GB file
19.37
GB
T
Tilo15
1 models
cosmic-2
Unknown
8K ctx
Q1_M
0GB file
2
GB
T
Timbossm
2 models
qwen2.5-3B-sql-mgpu-bi-ft
3B
8K ctx
FP16
6GB file
8.05
GB
sales-sql-finetuned-model
Unknown
8K ctx
FP16
0GB file
2
GB
T
Time Load
1 models
deepseek-r1-medical
671B
8K ctx
FP16
1342GB file
1354.99
GB
T
Times Last
1 models
TimesLastAI-4B-CODER-GGUF
4B
8K ctx
Q8_0
4.25GB file
6.32
GB
Previous
Next
Showing
5301
to
5310
of
5981
results
1
2
...
528
529
530
531
532
533
534
...
598
599