All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Baa Ai

12 models

Gemma-4-31B-it-RAM-26GB-GGUF

31B 8K ctx
FP16
62GB file 64.51GB

Gemma-4-31B-it-RAM-43GB-GGUF

31B 8K ctx
FP16
62GB file 64.51GB

Kimi-K2.6-RAM-344GB-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Kimi-K2.6-RAM-447GB-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Kimi-K2.6-RAM-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Llama-4-Scout-17B-16E-Instruct-RAM-105GB-GGUF

17B 8K ctx
FP16
34GB file 36.28GB

Llama-4-Scout-17B-16E-Instruct-RAM-137GB-GGUF

17B 8K ctx
FP16
34GB file 36.28GB

Qwen3.5-122B-A10B-RAM-164GB-GGUF

122B 8K ctx
FP16
244GB file 248GB

Qwen3.5-122B-A10B-RAM-94GB-GGUF

122B 8K ctx
FP16
244GB file 248GB

Qwen3.5-35B-A3B-RAM-30GB-GGUF

35B 8K ctx
FP16
70GB file 72.57GB

Qwen3.5-35B-A3B-RAM-50GB-GGUF

35B 8K ctx
FP16
70GB file 72.57GB

Qwen3.6-35B-A3B-RAM-26GB-GGUF

35B 8K ctx
FP16
70GB file 72.57GB
B

Baba K07

2 models

Llama-3.3-70B-Instruct-GGUF

70B 8K ctx
Q3_XS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Qwen2.5-7B-Instruct-1M-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
B

Babariankingcanyon

2 models

openthaigpt1.5-14b-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

openthaigpt1.5-7b-instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
B

Babu420

1 models

aquif-moe-800M-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
B

Bacchist

1 models

pokerbench_Qwen3-1.7B-unsloth-bnb-4bit

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
B

Backyardai

20 models

Big-Lemon-Cookie-11B-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q2_K_S
3.44GB file 5.62GB
Q2_M
3.44GB file 5.62GB
Q2_S
3.44GB file 5.62GB
Q2_XS
3.44GB file 5.62GB
Q2_XXS
3.44GB file 5.62GB
Q3_K_L
4.81GB file 6.99GB
Q3_K_M
4.81GB file 6.99GB
Q3_K_S
4.81GB file 6.99GB
Q3_M
4.81GB file 6.99GB
Q3_S
4.81GB file 6.99GB
Q3_XS
4.81GB file 6.99GB
Q3_XXS
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q4_XS
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q1_M
11GB file 13.18GB
Q1_S
11GB file 13.18GB
Q8_0
11.69GB file 13.87GB

Cerebrum-1.0-8x7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Chaifighter-20B-v2.1-GGUF

20B 8K ctx
Q2_M
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_XS
8.75GB file 11.08GB
Q3_XXS
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_M
20GB file 22.33GB
Q1_S
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB

Chaifighter-20B-v3-GGUF

20B 8K ctx
Q2_M
6.25GB file 8.58GB
Q2_S
6.25GB file 8.58GB
Q2_XS
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q3_M
8.75GB file 11.08GB
Q3_S
8.75GB file 11.08GB
Q3_XS
8.75GB file 11.08GB
Q3_XXS
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_XS
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q1_M
20GB file 22.33GB
Q1_S
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB

Chewy-Lemon-Cookie-11B-GGUF

11B 8K ctx
Q2_M
3.44GB file 5.62GB
Q2_S
3.44GB file 5.62GB
Q2_XS
3.44GB file 5.62GB
Q2_XXS
3.44GB file 5.62GB
Q3_K_L
4.81GB file 6.99GB
Q3_K_M
4.81GB file 6.99GB
Q3_K_S
4.81GB file 6.99GB
Q3_M
4.81GB file 6.99GB
Q3_S
4.81GB file 6.99GB
Q3_XS
4.81GB file 6.99GB
Q3_XXS
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q4_XS
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q1_M
11GB file 13.18GB
Q1_S
11GB file 13.18GB
Q8_0
11.69GB file 13.87GB

Chunky-Lemon-Cookie-11B-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q2_K_S
3.44GB file 5.62GB
Q2_M
3.44GB file 5.62GB
Q2_S
3.44GB file 5.62GB
Q2_XS
3.44GB file 5.62GB
Q2_XXS
3.44GB file 5.62GB
Q3_K_L
4.81GB file 6.99GB
Q3_K_M
4.81GB file 6.99GB
Q3_K_S
4.81GB file 6.99GB
Q3_M
4.81GB file 6.99GB
Q3_S
4.81GB file 6.99GB
Q3_XS
4.81GB file 6.99GB
Q3_XXS
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q4_XS
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q1_M
11GB file 13.18GB
Q1_S
11GB file 13.18GB
Q8_0
11.69GB file 13.87GB

DarkSapling-7B-v2.0-GGUF

7B 8K ctx
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Esper-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_S
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q2_M
2.81GB file 4.96GB
Q2_S
2.81GB file 4.96GB
Q2_XS
2.81GB file 4.96GB
Q2_XXS
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q1_M
9GB file 11.15GB
Q1_S
9GB file 11.15GB
Q8_0
9.56GB file 11.71GB

InfinityKuno-2x7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

L3-8B-Stheno-v3.3-32K-GGUF

8B 8K ctx
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-Nemotron-70B-Instruct-GGUF

70B 8K ctx
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
BF16
140GB file 143.15GB

magnum-72b-v1-GGUF

72B 8K ctx
Q2_M
22.5GB file 25.68GB
Q2_S
22.5GB file 25.68GB
Q2_XS
22.5GB file 25.68GB
Q2_XXS
22.5GB file 25.68GB
Q3_K_L
31.5GB file 34.68GB
Q3_K_M
31.5GB file 34.68GB
Q3_K_S
31.5GB file 34.68GB
Q3_M
31.5GB file 34.68GB
Q3_S
31.5GB file 34.68GB
Q3_XS
31.5GB file 34.68GB
Q3_XXS
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_K_S
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB
Q5_K_M
49.5GB file 52.68GB
Q5_K_S
49.5GB file 52.68GB
Q6_K
58.5GB file 61.68GB
Q1_M
72GB file 75.18GB
Q1_S
72GB file 75.18GB
Q8_0
76.5GB file 79.68GB

magnum-v4-72b-GGUF

72B 8K ctx
Q2_M
22.5GB file 25.68GB
Q2_S
22.5GB file 25.68GB
Q2_XS
22.5GB file 25.68GB
Q2_XXS
22.5GB file 25.68GB
Q3_K_L
31.5GB file 34.68GB
Q3_K_M
31.5GB file 34.68GB
Q3_K_S
31.5GB file 34.68GB
Q3_M
31.5GB file 34.68GB
Q3_S
31.5GB file 34.68GB
Q3_XS
31.5GB file 34.68GB
Q3_XXS
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_K_S
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB
Q5_K_M
49.5GB file 52.68GB
Q5_K_S
49.5GB file 52.68GB
Q6_K
58.5GB file 61.68GB
Q1_M
72GB file 75.18GB
Q8_0
76.5GB file 79.68GB

Meta-Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q2_M
21.88GB file 25.03GB
Q2_S
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_S
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

NeuralBeagle14-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Phi-3-mini-4k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q2_K_S
1.19GB file 3.25GB
Q2_M
1.19GB file 3.25GB
Q2_S
1.19GB file 3.25GB
Q2_XS
1.19GB file 3.25GB
Q2_XXS
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q3_S
1.66GB file 3.72GB
Q3_XS
1.66GB file 3.72GB
Q3_XXS
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q1_S
3.8GB file 5.86GB
Q8_0
4.04GB file 6.1GB

Smart-Lemon-Cookie-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

WestLake-10.7B-v2-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q2_K_S
3.34GB file 5.52GB
Q2_M
3.34GB file 5.52GB
Q2_S
3.34GB file 5.52GB
Q2_XS
3.34GB file 5.52GB
Q2_XXS
3.34GB file 5.52GB
Q3_K_L
4.68GB file 6.86GB
Q3_K_M
4.68GB file 6.86GB
Q3_K_S
4.68GB file 6.86GB
Q3_M
4.68GB file 6.86GB
Q3_S
4.68GB file 6.86GB
Q3_XS
4.68GB file 6.86GB
Q3_XXS
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q4_K_S
6.02GB file 8.2GB
Q4_XS
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q5_K_S
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q1_S
10.7GB file 12.88GB
Q8_0
11.37GB file 13.55GB
B

Bader X7

1 models

LFM2-700M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
B

Badgids

2 models

Gonzo-Chat-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Gonzo-Code-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
B

Baf S

1 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
B

Baghelz

1 models

OpenHermes-2.5-neural-chat-v3-3-Slerp

Unknown 8K ctx
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB