All Supported Models

29681 AI models · 198875 quantization formats tracked

L

Logic Bombaklot

1 models

SWE-rebench-openhands-Qwen3-30B-A3B-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB
L

Logical Lion

1 models

whiterabbitneo-8b-v1-gguf

7B 8K ctx
FP16
14GB file 16.11GB
L

Logihertzsystems

40 models

Nyra-Code-3B-GGUF-IQ1_M

3B 8K ctx
Q1_M
3GB file 5.05GB

Nyra-Code-3B-GGUF-IQ1_S

3B 8K ctx
Q1_S
3GB file 5.05GB

Nyra-Code-3B-GGUF-Q4_K_M

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Nyra-Code-3B-GGUF-Q8_0

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nyra-Code-7B-GGUF-IQ1_M

7B 8K ctx
Q1_M
7GB file 9.11GB

Nyra-Code-7B-GGUF-IQ1_S

7B 8K ctx
Q1_S
7GB file 9.11GB

Nyra-Code-7B-GGUF-Q4_K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Nyra-Code-7B-GGUF-Q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nyra-Core-3B-GGUF-IQ1_M

3B 8K ctx
Q1_M
3GB file 5.05GB

Nyra-Core-3B-GGUF-IQ1_S

3B 8K ctx
Q1_S
3GB file 5.05GB

Nyra-Core-3B-GGUF-Q4_K_M

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Nyra-Core-3B-GGUF-Q8_0

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nyra-Core-7B-GGUF-IQ1_M

7B 8K ctx
Q1_M
7GB file 9.11GB

Nyra-Core-7B-GGUF-IQ1_S

7B 8K ctx
Q1_S
7GB file 9.11GB

Nyra-Core-7B-GGUF-Q4_K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Nyra-Core-7B-GGUF-Q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nyra-Logic-3B-GGUF-IQ1_M

3B 8K ctx
Q1_M
3GB file 5.05GB

Nyra-Logic-3B-GGUF-IQ1_S

3B 8K ctx
Q1_S
3GB file 5.05GB

Nyra-Logic-3B-GGUF-Q4_K_M

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Nyra-Logic-3B-GGUF-Q8_0

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nyra-Logic-7B-GGUF-IQ1_M

7B 8K ctx
Q1_M
7GB file 9.11GB

Nyra-Logic-7B-GGUF-IQ1_S

7B 8K ctx
Q1_S
7GB file 9.11GB

Nyra-Logic-7B-GGUF-Q4_K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Nyra-Logic-7B-GGUF-Q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nyra-Main-3B-GGUF-IQ1_M

3B 8K ctx
Q1_M
3GB file 5.05GB

Nyra-Main-3B-GGUF-IQ1_S

3B 8K ctx
Q1_S
3GB file 5.05GB

Nyra-Main-3B-GGUF-Q4_K_M

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Nyra-Main-3B-GGUF-Q8_0

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nyra-Main-7B-GGUF-IQ1_M

7B 8K ctx
Q1_M
7GB file 9.11GB

Nyra-Main-7B-GGUF-IQ1_S

7B 8K ctx
Q1_S
7GB file 9.11GB

Nyra-Main-7B-GGUF-Q4_K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Nyra-Main-7B-GGUF-Q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Nyra-Vision-3B-GGUF-IQ1_M

3B 8K ctx
Q1_M
3GB file 5.05GB

Nyra-Vision-3B-GGUF-IQ1_S

3B 8K ctx
Q1_S
3GB file 5.05GB

Nyra-Vision-3B-GGUF-Q4_K_M

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Nyra-Vision-3B-GGUF-Q8_0

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nyra-Vision-7B-GGUF-IQ1_M

7B 8K ctx
Q1_M
7GB file 9.11GB

Nyra-Vision-7B-GGUF-IQ1_S

7B 8K ctx
Q1_S
7GB file 9.11GB

Nyra-Vision-7B-GGUF-Q4_K_M

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Nyra-Vision-7B-GGUF-Q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB
L

Logiya Vidhyapathi

1 models

llama-3.1-8B-quantization

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
L

Logxdx

1 models

ReaderLM-v2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
L

Loilkon

1 models

Qwopus3.5-9B-v3.5-Uncensored

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
L

Lolnoyarite

1 models

Dans-PersonalityEngine-V1.2.0-24b-Q3_K_S-GGUF

24B 8K ctx
Q3_0
10.5GB file 12.89GB
FP16
48GB file 50.39GB
L

Lone Striker

45 models

Air-Striker-Mixtral-8x7B-Instruct-ZLoss-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Air-Striker-Mixtral-8x7B-ZLoss-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

BioMistral-7B-DARE-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

BioMistral-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

BioMistral-7B-SLERP-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

BioMistral-7B-TIES-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

CodeLlama-70b-Instruct-hf-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB

CodeLlama-70b-Python-hf-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB

CodeMate-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_K_L
0.04GB file 2.04GB
Q3_K_M
0.04GB file 2.04GB
Q3_K_S
0.04GB file 2.04GB
Q4_K_M
0.06GB file 2.06GB
Q4_K_S
0.06GB file 2.06GB
Q5_K_M
0.07GB file 2.07GB
Q5_K_S
0.07GB file 2.07GB
Q6_K
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB

FuseChat-7B-Slerp-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

FuseChat-7B-TA-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

FuseChat-7B-VaRM-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

internlm2-math-20b-llama-GGUF

20B 8K ctx
Q3_K_L
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB

KafkaLM-8x7b-German-V0.1-DPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Llama-3-70B-Instruct-Gradient-262k-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Llama-3-70B-Instruct-Gradient-524k-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Llama-3-8B-Instruct-262k-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3-ChatQA-1.5-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Llama3-ChatQA-1.5-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Meta-Llama-3-70B-Instruct-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Meta-Llama-3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-64k-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral7B-PairRM-SPPO-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Nxcode-CQ-7B-orpo-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-deepseek-10b-v17.1-4k-GGUF

10B 8K ctx
Q3_K_L
4.38GB file 6.54GB
Q3_K_M
4.38GB file 6.54GB
Q3_K_S
4.38GB file 6.54GB
Q4_K_M
5.63GB file 7.79GB
Q4_K_S
5.63GB file 7.79GB
Q5_K_M
6.88GB file 9.04GB
Q5_K_S
6.88GB file 9.04GB
Q6_K
8.13GB file 10.29GB
Q8_0
10.63GB file 12.79GB

openbuddy-gemma-7b-v19.1-4k-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-mistral-7b-v17.1-32k-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openbuddy-mixtral-7bx8-v18.1-32k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

OpenCodeInterpreter-CL-13B-GGUF

13B 8K ctx
Q3_K_L
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

OpenCodeInterpreter-CL-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

OpenCodeInterpreter-CL-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenCodeInterpreter-DS-33B-GGUF

33B 8K ctx
Q3_K_L
14.44GB file 16.98GB
Q4_K_M
18.56GB file 21.1GB
Q5_K_M
22.69GB file 25.23GB
Q6_K
26.81GB file 29.35GB
Q8_0
35.06GB file 37.6GB

OpenCodeInterpreter-DS-6.7B-GGUF

6.7B 8K ctx
Q3_K_L
2.93GB file 5.04GB
Q4_K_M
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB

opus-v1.2-llama-3-8b-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Phi-3-medium-128k-instruct-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Quyen-Pro-Max-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_K_L
0.04GB file 2.04GB
Q4_K_M
0.06GB file 2.06GB

Qwen1.5-110B-Chat-GGUF

110B 8K ctx
Q2_K
34.38GB file 38.18GB

speechless-zephyr-code-functionary-7b-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Yi-6B-200K-GGUF

6B 8K ctx
Q3_K_L
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB

Yi-9B-200K-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

zephyr-7b-gemma-v0.1-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
L

Longod

1 models

SakuraLLMSakura-13B-LNovel-v08-gguf

13B 8K ctx
Q2_0
4.06GB file 6.27GB
Q3_0
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q6_0
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB
L

Loni415

1 models

Augmentoolkit-DataSpecialist-v0.1-GGUF

0.1B 8K ctx
FP16
0.2GB file 2.2GB