LMStudio

What is LMStudio?

LMStudio is a versatile software that empowers you to explore, download, and operate local LLMs like LLaMa, Falcon, MPT, StarCoder, and more, all from the comfort of your laptop. Whether you're on a Mac (M1/M2), Windows, or Linux, you can run these models offline, interact with them through an in-app Chat UI, or even use an OpenAI compatible local server. With the ability to download any compatible model files from HuggingFace repositories, you'll always stay ahead of the curve. The latest version, v0.2.8, enhances your experience with a new feature: Local server Automatic Prompt Formatting, improving output quality with AutoGen. LMStudio is your gateway to the world of AI, right at your fingertips.