Hermes Agent + LM Studio is INSANE!

Added: 2026-05-09

[00:00:00]Today, we are going to be testing out Hermes agent and how to use it for free with local models with LM Studio. So, LM Studio can run with Hermes agent now, which means that you can run Hermes agent and use it for free with local models. Bear in mind, Hermes agent itself is a free open source model, and then if you can plug in a free LM Studio local running AI model, then you can use it for free as well, right? So, it has a a free sort of way to run it inside Hermes. So, let's get started with this right now. And you can see that it's quite easy to integrate these two together. So, the first thing that we need to do is run the server from LM Studio, all right? So, we're going to open up LM Studio. If you don't have LM Studio already, you can get it at lmstudio.ai, right? It's a free app. You can download it, and then you can install local models, right? So, for example, you can set up a local server and load a model with a local server. This means you can run local models with LM Studio. So, for example, if we search inside the model section here, we can install something like, for example, Gemma 4, and then run that with our AI models, right? It's pretty simple and easy to set that up.

[00:01:17]So, for example, like this. And depending on your setup, LM Studio will actually tell you what's the best model to run. So, you can see, for example, here, it doesn't recommend using these models cuz it says likely too large, but you could run a more lightweight model, like, for example, this. And the other thing is that's important to note here is with LM Studio, you get quantized versions of the same model, which means that you get more lightweight versions of the model that are still powerful for running as a local AI. And then you can also use Hermes offline as well. That's the other benefit here. So, we can download Gemma 4, like you can see here, and this is a super small lightweight model, but I just want to show you as an example of how you can get that set up.

[00:01:57]And then, what we can do from there is we need to start LM Studio, right? Like this. So, all we do to do that is we can go into LM Studio, close that, go to local server, and then we just have to run it, right? So, if we click on running now, LM Studio server is now running locally, right? All we did was we just toggle that bit right here, right? So, we toggle that on. Once we've done that, we just need to load a model onto it as well. So, if we load a model here, we'll just get that model from Gemma 4, which is downloading, right? So.

[00:02:32]Then, we can get this started. Now, once you've started the local server, as you can see right here, we then need to run Hermes agent with LM Studio as a model provider. How do we do that? So, we're going to go to Hermes setup inside terminal here, as you can see, and then what you want to do is complete the LM Studio setup from there, right? So, you see how we've got LM Studio on the models we can select, we can go from there. Bear in mind as well, you can also use this with Ollama, which runs locally too. So, for example, we've got Gemma 4 with Ollama setup locally too.

[00:03:03]You can also plug in the API key if you want to add an API key, and you can just go with the defaults if you want as well. Then, we can restart the gateway to pick up the changes.

[00:03:12]That's basically how we can set this up, right? Now, you can see that Gemma 4 is now downloaded, so we can use that inside a new chat. If we go to the local server here, we just have to load the model, which is Gemma 4. I wouldn't recommend using this version of Gemma 4, but it's just as an example. And that's basically how you can get this working with LM Studio, and that's basically how you can set this up. And then, from here, if we go back to our terminal, click on done, we can launch Hermes in chat, select model, right? So, we can switch model by typing model, and then we can switch to LM Studio right there, right? So, that's how you can switch to LM Studio, and then we would select Google Gemma 4 inside the studio there.

[00:03:51]Pretty easy to set up with Gemma 4. It will also tell you what the context window is, the provider, the model you switch to. You can have multiple different models with LM Studio 2. Now, if we wanted to run this locally with Ollama as well, let me show you how to do that. And again, like inside LM Studio, I don't recommend using that version of Gemma 4. Just wanted to show you a quick way of how you can pick the model, load it in the server, and then from there, connect that to LM Studio, right? That's an example. But some of the best options that you can do here for this sort of stuff is like GLM 4.7 is pretty good. And there are actually some local models designed specifically for Hermes, right? So, for example, you can see a bunch of like Nous Research models here. Nous Research is the founder of Hermes Agent, which means these are some of the best models you can run locally with these agents, right? Also, you could run something like Aquen. Aquen is pretty good as a local model. I would use Aquen 3.5 for that. And they also have some lightweight model versions, as you can see right here. So, Aquen 3.5 9B, 35B if you've got a good setup, etc., right?

[00:04:50]So, that's basically it. And then if you wanted to configure this with Hermes using Ollama as a local model setup, you can go over here, Ollama Cloud. You can plug in the API key if you want to use the cloud method, method, and then from there, you're good to go. That's how you can run it. So, just to recap on this whole process, you can now run powerful free AI agents like Hermes on your own computer with no internet, right? Using LM Studio. LM Studio is a free app you can install. It lets you download and run powerful AI models. You have to have a good setup for this to work, but it will work on Windows, Mac, and Linux. I do this on a Mac Studio. Honestly, I prefer like cloud-based models, but if you do want to know how to use LM Studio, this is where you can do it. And you might be wondering, "Okay, how does this work together?" So, LM Studio acts as an engine. It runs the AI model on your computer, and Hermes engine agent acts as the driver. So, it tells the AI what to do, and gets tasks done for you.

[00:05:43]So, together, they create a local, fully private, fully free AI agent system.

[00:05:48]Now, why should you care? It's free, it's private, it's fast as well, right?

[00:05:53]And it works offline, right? So, if you're like on a plane or something like that, you can still use Hermes, and you can still get the most out of it, which is pretty cool. So, some examples of models you could use that could be like the Quen 3 series, could be a deep sea coder, llama as well as another one. And if you want to set it up, we've got a step-by-step guide right here and a full road map on how to implement it. And what we'll do is I'll put that inside the AI Profit Bot. And we'll add the video tutorial as well inside there. But that's the full guide on how to use it, how it works, why you care, how to set it up, plus a 30-day road map for implementing it into your business. Now, inside the AI Profit Bot, we add like new daily tutorials, full step-by-step guides on how to use all this stuff, which is pretty amazing. You also get all of my best trainings on AI SEO, how to go from beginner to expert with AI automation, my best trainings here, all the systems I use inside my business, and a full course for agencies and how to get clients as well. So, feel free to check that out. Link in the comments description or go to the AI Profit Bot.

[00:06:45]This is my community that's focused on helping you grow and scale with AI automation. Inside the community, you can ask questions, get help and support whenever you need to. Inside the classroom, you get my trainings. In the calendar, you can jump on weekly coaching calls and get help and support whenever you need to. And also, inside the map, you can connect with people in your local city who are also using AI agents just like you. So, feel free to check that out. Thanks for watching.

[00:07:06]I'll see you in the next one. Cheers.

[00:07:08]Bye-bye.