After Four Months With Hermes It Is Time to Say Goodbye

· 11 min read

Illustration of a girl and a small sleeping robot wrapped in a blanket under an autumn tree, watching the sun set over the hills

Only AI usage here: Hey agent, please introduce some headings to this text, and do not ever and ever change anything. Thanks.

(Yes I have written em dashes by hand)

Finding Hermes

Remember when the idea was new, the always on agent that can help you with your tasks etc, it is the birth of Jarvis, and being an engineer myself, I have always hated bloated software like every js ecosystem, and electron, so I had to do some research to find the best tool for this idea of “AI Assistant”. As we know it was first popularized as clawdbot (renamed as openclaw), then we saw Hermes, and through my research there were countless others like nullclaw, zeroclaw, some written in Rust, some in Zig etc, and at the time I remember all of them were just glorified agentic loops that run as a system service, and at your service the time you texted them, etc, you know the drill. Hermes on the other hand was the first one to come up with the idea of reinforcement thingy, where agent learns from your behavior and writes some skills, and reinforces them based on your use which was great. I installed it the minute I saw it but it was written in Python and was very bloated, but the vibes were there, I liked the onboarding, and some other things about it.

What I didn’t like at first is that, it downloaded a bunch of tools, I remember even though I opted out of computer use, it insisted on downloading the cua tool, it had and still has bloated web/desktop app—desktop app was not there at first though—and some other similar things, but it was open source, it is built by some lovable misfits rather than other dude that sold itself to OpenAI. Whatever.

Just Ask Hermes

I read some things, didn’t know what to do, and saw Teknium on X, writing something like “Just ask Hermes”, and I did “how can I use you”, it was the best experience of the tool itself to let you know how you can use it when you think about it. We created an Obsidian vault, stored our knowledge of our work and chats together, and connected to Telegram since it did not have any mobile app, which was a bummer. After using a bit with docker backend, I liked the way we interacted so much that I went to Hetzner to rent a $5 vps, and Hermes to this day is still living there.

The Setup

The Hetzner box is 2 vCPU / ~4 GB machine. hermes-gateway runs as a user systemd service with restart always. One private Telegram bot, one forum topic per task, and every topic is its own session, so the daily AI news digest never shared context with a job-search thread. The vault syncs with Syncthing, and in November we moved it to a Karpathy-style LLM wiki: raw/ for sources, wiki/ for what the agent writes, index.md and log.md at the root. Cronjobs run in a fresh session and drop a finished note into the vault.

At the time, I was applying for some work, and let me tell you, Hermes was immense help at tracking my applications, preparing me for interviews, creating some questions that may be asked, and helped me through everything there. At every interview I was just recording the interview, transcribing and giving it to Hermes, and it was magically organizing everything, he even created a skill it was something like job-inquiry-help skill, and it was amazing.

My Wife’s Hermes

At the time, my wife was (still is) doing some reviews of skincare products, she was storing everything at Google Drive, writing everything into drive docs, and half managing her content on there, which made me realize that it is one of the best use cases for wiki/graph like knowledge base management. I told Hermes, and at the time Nous introduced profiles, I said should we use profiles or should I create a vps for her, Hermes picked vps, wrote some bash scripts to create her user in vps, downloaded her Hermes app, sent first messages, adjusted Soul and Memory for it, left a little note about how I crafted this with love, and we even put gdrive integration there if she would continue there. Long story short, I gave her the access through telegram, and she has used Hermes 3x more than me, and she still uses it.

The sync btw came from my wife’s setup, I was normally managing my knowledge vault through git, and it was a bit of a hassle for my wife to work with it, she had two computers (one win desktop, one mac laptop) and wanted to share all the files, and chat between her devices, so for ease of use, I have installed Syncthing on all the devices, connected everything, and now there was no reason to use Google Drive at all. This introduced one major caveat and I still hadn’t focused on it to fix it, the media files are too big, I mean images can be tolerated but videos are at least a half gigabyte, so it is shrinking the storage of my beloved vps box (20 GB). Whatever, we can find a way.

Work, Office Files, and Other Tools

After some while, I haven’t changed jobs, my current job nearly turned into documentation where I am leading some people, creating work, documents, working on funding rounds, working with people outside the company both internationally, and nationally, so I have handed every task to Hermes. Since most of the tasks involve Microsoft ecosystem, I am dealing with word, excel, and powerpoint a lot, and I hate hate hate hate hate hate hate hate hate hate hate hate them—except Excel, I love that, I wish it stayed non bloat through the years but. Hermes is capable at those tasks, since LLMs are, but it became a burden to work in those files, and as a frontier person, I always search for new tools, I always try new things, I have used at least 15 different distros and 15 different window managers in the last 5 years, I have tried nearly every harness I can think of, and I have tried some Hermes alternatives as well, and after trying Grok Bot, as probably everyone can agree Hermes felt extremely slow, and unpolished.

Every Door

Every door I tried, 31 Jul to 9 Nov:

DoorSessionsLast used
Telegram189 Nov
Terminal (CLI)249 Nov
Desktop app287 Oct
ACP client288 Oct
Slack522 Sep
Cron jobs229 Nov
Subagents78 Oct

Telegram got the most of my messages (102). Slack lasted eight days, and I only went there because Telegram topics can’t be grouped into folders. The desktop app and the ACP client went quiet in early October. By November it was Telegram and the terminal.

Models and Tokens

The beauty of Hermes comes from being open source, and it led me to swap models however I please (most frontier). Codex gpt-5.6-sol until mid-September, muse-spark-1.3-contributor (yes contributor, it costs 0.10 input and 0.20 output, and it was a smart model) through OpenRouter for the remaining September, Codex gpt-6.1-sol for October, afterward Grok till now. Over 2,883 recorded API calls: about 22M input and 2M output tokens, plus 190M read from cache, roughly 215M in total. The only recorded spend is $1.50, all of it the OpenRouter stretch; the Codex and xAI calls went through account logins and are recorded as $0.

The Old Mercedes

Hermes is like a maintenance thing, it is like an old Mercedes, it is cool to drive but you have to be a mechanic, and understand every part of it, I love how it is open source, and I love Nous Research as well they are the best, but the interactions with Hermes became slow, and Teknium’s latest tweets show that the tool will evolve into a coding harness, and it will probably make Hermes move away from being an assistant, even at the moment, it is packed with tons and tons of things, it became slow, it bugs out a lot, the package itself is big, I tried running web app through Tailscale but ram usage is out of the question, I don’t want to rent 16 GB ram VPS, it uses CPU a lot, it is bloated, and so is the desktop app, and using it from cli is fine for me but we are on an acceleration where Hermes is moving to a different direction than I want it to be.

Resources and Maintenance

With my wife’s media storage, and the numbers of Hermes sessions were becoming big. For the curious, just on my user the Hermes install is 1.7 GB, my ~/.hermes is 4.1 GB. The idle gateway holds about 550 MB of RAM. A headless Chromium it launched on 5 Nov was still running nine days later, over a gigabyte across its processes. And with my wife’s Hermes 3.1 of 3.7 GB is in use, and there is no swap. The gateway log has 40 starts since 22 Sep, 31 of them on that first day. And of the issues with Hermes, from maintenance thing is that, the long running processes such as chromium, old versions of code that lives under ~/.hermes, are just there, Hermes is always running agent, it should clear some of the things but it does not really. I really have to manage that, the agent is not thinking that it should work on its infrastructure, of course this is not Hermes issue at all, it would probably be there on other tools as well.

What Comes Next

I want to assure the reader that I will not use Grok Bot either, I like it, it is nice, but it does not feel mine, Hermes did, it was mine. Grok Bot kills the need for a VPS as well which sounds nice actually, but as someone who likes having a cloud machine, and freedom to do anything inside is great for me, also it needs another subscription as well, so no no. I will probably build my own which I really consider, or maybe try something like Maus Bot, take a look at Open Bot (which I hated way how they work on open source side), maybe Instinct, Muse etc. Or like I said build my own, which is a big hassle and seems to introduce that “maintenance thing” again, but why not right?

What an Always-On Agent Should Have

So if I need to conclude and try to create some statistics at the end like most articles do, these maybe some of the things an always on agent should have for me:

  • Fits on a $5 box with room to spare
  • A chat app as the main door, one thread per task
  • Plain files as memory, so the vault outlives the agent
  • Models swappable without touching anything else
  • Cron as a first-class citizen
  • No browser, desktop app or computer-use tools bundled unless I ask for them

Thanks

I am very thankful that I have met with Hermes, even though I will not use it, my wife will probably continue using it. So thanks to everyone who has even a tiny bit of hand in creating such an app. I will continue following Teknium and Nous Research, they are really best of the best, and may even return to using Hermes time to time, who knows.

Note: This all happened in just 4 months, it is amazing how the sector moves this fast, while writing this, I have felt like all this happen in the span of 2–3 years but yes, it was just 4 months, amazing indeed.