Ability to set (and save) system contexts is critical. It's unclear to me why most apps don't enable this.
I can't get by without Machato's other innovation of suppressing earlier parts of the history I no longer need later in the conversation, making it straightforward to have 64k interactions with the 8k model.
Ability to fork and file conversations, as well as the cost monitoring, are gravy.
Honestly, this is my first macOS app and I'm a bit out of ideas when it comes to performance. If anyone has tehcnical knowledge about SwiftUI and how I could improve performance, please do contact me ! ([email protected])
My experience has been that the SwiftUI Profiler shows that almost all processor time is spent deep inside SwiftUI/AppKit primitives, despite there being close to no updates to view properties.
I'm glad HN is enjoying the app despite those issues. I promise I'm doing my best !
Edit: had a closer look, it's a multi-app for different AI chatbots. Fun, but not at all what I'm looking for (responsive Mac interface to OpenAI API).
Release the app outside the store? Fuck apple and their monopoly abuse control system.
So far I've been using Machato (https://untimelyunicorn.gumroad.com/l/machato), which has the perfect feature set for me, but despite its claims of being a native app, is just infuriatingly slow. You can't at all scroll in the app while it's producing text, and switching between conversations feels worse than using Slack.
So the search continues. What makes it so hard to produce a responsive native app, that there are so few of them out there?