Show HN: Mastra – Open-source TypeScript agent framework

Re:Show HN: Mastra – Open-source TypeScript agent framework by Gakho on Wednesday February 19, 2025 @12:56PM (#43105129)

Congrats on launching. I've noticed that switching prompts without edits between different LLM providers has degradation on performance. I'm wondering if you guys have noticed how developers do these "translations", I'm wondering since maybe your eval framework might have data for best practices.

[ Parent | on HN ]

Re:Show HN: Mastra – Open-source TypeScript agent framework by calcsam on Wednesday February 19, 2025 @01:06PM (#43105240)

Yeah, this is something we've heard as well. No particular feature right now but we did ship an agent in local dev to help people improve their prompts.

[ Parent | on HN ]

Re:Show HN: Mastra – Open-source TypeScript agent framework by Gakho on Wednesday February 19, 2025 @01:10PM (#43105291)

I'm wondering since there seem to be a lot of frameworks/websites that support evals, even OpenAI has evals.

Do you think that a lot of these components like observability and evals will eventually be consumed by either providers (like OpenAI) or an orchestration framework like Mastra (when using multiple providers, though even if you're using just one provider for many tasks I can see it belonging to the orchestration framework)?

[ Parent | on HN ]

Re:Show HN: Mastra – Open-source TypeScript agent framework by calcsam on Wednesday February 19, 2025 @01:49PM (#43105807)

I could be wrong but don't think OpenAI wants to be opinionated about that, except maybe the OpenAI solutions engineers :)

[ Parent | on HN ]

Re:Show HN: Mastra – Open-source TypeScript agent framework by swyx on Wednesday February 19, 2025 @01:30PM (#43105556)

link to this agent?

[ Parent | on HN ]

Re:Show HN: Mastra – Open-source TypeScript agent framework by calcsam on Wednesday February 19, 2025 @01:40PM (#43105688)

demo: https://x.com/calcsam/status/1889856384549982419

[ Parent | on HN ]