virtuallyvivek

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. We prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: [email protected]

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity. Role info: https://gentrace.ai/eng Email: [email protected]

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: [email protected]

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco) Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile:

- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.

- 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: [email protected]

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet and Webflow systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile:

- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.

- 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng

When building evaluation infrastructure for generative AI systems at Gentrace [1], we needed a task queue that could handle thousands of tasks per day while remaining simple to self-host.

We considered traditional options like RabbitMQ and Kafka but wanted to avoid the operational overhead for our self-hosted customers. That's when we turned to PostgreSQL.

Using PostgreSQL's FOR UPDATE SKIP LOCKED, we built a task queue that supports retries, parallelism, and large payloads, all without adding new infrastructure. Sometimes, PostgreSQL really is all you need!

It's been running in production at Gentrace, handling 8-10k tasks daily with peaks of 45k during large-scale evaluations. The architecture is simple, reliable, and easy to maintain.

We decided to open-source a version of this implementation as Simple Task Queue. It includes:

- A task queue built on PostgreSQL - Type-safe task definitions and scheduling in TypeScript - Support for retries, parallel processing, and scheduled tasks

We also wrote a deep dive about how we built it on our blog: https://gentrace.ai/blog/task-queue-simplification

We'd love feedback! Try it out, and let us know how it works for you.

- Vivek

[1]: https://gentrace.ai/

Excited to give this a try! A visual environment seems like a natural fit for chained LLM calls.

Have you considered supporting OSS LLMs? Inference servers like LocalAI or vLLM expose APIs for various OSS models with OpenAI-compatible endpoints, so might not be much more work to integrate.

Gentrace co-founder here.

That's an interesting use. We don't have that currently, since we haven't had anyone request workflows only using our evaluators as a service.

That said, we would like every part of our application to be controllable through API requests eventually, which would naturally support your use case.

Would you be open to diving deeper into your requirements? The best way to reach us is at [email protected]

JavaScript and the library is Observable Plot

Link: https://observablehq.com/plot/

Cool - I'm glad to see more tech similar to Firebase pop up that's self hosted.

The big request would be mobile. I mostly use FB for the web but knowing that I could create a mobile version using the same platform would be great.

Yeah... the idea was that urgent meant a site outage or customer P0. I'd like to think that would qualify, no?

Thanks ydb! Small world but that status would have been super relevant for me today :)

I experienced something similar with Electron applications too. If you're an Electron dev, do NOT handle authentication within Electron. Handle it in their default browser.

"We don’t want to get back to judge people by how much time they spend working, but by the quality of their output."

Super important to mention this when advocating for more team building. If anything, remote workers have a tough time unplugging.

Ooo, that's definitely an interesting idea. Might be interesting to see if there's publicly available data for the largest companies that are active in that area.

An observation mostly! We definitely plan to add more graphs and charts comparing those two factors directly in the future!!

Stay tuned :)

Thanks so much :) We're excited for the results.

Eek, that's not good! Would you mind sending me a screen capture at [email protected]? Sorry about that!!

Yep, Asana was on the right hand side and Pragli was on the left.

Made it a bit easier to screen capture!