News for hackers. Stuff that matters.

CastFX

Looks super promising! A couple of questions:

For new open weights models, will you need to adapt model code and optimization for your inference engine by hand?

It's true that BS=1 is king when it comes to agentic workflows, however these kinds of system serve multiple requests concurrently with dynamic batching. Do you think it will scale as well ?

Any plans to release it open source?

Congratz again for the release

As ADHD dev that thought about something similar (but never worked on it) I'd love to see the code. Please make a post when you intend to release it as opensource, it seems super interesting
Re:Tell HN: You owe it to yourself to understand nutrition on Saturday July 05, 2025 @01:05PM (#44474045)
> It takes very little energy to digest fat, a moderate amount for carbs, and a high amount for protein.

Carbs are the easiest to digest, proteins and fats are the hardest. That's why they make you feel satiated for longer.

However fats are more calorie dense (9kcal per 1g, vs 4kcal per 1g of proteins/carbs). Which means, if you're not careful, you can binge eat fats more easily (I can consume 1000kcal of almonds without even noticing).

Re:Ask HN: Who is hiring? (March 2025) on Monday March 03, 2025 @11:02AM (#43243044)
iGenius.ai | Senior AI/Software Engineer, MLOps Engineer, Senior AI Research Scientist and more | Full-time | Remote (US, Italy)

We recently released our biggest model yet, Colosseum-355B (MMLU 5-shot: 82.04), and we've become the first AI Unicorn in Italy, last summer.

We're also creating our own $1B supercomputer of 115 exaflops (FP4), around summer 2025. https://www.reuters.com/technology/artificial-intelligence/i...

Our goal is to enable anyone to explore company data and ask business questions in natural language. We are committed to making data analysis accessible, secure, and private, supporting businesses in highly regulated sectors.

Our tech stack is

- Backend: Python (FastAPI), Typescript (Fastify)

- Frontend: React, Swift/Kotlin

- Infra: K8s, Terraform

All open roles @ https://apply.workable.com/igenius/

Don't forget to mention that you came from HN in your application!

Re:Ask HN: Who is hiring? (February 2025) on Monday February 03, 2025 @01:16PM (#42921106)
iGenius.ai | Senior AI/Software Engineer, MLOps Engineer, Senior AI Research Scientist and more | Full-time | Italy (Remote)

We recently released our biggest model yet, Colosseum-355B (MMLU 5-shot: 82,04), and we've become the first AI Unicorn in Italy, last summer.

We're also creating our own $1B supercomputer of 115 exaflops (FP4), around summer 2025. https://www.reuters.com/technology/artificial-intelligence/i...

Our goal is to enable anyone to explore company data and ask business questions in natural language. We are committed to making data analysis accessible, secure, and private, supporting businesses in highly regulated sectors.

Our tech stack is

- Backend: Python (FastAPI), Typescript (Fastify)

- Frontend: React, Swift/Kotlin

- Infra: K8s, Terraform

All open roles @ https://apply.workable.com/igenius/

You can also contact me on my work email, you can find it in my HN profile

Re:Never fail a technical interview again on Saturday December 07, 2024 @05:21AM (#42348727)
I agree but a big problem remains. How do you make it scale for 100k applications?
Re:Procrastination and the fear of not being good enough on Monday November 11, 2024 @06:04PM (#42111224)
"Nonviolent Communication" by Marshall B. Rosenberg is a wonderful book (I picked up from HN) that explores this concept very well.

Definitely recommend a read

Re:Ask HN: Who is hiring? (November 2024) on Friday November 01, 2024 @05:17PM (#42021638)
iGenius.ai | Senior Backend Engineer, ML Engineer, AI Research Engineer and more | Full-time | Italy (Remote)

We recently released Italia-9B, an open-source LLM trained from scratch in Italian and we became the first AI Unicorn in Italy.

Our goal is to enable anyone to explore company data and ask business questions in natural language. We are committed to making data analysis accessible, secure, and private, supporting businesses in highly regulated sectors.

Our tech stack is

- Python (FastAPI), Typescript (Fastify) for the backend

- React for the frontend

- Infra on GCP orchestrated with K8s

All open roles @ https://apply.workable.com/igenius/

Re:Ask HN: Who is hiring? (September 2024) on Monday September 02, 2024 @04:28PM (#41428532)
iGenius.ai | Senior Backend Engineer, ML Engineer, AI Research Engineer and more | Full-time | Italy (Remote)

We recently released Italia-9B, an open-source LLM trained from scratch in Italian and we became the first AI Unicorn in Italy.

Our goal is to enable anyone to explore company data and ask business questions in natural language. We are committed to making data analysis accessible, secure, and private, supporting businesses in highly regulated sectors.

Our tech stack is

- Python (FastAPI), Typescript (Fastify) for the backend

- React for the frontend

- Infra on GCP with Terraform, K8s

All open roles @ https://apply.workable.com/igenius/

Re:Ask HN: Who is hiring? (August 2024) on Friday August 02, 2024 @04:33AM (#41137092)
iGenius.ai | Senior Backend, ML, AI Research Engineers | Full-time | Italy (Remote)

We recently released Italia-9B, an open-source LLM trained from scratch in Italian and we became the first AI Unicorn in Italy.

Our goal is to enable anyone to explore company data and ask business questions in natural language. We are committed to making data analysis accessible, secure, and private, supporting businesses in highly regulated sectors.

Our tech stack is

- Python (FastAPI), Typescript (Fastify) for the backend

- React for the frontend

- Infra on GCP with Terraform, K8s

All open roles @ https://apply.workable.com/igenius/

Re:How to summarize YouTube videos using artificial intelligence on Wednesday February 14, 2024 @09:16AM (#39369999)
I just get

"I don't have enough information to do that. I'm a large language model, able to communicate in response to a wide range of prompts and questions, but my knowledge about that specific video is limited. Is there anything else I can do to help?"

Re:Show HN: Natural-SQL-7B, a strong text-to-SQL model on Monday February 05, 2024 @10:56AM (#39262493)
I was wondering how it performs in a more complex (and realistic) benchmark like Bird?

https://bird-bench.github.io/

Re:An open source DuckDB text to SQL LLM on Thursday January 25, 2024 @04:17PM (#39135435)
I'd love to see how it performs in some benchmarks, specifically against Spider (https://yale-lily.github.io/spider) and BIRD (https://bird-bench.github.io/)
Re:Ask HN: Who wants to be hired? (September 2023) on Saturday September 02, 2023 @05:16AM (#37359805)
Location: Milan, Italy Remote: Preferred

Willing to relocate: If in Europe, I can consider it

Technologies: PHP, Laravel, Vue, React-Native/Redux, JS/TS, GCP, k8s. Less proficient but interested in Scala, Rust, Swift...

Résumé/CV: https://www.linkedin.com/in/christian-serra/, https://github.com/CastFX

Email: [email protected]

Hi everyone! I'm Christian, one of the few software engineers from San Marino ! First learner then engineer with 4 YoE. Currently working at Corsi.it, an e-learning platform based in Italy. Here I had the pleasure to work in many different areas: mobile, then web as a fullstack, then a bit of infra. Would love to find a place to specialise more as a backend dev, or even as a SRE.

My other passions include tinkering a bit with hardware and SBCs, some light pentesting with Flipper Zero, code puzzles and writing programs for stuff I need or out of spite.

I'm always amazed by all the brilliant people here in HN and I feel this is the right place to find challenging and fun opportunities!

Maybe it was the 1700 anniversary on 2001? The official founding date is 3 September 301 AD
I live in San Marino, let me chime in!

The historic center, which is called San Marino Città, is a gorgeous medieval town and it's also part of UNESCO heritage. I definitely recommend a trip there, if you happen to be somewhere near.

When I went to school there, I regularly missed the bus so I had the chance of doing a few walks down to my home. It's a bit steep, since the town is located at the top of mount Titano at 700m of height, but it's truly charming.

Re:Ask HN: Who wants to be hired? (August 2023) on Tuesday August 01, 2023 @04:11PM (#36962006)
Location: Milan, Italy

Remote: Preferred

Willing to relocate: If in Europe, I can consider it

Technologies: PHP, Laravel, Vue, React-Native/Redux, JS/TS, GCP, k8s. Less proficient but interested in Scala, Rust, Swift...

Résumé/CV: https://www.linkedin.com/in/christian-serra/, https://github.com/CastFX

Email: [email protected]

Hi everyone! I'm Christian, one of the few software engineers from San Marino ! First learner then engineer with 4 YoE. Currently working at Corsi.it, an e-learning platform based in Italy. Here I had the pleasure to work in many different areas: mobile then web as a fullstack, then a bit of infra. Would love to find a place to specialise more as a backend dev, or even as a SRE.

My other passions include tinkering a bit with hardware and SBCs, some light pentesting with Flipper Zero, coding puzzles and coding for stuff I need or out of spite.

I'm always amazed by all the brilliant people here in HN and I feel this is the right place to find challenging and fun opportunities!

yeah but in the 90s you didn't have a measurable and significant increase in teenage suicides and depression, right?
Independent studies show that it's among the best but not quite on par with medical grade devices. I suggest to have a look at this channel

https://www.youtube.com/watch?v=7m_oBiYk8Rk

Re:Japan Says 1.5M Living as Recluses After Pandemoc on Monday April 03, 2023 @02:28PM (#35428948)
I assume those excess deaths would've come because of the failure of health system and its inability to aid curable cases of Covid
Re:Universal Speech Model on Thursday March 30, 2023 @10:25AM (#35373164)
Have you tried transcripts with swearing? Last time I tried, it censored "shit" with "stuff".

Not ideal, maybe I should've asked to censor with asterisks instead of changing the whole world

Re:EU will require Apple to open up iMessage on Thursday March 02, 2023 @12:04PM (#34998394)
I bet Apple will include a switch (off by default) to allow side-loading. Less tech-savvy folks will not even know how to enable side-loading.
Re:EU will require Apple to open up iMessage on Thursday March 02, 2023 @11:57AM (#34998285)
Mostly all of American iPhone owners
Re:Evernote to be acquired by Bending Spoons on Wednesday November 16, 2022 @02:11PM (#33628794)
Actually this is wrong. They did not receive any funds from the Government. There is an article in Italian with the words of one of the founders.

https://www.corriere.it/tecnologia/20_aprile_22/luca-ferrari...

Re:Merge soon on Thursday September 15, 2022 @02:46AM (#32848002)
Thank you! After having seen so many pessimistic comments about the merge it's refreshing to see someone willing to change its mind.
Re:Advent of Code 2021 on Wednesday December 01, 2021 @02:08PM (#29407802)
I loved day 19 because I managed to use some Automata theory I studied at uni. Something like, I cannot simply use a regex because it's a context-free grammar. Then I learned about recursive regexes and how they could be used to parse a cfg. Aaah fascinating, really.
That sounds a lot of info you managed to extrapolate from this little context.