News for hackers. Stuff that matters.

davidz

no reasons to put open stack in quotes. code available under Apache-2 https://github.com/livekit/livekit

Show HN: Serverless platform for running voice AI agents

https://blog.livekit.io/deploy-and-scale-agents-on-livekit-cloud/

Over the past year, we've collaborated with hundreds of developers building voice AI agents using our Agents SDK. It quickly became apparent that hosting these persistent, session-based workloads is a world apart from traditional HTTP servers. We fielded the same questions repeatedly:- How do I size CPU/memory for unpredictable session lengths?- What's the best way to autoscale without...

( Read More... | no comments | on HN )
Re:Type-constrained code generation with language models on Wednesday May 14, 2025 @01:02AM (#43981011)
thanks for the feedback. let us see how we can organize this better for compat with diff LLMs.
It's really cool to see how you guys are using the voice AI stack to overcome language barrier.

(btw I work at LiveKit, so let me know if we could make Agents easier to use for your use case.)

currently we are using silero VAD to detect speech: https://github.com/livekit/agents/blob/main/livekit-plugins/...

it works well for voice activity; though it doesn't always detect end-of-turn correctly (humans often pause mid-sentence to think). we are working on improving this behavior.

I'm working on a PR now :)
Currently it does: all audio is sent to the model.

However, we are working on turn detection within the framework, so you won't have to send silence to the model when the user isn't talking. It's a fairly straight forward path to cutting down the cost by ~50%.

only if you buy enough tokens.
Re:Cloudflare Calls on Tuesday September 27, 2022 @12:09PM (#32997255)
Speculating here, but I would read this as "anycast" as a concept, where each user is connected to the closest location. versus anycast as in the IP protocol. The complexity far outweighs benefits with routing each UDP packet to different servers within the same session.
Thanks Roshan!
Arcas is fantastic! They are doing some really great work with WebRTC.
Re:An Introduction to WebRTC Simulcast on Tuesday September 21, 2021 @12:40AM (#28602092)
> However, it's still a lowest common denominator solution with respect to what codec is being used. The broadcasting "peer" has to send using a codec that every other peer supports. Essentially that means you're stuck with the lowest common denominator codec.

This is correct, though I wouldn't call them "inferior codecs": all WebRTC capable browsers support both H.264 and VP8 as required by the specs.

Re:Can we all stop using Medium now? on Friday May 17, 2019 @01:32AM (#19936605)
It's fine to dislike Medium and run your own blog, but I find the article intellectually dishonest in comparing Medium to Facebook. One harvests your data and lets advertisers target you with ads, the other charges a subscription to provide access to content.

It's disingenuous to claim they "sell whatever advertising they please", and link to a ToS screen cap that's completely unrelated.

Companies have to make money in order to pay their developers and pay for servers. Personally, I'd rather pay them instead of seeing ads plastered everywhere.

"How quickly can we get this into people's hands? If you read the papers, you see maybe it's three years, maybe it's thirty years. And I am here to tell you that honestly, it's a bit of both."

This statement is based on what he is aware of at the time. The most pessimistic side of it is purely a data game, and Tesla's ability to have 100k cars collecting data for them will give them a significant advantage to accelerate their progress.

Re:Master Plan, Part Deux on Thursday July 21, 2016 @01:39AM (#12134976)
The product isn't solar panels, it's energy. With a huge fleet of electric cars needing to be charged in major metros, where is the electricity coming from?

What if you also have a massive deployment of solar panels on top of existing real estate, that you essentially don't have to pay rent for?

When Teslas are autonomous, and owners are using them to make money by giving other people rides. How are these cars getting charged? And that energy doesn't come for free. Tesla will have their hand in every piece of transportation.

Re:Ask HN: Who is hiring? (September 2013) on Friday September 13, 2013 @02:32PM (#6382232)
Voxel (Palo Alto, CA) - Local

We run mobile apps in the cloud (virtualized) so you could use them without first downloading the binaries. Help us change how people create and distribute mobile apps.

We are a small team, and are looking for a couple of hackers to join us. Competitive salary + equity. http://voxel.com/jobs

Server Scaling Engineer

* You love building & scaling distributed systems

* You've built systems that serve millions of users

* You have managed production systems and had the joy of seeing it go down unexpectedly... at 2am in the morning

Systems Engineer

* Help us build the virtualization platform that powers Voxel

* You are good with low level programming and speak fluent C

* You enjoy solving hard problems with creative solutions

Re:Voxel virtualizes mobile apps to disrupt mobile advertising on Monday September 09, 2013 @09:49PM (#6357563)
Thanks, we do as well. However, we'll remain very focused on ads initially to bring it to the masses.
Re:Show HN: Private RubyGem Server on Thursday February 09, 2012 @02:29PM (#3572629)
Re:Ask YC: YC (Dropbox) vs YC (ZumoDrive)? on Saturday January 17, 2009 @08:56PM (#438890)
We are looking to support Linux soon :)
Re:ZumoDrive is going to change everything on Saturday January 17, 2009 @02:44AM (#437870)
Even though cloud storage is getting cheaper, it's still not as cheap as off of the shelf hard drives (yet). But then again, you can't access your hard drive from anywhere, and it's not stored at geographically different locations.

Then when it comes to your mobile devices, sometimes it's not possible to add additional capacity. You are paying for something different than a hard drive. Cloud storage will get cheaper, just as the harddrives have

There's a code for all news.yc readers (good for 200)

newsyc or http://www.zumodrive.com/invite/newsyc

Dell,

We are going to be sending out the iPhone app shortly. This takes a bit of time unfortunately, but you will hear from us soon.

Other than the usability differences, the underlying technology is significantly different. ZumoDrive uses its own file system layer instead of WebDAV(what most drive services use). What this means for the user is that the drive is a lot faster to access, and it supports things like streaming & random access of files.

Older »