News for hackers. Stuff that matters.

brandoncarl

With purely quadratic attention, the cost of the token at 372K is 87% more than the token at 272K.

There are attention mechanisms that help to mitigate this, but you can clearly see in the chart that Tibo posted that the attention mechanisms they are using are still scaling quadratically.

This becomes an optimization problem for token t:

min f[cost, quality loss] = compaction cost[t] + compaction quality loss[t] + token cost[t]

HN -

The topic of LLM jailbreaking is an important one. As machines increase in power their ability to benefit society increases, as does their ability to harm society.

This paper intends to address the question: "Is it possible to create a perfect universal guardian against LLM jailbreaks?". This means:

Universal: applies to all prompts and input combinations Perfect: is able to successfully distinguish harmful versus not harmful Computable: is feasible to compute We show that this combination does not exist and Request for Comment.

A more feasible approach involves post-hoc filtering of results, which involves an easier problem of decideability. In order to implement such approaches, both reasoning traces an intermediate code changes would likely need to be hidden from the user until the results are determined.

Note: this paper was written in conjunction with ChatGPT 5.5 Pro. The topic of the reducibility of such problems to The Halting Problem has been top of mind for me for some time. In one sense, it is a trivial conclusion. Yet it is one of high importance.

Re:Markdown DOM Spec for LLMs: Request for Comment on Wednesday February 25, 2026 @01:02PM (#47155170)
Markdown has emerged as the "lingua franca" of LLMs. It is structured enough to convey meaning, and yet readable everywhere.

However, as document lengths increase: 1. It is wasteful to put the entire context in memory 2. It can reduce accuracy by providing less relevant information 3. Increase the possibility of errors during edits

Inspired by Cloudflare's Markdown Content Type and Code Mode, we propose a lightweight document object model for Markdown to: 1. Reduce costs 2. Increase the accuracy of locating key sections 3. Increase speed 4. Increase the accuracy of editing documents

https://github.com/brandoncarl/markdown-dom

Re:Ask HN: Economy Simulator on Monday July 04, 2022 @12:15PM (#31978680)
Thank you

Ask HN: Economy Simulator

Given that we are in unprecedented economic times, a fantastic economic simulator would be very valuable.Not because it would be correct. Rather because it could potentially identify high probability situations we haven't thought of.What are the best projects of the kind that you're aware of? Does anyone know how this is done at the Federal Reserve?

( Read More... | 6 comments | 5 points | on HN )
Re:Webcams aren't good enough on Sunday June 19, 2022 @09:02PM (#31805120)
I used this for the camera angle. Works really well.

https://www.amazon.com/gp/product/B07F1DB2F7/ref=ppx_yo_dt_b...

On timing – I just had to start planning a bit better. In worst case I'd start the meeting without video and turn on a minute or two in. Well worth it for me.

Re:Webcams aren't good enough on Sunday June 19, 2022 @05:31PM (#31803718)
I use Camo (lifetime $79 license) and an iPhone SE I picked up on eBay for $200.

I've had dozens of people comment how clear my camera is. Many now purchased a similar setup. I used OBS for a long time since it was free, but the quality wasn't close.

If you're in a line of work that requires you to stream it's a worthwhile investment by a great company that just keeps getting better.

Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @12:52PM (#31728133)
This is the closest. https://assets.ctfassets.net/vyse88cgwfbl/1np5dpcwuHrWJ4AgUg...

As you can see, the rates don't map to any significant overcollateralization.

Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @11:52AM (#31727248)
You're absolutely right regarding from market highs.

To do this correct you'd need purchases and sales versus assets.

All that said, it's why I put a rough estimate of 30% (instead of 60%) and hadn't included any losses in broader commercial paper (which has dropped). So the overall estimate is defensible.

Also agree on Basel 2-like risk. The primary issue with Tether is the marketing around stability and the transparency. If it was treated like any other "money market" with better NAV reporting, position reporting and rules around withdrawals then we'd mitigate some of the risks.

Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @09:05AM (#31724979)
Important to note that a currency peg is different than a currency. The latter free floats, the former does not.
Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @09:04AM (#31724965)
Investments were this way in the 1800s and early 1900s.

A lot of protections have been put into place since then. There's a reason we prosecute Ponzi schemes, offer FDIC and SIPC insurance, stress test banks, etc.

Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @09:03AM (#31724945)
I follow your theory, but as of the last audit that wasn't close to true.
Re:Tether is starting to depeg from USD again on Monday June 13, 2022 @08:15AM (#31724383)
Tether's underlying assets are almost certainly worth less than $1. You can see this by taking each asset class and marking it to market.

I've provided details here: https://twitter.com/brandonjcarl/status/1536310742261047296?...

By itself that's not enough for Tether to "fail". It does mean that the asset is in a position of very high risk and subject to a run.

It's fantastic to see great research combined with great tutorials – bravo. You all have bitten off an incredibly hard problem with pragmatism and tenacity. Keep up the great work.
To the authors: did you any of your own recordings? I've used my own and clips online, in WAV and other formats, at various sampling rates.

All of the results come back gibberish. The results in the training data seem just fine. Curious if you've tested the above to ensure it didn't overfit.

Earning per share....
Re:Ask HN: Is Energous' Wireless Charging Legitimate? on Tuesday February 23, 2016 @07:47PM (#11163626)
As I understand they do have a working prototype. I believe their chip is 3mm and works in pockets, etc. There's been so much hype, so little delivered in this area that I'm finding it hard to sift the wheat from the chaff.

Ask HN: Is Energous' Wireless Charging Legitimate?

There's obviously been a lot of buzz around wireless charging (see uBeam and Witricity). These guys have been addressed in years past on HN, but given rumors swirling around potential Apple integration would like an intelligent discussion around Energous' technology/patents. It appears to me that they are utilizing the RF portion of the spectrum (as opposed to the sound waves that uBeam...

( Read More... | 4 comments | 3 points | on HN )
Re: on Thursday February 11, 2016 @12:01PM (#11081359)
Re:“Discuss latest changes to master before releasing” on Thursday February 19, 2015 @10:19PM (#9078718)
Via the Lodash CLI you can "lodash underscore". This results in 6.7kb gzipped. In my experience, jdalton is a very solid coder and the lodash package is excellently maintained.
If anybody has interest in working on some of the Econ-related issues, please tweet me at @brandonjcarl
Re:My Resume Is Total Fiction on Friday January 02, 2015 @01:15PM (#8827793)
How can you possibly say "no offense" and then proceed to make fun of somebody? Simply using that phrase doesn't make it any more ok.
Re:Instacart (YC S12) Scores $220M Investment on Tuesday December 30, 2014 @06:10PM (#8817278)
Obviously hard to tell, but you can extrapolate a bit.

At $100mm in revenue, and an assumed $60 order price, you've got 1.6mm orders. Assuming 25% of people pay for faster delivery, you've got gross revenue per order of $4.50, or gross revenue of $7.2mm. If Instavart takes a 30% share (similar-ish to Uber and iTunes), you're looking at $2.2mmin revenue after paying contractors.

So that would leave you with 2.2% of sales as your margin after contractors. This obviously changes if they mark up the groceries or if the assertions are different.

Out of interest, a 15 P/E on 2bb would correspond to a 60x grow in their market (ish). They currently represent about 100mm of Whole Foods 15bb take, or about 0.67%. A 60x increase would take them to managing 40% of Whole Foods orders, given no expansion into other grocery chains.

This is a lot of hand-waving, so please take it with a grain of salt.

Re:Apple's Ship has Sailed: there is no “next” iPhone on Tuesday September 16, 2014 @08:05PM (#8327792)
Yes, Tim Cook's an operational genius. However those cell phone plans are starting to change, which I think makes things a bit more complex for Apple.

Older »