News for hackers. Stuff that matters.

lajamerr

You can tell an agentic system. "Go and find a novel area of math that has unresolved answers and solve it mathematically with verified properties in LEAN. Verify before you start working on a problem that no one has solved this area of math"

That's not creative prompt. That's a driving prompt to get it to start its engine.

You could do that nowadays and while it may spend $1,000 to $100,000 worth of tokens. It will create something humans haven't done before as long as you set it up with all its tool calls/permissions.

LLMs by themselves are not able to but you are missing a piece here.

LLMs are prompted by humans and the right query may make it think/behave in a way to create a novel solution.

Then there's a third factor now with Agentic AI system loops with LLMs. Where it can research, try, experiment in its own loop that's tied to the real world for feedback.

Agentic + LLM + Initial Human Prompter by definition can have it experiment outside of its domain of expertise.

So that's extending the "LLM can't create novel ideas" but I don't think anyone can disagree the three elements above are enough ingredients for an AI to come up with novel ideas.

Re:Scalable MatMul-Free Language Modeling on Sunday June 09, 2024 @02:09PM (#40626295)
So a mishmash of ideas from other papers(Not to downplay the results). This is exciting times of hackery and basically using puzzle pieces and piecing together stuff.

This is the kind of stuff that can only be done so quickly by having more and more people brought into the field to try these ideas out. The more people the more permutations of ideas.

128 bits*
Re:SSH3: SSHv2 using HTTP/3 and QUIC on Saturday December 16, 2023 @11:19AM (#38665351)
I assume he means with the encrypted metadata in HTTP/3 / QUIC that it makes it harder as a security admin to "peek" at what is going on in the network.

In my opinion its short sighted, because if we care about security, then we should care about user security and privacy as well. Because if the security admin has the ability to packet inspect stuff, so does a potential malicious app.

Change up the model. That allows it to see previous frames and 1-2 future frames.

Then train the model on movies that are color and then turn them black and white.

That way you can train temporal coherence.

Re:Hackers manage to unlock Tesla software-locked features on Thursday August 03, 2023 @05:56PM (#36992561)
Probably the same sentiment between DLC vs Expansions in gaming.

But fundamentally no difference because you are getting a discounted price in exchange for the soft locked feature. So 2 and 3 are the same imo.

For context Terence Tao is often referred to as one of the greats of modern mathematicians of our time.

He also has a Mastodon account where he sometimes goes over the implications of LLMs and in this post is his musings of how he sees it's current potential and possible impact in the near future for mathematics.

"The 2023-level AI can already generate suggestive hints and promising leads to a working mathematician and participate actively in the decision-making process. When integrated with tools such as formal proof verifiers, internet search, and symbolic math packages, I expect, say, 2026-level AI, when used properly, will be a trustworthy co-author in mathematical research, and in many other fields as well."

Re:Emergent Mind: AI News, Curated and Explained by AI on Wednesday March 29, 2023 @11:11AM (#35358404)
Thanks, I just hope this is sustainable. I like newsletters and the site design is simple and basic. I hope there's some way you can set up like a monthly contribution of like $1-$5 to pay for some of the hosting/API costs.

The main concern though for me is long term vision for the site. I'd really like it to stay user/community oriented and hopefully the users can pay for the costs with donations/contributions.

AI can efficiently teach your daughter how to solve math problems, but as a human, you can provide her with the context and understanding of why and what she's learning. AI is great at handling the technical aspects, freeing us to focus on cultivating our uniquely human qualities of empathy, creativity, and critical thinking. Letting the AI teach the how and the human teach the why and what can lead to a more holistic and enriching education.
Re:Using AI tools to design an entire website on Sunday February 19, 2023 @09:00PM (#34864134)
Me with not much background experience in programming not knowing what RoR stood for.

Me asking ChatGPT:

In this context, RoR most likely refers to Ruby on Rails, which is a web application framework written in the Ruby programming language. The second comment is suggesting that people had similar dismissive comments about Ruby on Rails (RoR) when it was first introduced, but it has since become a widely used and respected framework in web development. The comment implies that similar trends may apply to AI tools used for web design.

I wouldn't necessarily say it learns how a human would. But instead learns how an arbitrary brain would.

There's all kinds of brains in this world from all kinds of life. A dog can learn. A cat can learn. And they don't learn like a human would.

Even though Whisper advertises the translation part of it. I honestly wouldn't say it's a first class feature at least part of the Whisper model itself.

The only thing I'd use Whisper for is transcription part of it. Then use ChatGPT for the translation.

Most big AI is trained on Nvidia GPUs but usually not the standard consumer ones found in the GeForce line-up. Instead it's usually their data centre GPUs like the current A100 or soon to be H100 that's just hitting the market.

Google does have their TPUs(Tensor Processing Units), however it is not cost efficient budget wise, so unless you have some kind of deal with Google or compute credits it doesn't make sense. They have pods upon pods of TPU clusters though so the main selling point of TPU training is that you can get your training done really fast with just the ease of scaling your workload to more TPUs.

So if you needed a big model like GPT-3 trained in a single day, you could spend an ungodly amounts of money and get it done with Google TPUs. Otherwise if you can wait weeks or months you can go with the standard Nvidia data centre solution and it'd be cheaper at the end by a significant margin.

Re:The next decades might be wild on Saturday December 17, 2022 @12:42PM (#34030126)
The article was written by Marius Hobbhahn.

Here is his public bio to gain a sense of his perspective.

https://www.mariushobbhahn.com/aboutme/

>I'm currently doing a Ph.D. in ML at the International Max-Planck research school in Tübingen. My focus is on Bayesian ML and I'm exploring its role in AI alignment but I'm also exploring non-Bayesian approaches. I want to become an AI safety researcher/engineer

Re:I Asked ChatGPT to Explain Some Jokes to Me on Saturday December 17, 2022 @11:34AM (#34029284)
This post is funny because the author uses ChatGPT to explain the joke in the title, which is that ChatGPT can't explain the jokes. But then, the comment written by ChatGPT itself tries to explain why the joke in the title is funny, but in doing so, it just further highlights the fact that it can't understand the jokes. It's a never-ending cycle of AI attempting to understand humor, but ultimately failing and adding to the joke itself.
Re:John Carmack Leaves Meta on Saturday December 17, 2022 @11:12AM (#34029014)
Let's say we have 2 people in two different walks of life. Jim and Alice.

Both of them are entrepreneurs and like doing startups. Both of their goals are to take a startup from idea to $1 Billion+ IPO in 2 years and exit and then start the next start-up. If they don't reach 1 Billion IPO they just exit.

After 20 years. Jim and Alice have both attempted 10 startups.

Jim has reached the goal 2 out of 10 times. While Alice has reached the goal 8 out of 10 times.

Would it be a fallacy to bet on Alice if you had to invest in either Jim or Alice's startup?

Re:The Gates of Argonath from the LotR in VR 50 FPS Using UE5.1 on Thursday December 15, 2022 @07:13AM (#33998323)
I'd like a version of Tokyo that is hyper detailed and functioning transit system/lines.

Spend a week preparing for a trip on how to navigate the city before actually going.

Glad to hear you are working on such a project. There definitely will be a lot of privacy concerns in any such project so it may be difficult to open source the data to broad public.

But could still be useful to research institutes who follow privacy guidelines.

It might be best to do a short stint of 1 week to test the feasibility. That should give you a good estimate on future projections of how much data it will consume after a month, 3 months, and a year.

I imagine any intelligent system could work with reduced data quality/lossy data at least on the audio.

As long as it's consistent in the type/amount of compression. So instead of WAV/FLAC/RAW. You could encode it to something like Opus 100 Kbps and that would give you 394.2 Gigabytes of Data for a single year for the audio.

As for video... it would definitely require a lot of tricks to store on a hobbyist level.

There's value in redundancy and continuous stream of images where one follows the other.

It would be nice to have a dataset of a couple "raising" a Video recorder for 1 year as if they would a baby. A continuous stream of data.

Could train a model to predict the next frames based on what it's seen so far.

While impressive number of images today. I believe this will be an underwhelming amount of images compared to what models are trained on in the future.

This is an incomplete analogy but from the time a baby is born that baby will have seen 1,892,160,000 frames of data per eye 3,784,320,000 frames in a year. That baby practically knows nothing about the world still.

Re:JPEG XL support has officially been removed from Chromium on Saturday December 10, 2022 @10:40AM (#33933501)
Can't really consume it if it's locked behind a flag. 99% of chrome users never touch the flags at all.
Re:Ask HN: Are Protonmail.com Addresses Snubbed? on Monday December 05, 2022 @08:07PM (#33874462)
Just make your own personal email address/domain.

I already have my domain firstlastname.com with Google domains. I can setup email forwarding for free. All goes to my gmail address.

As far as normal people their reaction was "That's cool you have your own email like that"

What is loneliness people speak of? I am alone and I don't feel like I am missing out on anything. I am happy and content. I have fun. I am fine just entertaining myself or going out to do things. I'd say I am by myself 95% of the time of every day.

Is loneliness related to depression?

I would. But in general I would consider anyone a founder of a company if they had a significant impact before the companies first product/service went general availability to their target demographic.

If they already had a general release of product or service. I wouldn't consider them a founder if they joined afterwards.

The next step after is to build an AI to convert your style of writing to another person's style.
Re:MDM: Human Motion Diffusion Model on Friday September 30, 2022 @02:36AM (#33031685)
https://iclr.cc/

The conference for reference

Re:Show HN: Invest in Airbnbs Like Stocks on Friday September 09, 2022 @12:28PM (#32781315)
I was wondering so as well. I went through entire sign-up process and did not see a place to enter a code.

Edit: There seems to be a gift code when you try to invest in a property but the code hackernews is not a valid promotional code.

So it would be nice to get clarification on where this code would be put in.

Aside this seems like a cool platform. I know some people will be cynical and call out the housing crisis as a issue.

In some cases it's justified. But if I just want to invest in a rural house in Arizona that is used as a vacation spot, what's the issue with that?

Older »