News for hackers. Stuff that matters.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Tuesday May 02, 2023 @07:51PM (#35795876)
Hey HN, author of the site here!

Happy to answer any questions.

(below is the project description I used when posted about it on Reddit)

The problem I have with most news sites is that I can't read only important news: an article about a virus outbreak is followed by some celebrity gossip or another smartphone release.

But even on sites that focus on important events articles are posted every day and there are always "top headlines" — even on days when nothing important happened.

I am forced to make a choice: waste time going through unimportant updates or ignore the news and miss important events.

So I built a web app that I think solves this.

It uses AI (ChatGPT-4) to read the top 1000 news every day and rank them by significance on a scale from 0 to 10 based on event magnitude, scale, potential, and source credibility.

The results are posted on the site: https://www.newsminimalist.com/

I also run a newsletter where I post summaries of all the news with a score over 6.5. On average that's 1-3 articles per day, but sometimes it is 5, and sometimes — none at all. In that case, I just send an email saying that nothing important happened that day.

You can read previous issues here: https://newsletter.newsminimalist.com/

Let me know if you have any feedback or ideas. I'm considering adding new features and looking for direction.

Re:News Minimalist - Only significant news. All signal, no n... by hedora on Tuesday May 02, 2023 @10:35PM (#35797065)
I’d love for there to be sections, such as science, business, politics, etc.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Tuesday May 02, 2023 @10:42PM (#35797118)
I had them at one point, but decided to remove for simplicity. Will bring them back :)
Re:News Minimalist - Only significant news. All signal, no n... by alberth on Tuesday May 02, 2023 @11:00PM (#35797271)
Maybe make it optional because there’s huge value in keeping it simple like you currently have, so please don’t lose that

Eg default (no topic sections like what you have today), and optional advanced (with sections)

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Tuesday May 02, 2023 @11:09PM (#35797359)
I think it's the best solution, will do it soon.
Re:News Minimalist - Only significant news. All signal, no n... by alberth on Tuesday May 02, 2023 @11:13PM (#35797391)
Also, is you’re looking for a simpler domain name - BigNews.today is available.

( I used ChatGPT to help me find it, via https://smartynames.com/ )

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @11:46AM (#35803800)
Seems like someone bought it and set up a redirect to newsminimalist.com

Thank you kind stranger!

Re:News Minimalist - Only significant news. All signal, no n... by wyre on Wednesday May 03, 2023 @01:34AM (#35798393)
Similar aesthetic, different execution, but you could check out brutalist.report
Re:News Minimalist - Only significant news. All signal, no n... by alberth on Tuesday May 02, 2023 @10:57PM (#35797241)
I really love this. Thank you.

Question: are you using ChatGPT to summarize the article and making that the title of each post?

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Tuesday May 02, 2023 @11:15PM (#35797405)
Yes! I do exactly that. In the early version I posted the original titles, but many were too clickbait-y and hard to read. I find the rewritten titles much easier to scan through.
Re:News Minimalist - Only significant news. All signal, no n... by gnicholas on Wednesday May 03, 2023 @12:24AM (#35797999)
How do you decide how aggressively to summarize? That is, a 200-word summary of an 800-word article is very different from a 200-word summary of a 5,000-word article.

Relatedly, it would be neat if you had a slider or +/- buttons for each article summary, so someone could choose their depth based on how interesting the title sounds.

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @12:37AM (#35798059)
I don't decide it.

I just ask chatgpt to "summarize the article very concisely" and hope that it won't lose any important points. But chatgpt is really good at summarizing, so I don't worry much.

Having +/- buttons is a good idea, will add it to todo list as well.

Re:News Minimalist - Only significant news. All signal, no n... by komali2 on Wednesday May 03, 2023 @01:54AM (#35798519)
I assumed you did one llm batch a day and served it to all users. With +- buttons wouldn't you need to re-engage the llm?
Re:News Minimalist - Only significant news. All signal, no n... by lukevp on Wednesday May 03, 2023 @02:06AM (#35798602)
Could just ask the model for 5 lengths/levels of detail per article and have the +/- switch between them.
Re:News Minimalist - Only significant news. All signal, no n... by gnicholas on Wednesday May 03, 2023 @02:39PM (#35806061)
This is what I was thinking, sort of like the mechanism that Newsela and others use for their leveled reading platforms.

If you were so inclined, it would probably be pretty trivial to also offer leveled versions as well, which would be very useful for schools/teachers to use with students. There are a handful of companies that have bespoke leveled reading articles created from standard news articles. ChatGPT would make the workflow for creating news articles much easier, though manual QC would still be necessary to ensure that the article summaries are accurate and appropriate for students.

Re:News Minimalist - Only significant news. All signal, no n... by user_named on Tuesday May 02, 2023 @11:05PM (#35797328)
These headlines are basically the same as I get going to Bloomberg.com/markets over the past couple of of days.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Tuesday May 02, 2023 @11:18PM (#35797434)
Yeah, today is very economy-heavy day. But in the past issues there were more articles about health, science and environment.

Recent example: https://newsletter.newsminimalist.com/p/tuesday-april-25-3-m...

Re:News Minimalist - Only significant news. All signal, no n... by hellcow on Wednesday May 03, 2023 @12:13AM (#35797907)
Love this concept and signed up immediately.

Heads up that your plaintext emails in the newsletter have some html formatting and template artifacts in there.

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @12:32AM (#35798041)
Thanks, will look into that. I've been using the default template, which is relatively style-heavy, but will work on making it more minimal and clear.
Re:News Minimalist - Only significant news. All signal, no n... by ccppurcell on Wednesday May 03, 2023 @12:37AM (#35798063)
A great use case for llms. I'm not expecting you to do this, but I would love to choose my own news sites. I'm a Brit living in Czech Republic. So I'd maybe have the guardian, BBC, and some Czech sources in there. Not so interested in American news, any American news that affects me will reach my local sources. But great work!
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @01:04AM (#35798232)
Thank you!

Adding filter for news sources should be pretty easy, I'll consider it for "advanced view".

Re:News Minimalist - Only significant news. All signal, no n... by 6510 on Wednesday May 03, 2023 @08:25AM (#35801531)
A prompt, or more like a list of them seems the most interesting customization. For example: "no crypto currency", "nothing from Keith Rupert Murdoch", "chinese realestate", "ukraine war", "forex" etc

Now that would be worth something...

Say, you want more than 6 filters they costs 50 cents/filter/month with a minimum of 5.

I think one would gradually make more and more of them?

Re:News Minimalist - Only significant news. All signal, no n... by t0bia_s on Wednesday May 03, 2023 @03:00AM (#35799016)
Agree. US news are not so relevant here so source customisation would be great!
Re:News Minimalist - Only significant news. All signal, no n... by kqr on Wednesday May 03, 2023 @01:30AM (#35798373)
This is an awesome idea and I'm kicking myself for not thinking about it before. Very creative.

Have you made any attempt at quantifying its biases? Both whether it considers left- or right-leaning articles more significant and where it focuses most of its reporting. (Economy and the US from a first glance?)

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @02:50AM (#35798943)
Thank you!

> Have you made any attempt at quantifying its biases?

I haven't. I can share ChatGPT's evaluation of sources credibility, maybe that will give people some insights. For example, Reuters got 9.5 (out of 10), Lifehacker 7, Oprah Mag 3.

> where it focuses most of its reporting. (Economy and the US from a first glance?)

I'd say today is just US and economy-heavy day. There were many days when other categories and geographies made the top (I especially enjoy these). One example: https://newsletter.newsminimalist.com/p/tuesday-april-25-3-m...

Re:News Minimalist - Only significant news. All signal, no n... by klabb3 on Wednesday May 03, 2023 @04:31AM (#35799608)
> Have you made any attempt at quantifying its biases? Both whether it considers left- or right-leaning articles

FWIW, when I read news I often cross check on different outlets to get a sense of the span, range and sometimes media blackouts, including the ones with extreme bias (like RT reporting on Ukraine). This can give a good reading of the meta-temperature of a developing or controversial situation with a lot of propaganda and bias. In some cases, less trustworthy outlets will cover stories that aren’t narrative-friendly to more reputable publications, and sometimes, those can be really important.

For a service like this, I’d much prefer something analogous to “here’s what different outlets are saying”, rather than trying to make its own judgment about bias.

Re:News Minimalist - Only significant news. All signal, no n... by wolfv on Wednesday May 03, 2023 @09:13PM (#35810056)
Great idea, the “here’s what different outlets are saying” feature. Stories that aren’t narrative-friendly to main stream media. Media blackouts to highlight propaganda and bias. Make it easy for reader to see the "manufactured consent"!

Subscribed to newsletter.newsminimalist.

Re:News Minimalist - Only significant news. All signal, no n... by dublinben on Thursday May 04, 2023 @10:07AM (#35815542)
In case you’re not already familiar with it, there’s a site called https://www.allsides.com/ that does exactly this. I believe the creator is on HN.
Re:News Minimalist - Only significant news. All signal, no n... by pablolec on Wednesday May 03, 2023 @01:38AM (#35798419)
Hi and congrats, that's a great idea ? Is your project open source by any chance ? And if so, are you open to contributions ?
Re:News Minimalist - Only significant news. All signal, no n... by teodorlu on Wednesday May 03, 2023 @02:40AM (#35798865)
Great idea!

Personally, I want an even higher signal to noise ratio and even fewer articles. Perhaps significance > 7, and articles from the last week.

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @03:12AM (#35799102)
Someone suggested making weekly section, I'll try to add it soon: https://news.ycombinator.com/item?id=35797568
Re:News Minimalist - Only significant news. All signal, no n... by mcjiggerlog on Wednesday May 03, 2023 @03:41AM (#35799288)
Great idea and well executed - well done!

I actually created a site - https://detoxed.news - with a very similar philosophy a while back, though with a much simpler implementation. It periodically scrapes Wikipedia's Current Events Portal (https://en.wikipedia.org/wiki/Portal:Current_events) and presents that information in a nicer format.

I think there's definitely a sweet spot where you keep well-informed about current events and happenings in the world, without wasting your time on the 24 hours new cycle.

Re:News Minimalist - Only significant news. All signal, no n... by elektor on Wednesday May 03, 2023 @09:48AM (#35802364)
The problem with using Wikipedia as a news source is that it focuses on really flashy topics, like murder and armed conflicts. Looking at the headlines of detoxed.news confirms this:

1) Flood in Rwanda kills 109 people 2) Sudan War 3) Australia evacuation from Sudan 4) Seizing of an oil tanker

None of these headlines keep me particularly informed and are actually a more potent version of the 24 hours new cycle

Re:News Minimalist - Only significant news. All signal, no n... by pftburger on Wednesday May 03, 2023 @03:52AM (#35799362)
The absolute best feature is selecting the LEAST significant articles. Way more whimsey! +1
Re:News Minimalist - Only significant news. All signal, no n... by implements on Wednesday May 03, 2023 @05:02AM (#35799812)
“Brief downpour in Karachi turns weather pleasant.”
Re:News Minimalist - Only significant news. All signal, no n... by pavon on Wednesday May 03, 2023 @11:47AM (#35803815)
I get the most random articles by selecting around the mode (peak) of the distribution. The lowest of the low is all Daily Mail gossip all the time :puke:.
Re:News Minimalist - Only significant news. All signal, no n... by poniko on Wednesday May 03, 2023 @04:21AM (#35799551)
Such a great idea! Good job!
Re:News Minimalist - Only significant news. All signal, no n... by kome on Wednesday May 03, 2023 @04:57AM (#35799766)
very good idea and good website, but very US focused. so not very useful. one thing people tends to ignore about google and apple is how good their localization are. ofc i am not expecting the same sophistication from a team of 1, and i am not expecting anything at all. but i just want to encourage developers to think global from the get go.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @05:09AM (#35799866)
True for today, many US-centric news made the cut. But that's not always the case. Here's recent issue with no US news: https://newsletter.newsminimalist.com/p/tuesday-april-25-3-m...
Re:News Minimalist - Only significant news. All signal, no n... by aheckler on Wednesday May 03, 2023 @05:30AM (#35800029)
Some news entries appear to be of the "Top 5 things you should know today" variety, where it covers multiple topics. Example screenshot.[0] Might want to filter those out somehow?

[0] https://cln.sh/s44CS9tmwkC79NHcXPP3

Re:News Minimalist - Only significant news. All signal, no n... by Quanttek on Wednesday May 03, 2023 @05:36AM (#35800080)
Great work! I'd consider specifying the list of criteria for significance further, in order to counteract the heavy US bias of ChatGPT and, therefore, your site. I'm not a prompt engineer, but perhaps something on relevance for people from different countries, or simply adding to your prompt a sentence on ensuring geographical diversity.

The idea of filtering news sourced mentioned elsewhere is nice, but will necessitate considerable input from users, kind of negating the purpose of the site

Re:News Minimalist - Only significant news. All signal, no n... by tecoholic on Wednesday May 03, 2023 @06:05AM (#35800284)
I have a question: when watching shows like Last Week Tonight by John Oliver, it feels like the important news that make direct impact on people’s lives are more local than national or even international. The state changing a law here, the city building something new or make it harder to X..etc.,

Have you considered/thought about this aspect of news?

Re:News Minimalist - Only significant news. All signal, no n... by shshahshsusus on Wednesday May 03, 2023 @07:28AM (#35801010)
great work! How did you gain access to GPT-4 API? or are you manually inserting the article text into chat-gpt 4's web interface?
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @11:45AM (#35803792)
Thank you! I asked for GPT-4 access via form on OpenAI website, they gave me the one with 8k context window, which is enough for 99% of articles.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @09:38AM (#35802232)
Just published today's issue: https://newsletter.newsminimalist.com/p/wednesday-may-3-3-si...

I bet spam algorithms didn't like that I sent email to 30 people yesterday and 900 people today. Good problem to have :) Please check your spam folder if you don't see today's issue in inbox.

Re:News Minimalist - Only significant news. All signal, no n... by strunz on Wednesday May 03, 2023 @09:41AM (#35802259)
I'm sure you're aware, but I don't see a comment - the site is down.
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @10:28AM (#35802826)
Wasn't aware, thank you. Can't find anything in logs, is it still down for you?
Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Wednesday May 03, 2023 @09:56AM (#35802455)
RSS: https://rss.beehiiv.com/feeds/4aF2pGVAEN.xml (some people had complaints about formatting there, will try to fix soon)
Re:News Minimalist - Only significant news. All signal, no n... by noveltyaccount on Wednesday May 03, 2023 @10:49AM (#35803078)
Amazing project. Would be cool if the RSS feed could accept a parameter for either top x stories, or all stories with score greater than y.
Re:News Minimalist - Only significant news. All signal, no n... by pavon on Wednesday May 03, 2023 @11:20AM (#35803459)
Some changes that I would find useful are:

* Make it easier to browse back in time. My biggest annoyance with news sites I've subscribed to is that they have no way to find articles after they have moved off the front page so I feel compelled to visit every day, and when I don't I feel like I'm wasting money, so I unsubscribe. I did eventually find that you have previous days available in the newsletter section, but a more discoverable interface like "previous/next day" link on the bottom of the page would be great.

* Add some less frequent newsletters, such as weekly and monthly which dedupe any stories that come up multiple times in that period, and include the top N stories, rather than everything over a threshold.

* Sections would be great for advanced users. My ideal would be to let the user set a different threshold for each section, but then still display them all together on the front page.

Re:News Minimalist - Only significant news. All signal, no n... by ko3us on Wednesday May 03, 2023 @10:51PM (#35810668)
So cool! Would you be able to explain your architecture?
Re:News Minimalist - Only significant news. All signal, no n... by damnesian on Thursday May 04, 2023 @11:23AM (#35816860)
I am always interested in minimalist / text-oriented resources. And "importance ranking" seems like an especially valid task for AI. Thanks for sharing.
Re:News Minimalist - Only significant news. All signal, no n... by freiheit on Thursday May 04, 2023 @02:31PM (#35820032)
Overall: love the idea.

Any chance of updating the RSS feed item "summary" to something more useful than "significant news" and title to something more than the date? Or maybe an RSS feed of the newsletter format?

(I do see some of the older items have titles that include some info on what's included)

Basically, I think the ideal RSS feeds would be _two_: 1. RSS feed of every item that hits the 6/10 threshold (title and link to original, summary not too important, either same as title or paragraph summary of what the article is about) 2. RSS feed of the newsletter (title: "May 4 2023 - significant news", link: newsletter page, summary: list of article titles)

I suppose versions of #1 with diff thresholds could be nice, but I'd probably only use the default threshold.

Background: I run a bot that sends RSS feeds into discord channels (easily followable to any discord server) and this particular feed seems potentially quite handy for good news info. Probably overlaps with https://whatthefuckjusthappenedtoday.com/ but that automation probably means it can catch breaking news faster than a manually-curated site like that.

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Thursday May 04, 2023 @11:36PM (#35824938)
Thanks for the feedback. All great points.

"RSS" that I have currently is generated by the email platform that I use for daily emails. It's not a proper RSS from website.

Making a proper RSS for website items is on my list, but I need to finish some other features first.

Agree about subtitles in older items, I guess I just got lazy writing them :) your message was just what I needed to get back to older better format.

Re:News Minimalist - Only significant news. All signal, no n... by MattyRad on Thursday May 04, 2023 @05:06PM (#35822079)
This is great!

I've subscribed to the RSS feed. I thought the feed would provide links the significant news articles directly, but it appears to provide a link to the newsminimalist.com summary. That's totally fine, but I'd think it'd be a bit nicer if there was an option to access the articles directly.

I'm also using ChatGPT to scrape online info and reduce it. Were there any particularly interesting problems that you had to solve? For me, it was figuring out ways to reduce the number of tokens so I don't hemorrhage money!

Re:News Minimalist - Only significant news. All signal, no n... by yakhinvadim on Thursday May 04, 2023 @11:48PM (#35825010)
Thanks!

Yeah RSS it not great currently. Replied about it here with more info: https://news.ycombinator.com/item?id=35820032

Oh, exactly the same problem. The straightforward implementation would make me broke in month :)

Had to make several optimizations to make the bill reasonable. Not all of them worked, some greatly reduced the quality of significance estimations.

Reducing number of tokens was super fun, forgot about it :D

Re:News Minimalist - Only significant news. All signal, no n... by maliker on Monday May 08, 2023 @09:43AM (#35861427)
Every news site has some notion of top items, but you’ve done it 10x better. The de-duplication of similar stories, great summaries, and super clean interface are amazing. Bravo! It really feels like you solved news aggregation.