News for hackers. Stuff that matters.

agencies

What is state of the art currently?
Re:G. Polya, How to Solve It on Wednesday August 23, 2023 @03:01PM (#37240666)
You say that if someone has the chops to be a real mathlete they won't need Polya's _How To Solve It_

I'll say I went to college 25 years ago with people who had competed internationally in high school and who placed competitively on the Putnam, and they LOVED Polya's book.

I think whether you enjoy seeing strategies laid out well--—whether or not you've been able to figure some of it out yourself---depsnds more on your personality than on how good you are at solving creative math problems.

Is the code or expanded explanation available?
Re:Ask HN: How to build an image search service? on Wednesday February 01, 2023 @03:22PM (#34617033)
Here's a write-up from a relatively small/personal perspective

https://blog.qwertyforce.dev/posts/similar_image_search

Re:Ask HN: Bookmarking with _working_ full text search? on Wednesday January 25, 2023 @05:52PM (#34525293)
Yeah several threads on HN that have lists of tools and pros/cons.
Re:Ask HN: Bookmarking with _working_ full text search? on Wednesday January 25, 2023 @05:07PM (#34524832)
Have you tried https://historio.us/ ??
Re:Ask HN: Bookmarking with _working_ full text search? on Wednesday January 25, 2023 @03:27PM (#34523713)
Depends on required features like cross browser support, cross device support, handling pdfs, ocr images, etc. Some of the mentioned features already exist in the browser. Not sure if the browser vendors are incentivized to develop and maintain such features.
Re:Ask HN: Bookmarking with _working_ full text search? on Wednesday January 25, 2023 @02:28PM (#34522988)
How much would you be willing to pay for such a service?

Ask HN: Impossible to serve web page over blueooth?

I want to have a local device that will serve web apps to my Android browser over bluetooth or wifi *while my Android is still connected to normal wifi or mobile data*.I have thought about trying local http proxies over bluetooth serial, the new web bluetooth standards, intercepting xhr in native Android code to send requests over serial, wifi direct, wifi regular mode but w/o route to...

( Read More... | 1 comment | on HN )

Ask HN: How would you use a small web crawl?

I recently completed a small web crawl including only pages linked from HN stories. For example I would crawl the lwn article from https://news.ycombinator.com/item?id=32614633. I used archive.org's wayback machine to fetch their copy nearest to the HN submission's timestamp. If archive didn't have a copy, I did a direct fetch. It's about 2.5 million pages.I would like to publish it for others...

( Read More... | no comments | on HN )
Re:Ask HN: I want to dive into how to make search engines on Thursday August 25, 2022 @11:45AM (#32595329)
Interesting intro/overview in "What every software engineer should know about search" https://scribe.rip/p/what-every-software-engineer-should-kno...
There is definitely demand and folks are willing to pay:

https://www.duckbillgroup.com/

https://www.vantage.sh/

Re:Paid Search Engines Are Dead on Arrival on Thursday June 02, 2022 @02:25PM (#31598680)
If it were easy/cheap enough to host, can a model like shared game servers or web/email hosting work? People pay $20 a month without thinking for web hosting. What does it take to make "search hosting" a thing, where cheap search hosting companies can crop up both at the low end with bare bones offerings and others climb up the value chain with offerings like squarespace...

Ask HN: HN but for Performance

Where do folks keep up with and ask questions about sota performance code (e.g. simd, hashmap tuning, allocators, Dan Lemire, gaming code optimizations, etc.)?Stackoverflow? Particular forums?

( Read More... | 1 comment | 2 points | on HN )
Re:Ask HN: Fastest Crawl of HN Articles on Friday April 29, 2022 @01:33PM (#31208276)
Many domains have expired or content is no longer available.
Re:Ask HN: Fastest Crawl of HN Articles on Friday April 29, 2022 @12:23PM (#31207220)
If a HN story is a link to Wikipedia, the HN api serves the content of the Wikipedia page??
Re:Ask HN: Fastest Crawl of HN Articles on Friday April 29, 2022 @12:13PM (#31207074)
To clarify I'm not asking about HN itself but articles linked from HN.

As you said the HN api is great and there are at least 2 existing published crawls of it that help a lot.

Ask HN: Fastest Crawl of HN Articles

HN links to over 6 million urls in stories and comments. Many domains have expired or content is no longer available. Internet archive has much of the content but throttles requests. What's the fastest way to get the historical content?

( Read More... | 13 comments | 8 points | on HN )
Re:Home lab beginners guide (2021) on Sunday April 24, 2022 @03:04PM (#31147158)
Nice! Have you considered publishing your crawl data?
HN continues to pay lip service to wanting to make this better but does NOTHING to move the ball forward. Simple things like providing barrier less access to HN content and harder things like crawling all content linked from HN would be a great resource to bootstrap new search engines.

Ask HN: Crawl HN Linked Articles

How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls.Several services would likely do this for several thousand dollars but I'm hoping for something cheaper.

( Read More... | 1 comment | on HN )
Re:The next Google on Tuesday April 05, 2022 @08:03PM (#30926750)
Can you describe how context would work differently than additional search terms?
Re:Teclis – Non-commercial web search on Wednesday March 23, 2022 @06:29PM (#30784375)
What were your failed searches?
What's the source/breakdown of the 350 million pages? Thanks!
Please comment with your recent failed searches in this thread.

Any new search engine is going to need a niche with lots of users.

I haven't seen a comprehensive list of actual failed queries that new search engines could focus on solving.

Older »