News for hackers. Stuff that matters.

A comment on The next Google. Parent comment

Re:The next Google by nojs on Tuesday April 05, 2022 @05:52PM (#30925516)
> Building a search engine index is not something Java is at all suitable for

Worth pointing out that Lucene/Solr, the biggest open source player, is also Java!

[ Parent | on HN ]
Re:The next Google by marginalia_nu on Tuesday April 05, 2022 @05:59PM (#30925602)
This is some of the nonsense you are dealing with implementing a search index in Java:

* You can only allocate on-heap arrays of 2 billion items.

* On-heap arrays have a massive size overhead in terms of GC book-keeping.

* You can only allocate off-heap memory map 2 Gb at a time.

* This also goes for memory mapped areas.

* You have no control over the lifecycle of mapped memory and off-heap memory. They get cleared if and when the GC feels like it.

* You have no madvise capabilities

* The language barely acknowledges unsigned types

[ Parent | on HN ]