News for hackers. Stuff that matters.
Re:Faster JavaScript Calls by hinkley on Monday February 15, 2021 @01:56PM (#26145855)
YouTube fed me a video I’d watched a couple years ago about a log searching tool. Compressed data, decompressed into cpu cache, and then scanned. Almost no indexing at all, just cpu cache for speed.

We spend a lot of time arguing with the cpu. If we give it something it’s actually happy doing, it almost doesn’t matter how stupid that thing is, because it’s stupid fast.

Re:Faster JavaScript Calls by owaislone on Monday February 15, 2021 @02:11PM (#26146016)
Interesting. Would really appreciate if you could share the video with us. Thanks
Re:Faster JavaScript Calls by posnet on Monday February 15, 2021 @03:12PM (#26146732)
This is one of the main selling points of Blosc https://blosc.org/pages/blosc-in-depth/
Re:Faster JavaScript Calls by e12e on Monday February 15, 2021 @03:35PM (#26146982)
I couldn't find the talk hinted at, but this blog post seems to touch on some of the same ideas: https://www.humio.com/whats-new/blog/how-fast-can-you-grep/
Re:Faster JavaScript Calls by devbug on Monday February 15, 2021 @08:51PM (#26150035)
Brute force search is how Scaylr does it. Here’s an article they wrote about their implementation.

https://www.scalyr.com/blog/searching-1tb-sec-systems-engine...

Re:Faster JavaScript Calls by mhh__ on Monday February 15, 2021 @06:41PM (#26149192)
> Compressed data, decompressed into cpu cache, and then scanned. Almost no indexing at all, just cpu cache for speed.

Where are these programs not using the CPU cache?

Re:Faster JavaScript Calls by hinkley on Tuesday February 16, 2021 @03:25PM (#26158350)
Indexes and tree structures involve pointer walking. Nothing is even guaranteed to be in main memory, nevermind L2 cache. These guys apparently went straight from disk (linear reads) to L1/L2.
Re:Faster JavaScript Calls by chii on Monday February 15, 2021 @09:43PM (#26150337)
assume they meant decompress small enough a block to fit the CPU cache, and do in-memory scans.