News for hackers. Stuff that matters.
Re:Making the Tokio scheduler 10x faster by hu3 on Monday October 14, 2019 @07:25PM (#21253960)
Weird. In one of my Go explorations I wrote a naive trade algo backtracker which ingested 100,000 datapoints per second from SQLite on commodity hardware.

I'd expect something highly specialized such as GRPC server to perform better.

Re:Making the Tokio scheduler 10x faster by jumpingmice on Tuesday October 15, 2019 @12:24PM (#21260244)
Reading 100k rows per second from sqlite sounds WAY easier than serving 100k HTTP/2 queries in the same time.
Re:Making the Tokio scheduler 10x faster by hu3 on Tuesday October 15, 2019 @06:47PM (#21264851)
True. But in my case the code also distributes these datapoints to multiple threads, computes technical indicators and simulates tradings while gathering statistics to finetunne parameters.

The only optimization I've done was to ditch maps wherever I could. They were dominating flamegraphs.

This is why I expected GRPC to perform better. But I agree it depends heavily on what's being done.

Re:Making the Tokio scheduler 10x faster by tozeur on Monday October 14, 2019 @11:59PM (#21255431)
How did Go perform compared to a language like python? I thought the db would be the bottleneck?
Re:Making the Tokio scheduler 10x faster by hu3 on Tuesday October 15, 2019 @06:50PM (#21264876)
Python is awesome. It's fast as long you're mosty calling libraries. Not so fast if Python itself is doing most of the work.