Many small queries are efficient in SQLite

Re:Many small queries are efficient in SQLite by tutfbhuf on Tuesday February 16, 2021 @03:37AM (#26152063)

You exchange network access against filesystem access, but what if your filesystem is a network device?

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by config_yml on Tuesday February 16, 2021 @05:52AM (#26152778)

SQLite recommends not using network storage:

> You are advised to avoid using SQLite on a network filesystem in the first place, since performance will be slow

https://sqlite.org/atomiccommit.html#_broken_locking_impleme...

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by tutfbhuf on Tuesday February 16, 2021 @10:23AM (#26154672)

That's a serious limitation since many VMs in datacenters have block devices attached over network.

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by striking on Tuesday February 16, 2021 @01:48PM (#26157303)

I think this is true for any RDBMS, though. If your block device has high latency, you will see bad perf when the DB tries to fsync.

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by tutfbhuf on Wednesday February 17, 2021 @02:33AM (#26163713)

But the block device latency is usually a order of magnitude lower (microseconds) than the network latency between the database and its clients (milliseconds), except when all clients are located in the same datacenters.

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by stefanfisk on Tuesday February 16, 2021 @03:35PM (#26158470)

”Network filesystems” means stuff like NFS. Networked block devices should generellt be fine AFAIK.

[ Parent | on HN ]

Re:Many small queries are efficient in SQLite by madpata on Tuesday February 16, 2021 @08:20AM (#26153557)

You exchange network+filesystem access against only filesystem acess.

The server needs to store your DB somehow too.

[ Parent | on HN ]