News for hackers. Stuff that matters.
Re:The Open Microscopy Environment by COGlory on Sunday March 05, 2023 @10:15PM (#35037132)
If anyone is interested in similar challenges, but in cryo electron microscopy, where the datasets are dozens of TB, this is a good paper discussing the file formats, header organization, and bit-depth required for proper resolution:

https://pubmed.ncbi.nlm.nih.gov/35724904/

What I can say is that TEM data management is unmitigated hell, and thank God for that author (Ludtke) and his software (EMAN2).

Biologists are unsurprisingly awful at data management.

Re:The Open Microscopy Environment by 0xcoffee on Monday March 06, 2023 @01:02AM (#35037961)
Noob question here, how can I read this paper? Or I need to purchase access?
Re:The Open Microscopy Environment by cinntaile on Monday March 06, 2023 @04:06AM (#35038971)
Use sci-hub
Re:The Open Microscopy Environment by nickpeterson on Monday March 06, 2023 @09:35AM (#35041487)
Their data management strategy is organic.
Re:The Open Microscopy Environment by dekhn on Monday March 06, 2023 @12:09PM (#35043547)
and in the case of the cryo-em researchers, completely frozen.