Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray...
by smfjaw on Wednesday July 31, 2024 @06:45PM
(#41124320)
I work in finance and it's great having big historical datasets, even if the figures are far lower in previous years it's good to see system 'shocks' and these can be used at a different magnitude/scaled for future forecasting
[ Parent
| on HN ]
Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray...
by refset on Thursday August 01, 2024 @08:22AM
(#41128400)
Yep backtesting is critical step in the deployment of new trading algorithms.
Related, I rather enjoyed reading this other thread from June: "Ask HN: Is KDB a sane choice for a datalake in 2024?" https://news.ycombinator.com/item?id=40625800