Re:Applying machine learning and deep learning methods to au...
by alon7 on Wednesday November 27, 2019 @10:08AM
(#21648437)
We're actually very happy with Comet and have been using it on v large projects (>50 researchers, 10k models). You can reduce the refresh interval and the amount of data points reported if things feel slow
[ Parent
| on HN ]
Re:Applying machine learning and deep learning methods to au...
by m0zg on Wednesday November 27, 2019 @02:06PM
(#21650904)
I don't log that many points as it is: about 4K data points per run in total (windowed average loss and LR every 25-30 batches, eval metrics every epoch), for all metrics combined. I also log the same data to TensorBoard, which renders everything pretty much instantaneously with no issues at all, even though I tell it to not downsample beyond 5K samples per graph.