Lightning Talk: FastTrackML: Experiment Tracking at Hyper Scale – Dave Gantenbein, G-Research
Lightning Talk: FastTrackML: Experiment Tracking at Hyper Scale – Dave Gantenbein, G-Research
: Experiment tracking with an extremely high throughput can be a challenging task. While existing tools such as AIM and MFLow attempt to address this problem, they were not able to reach the scale we required.
This lightning talk discusses how we created the open source FastTrackML project to meet the scaling needs of a real-time algorithmic financial trading platform. FastTrackML is a drop-in replacement for the MLFlow back end, allowing users to scale their experiment tracking. It also allows users to view experiment results with the existing MLFlow UI, or alternatively they can use the AIM project UI to explore their results via an API that replicates the AIM REST server but uses the MLFlow database. This tool has allowed our researchers to understand their experiments quickly, while continuing to use familiar and well-proven UI tools built by the community.
https://fasttrackml.io
https://github.com/G-Research/fasttrackml
by The Linux Foundation
linux foundation
