Overview
42–Research developed a high-volume, real-time data processing infrastructure to support an investment fund’s need for expanded data coverage on niche asset classes. The existing data solutions were inadequate, with delays, limited asset coverage, and scalability issues.
Problems
Investment fund wanted to drastically increase the scope and scale of assets they traded in, but lacked sufficient real-time data to make investment decisions on niche asset classes
Most existing data sets were either delayed, lacked full coverage of desired data points/asset classes, or were extremely difficult to scale beyond a handful of assets at a time,
Solution
Developed a high-volume, real-time data processing infrastructure with the ability to scale capacity 20x within minutes, enabling automated collection, analysis, and processing of selected data points and assets from diverse sources.
Results
Achieved 24/7 processing of over 40,000 unique data points per minute with a maximum 60-second lag, enabling continuous automated trading signals and alerts for a global team across multiple time zones.