Processing two petabytes of data, responding to ad auctions at a rate of 2.7 million requests per second and running 24 x 7 across five continents is all in a day’s work for DataXu’s platform.
Have you ever wondered how this is all accomplished? Beyond the genius of our engineers and data scientists, it requires enabling technologies such as Apache Spark and AWS.
Earlier this year, a few of the ‘Xu’s data scientists and engineers attended the Spark Summit East to discuss how DataXu utilizes enabling technologies to continue improving our platform and facilitating success for our customers.
The Spark Summit brings together technology innovators and industry influencers to speak about data science and engineering on a large scale. This year, attendees had the opportunity to take a deeper dive into the technology behind Apache Spark and how to best leverage it.
Check out the video below for an in-depth explanation on how Spark has helped DataXu maintain agility and prototyping strength while taking a product from the R&D phase into full production.
RELATED BLOG POSTS: