Spark of The Future with DataBricks

Published: May 14, 2019, 10 a.m.

Spark is one of the most popular platforms for Data Science and AI development today and the team at DataBricks is driving massive innovation in this community, both open-source and commercially.\n\nCory (https://twitter.com/Cory_Minton?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor) sat down with Reynold Xin, Co-Founder and Chief Architect, and Michael Armburst (https://www.linkedin.com/in/michaelarmbrust/), Principal Architect, at DataBricks to understand the history of Spark development and uncover the massive developments in the platform available now and in the near future making Spark more accessible and easier for Data Scientists and Engineers alike.\n\n\nThis podcast was recorded at Spark+AI Summit in San Francisco (https://databricks.com/sparkaisummit/north-america), California in April 2019.\n\nLinks\nDataBricks (https://databricks.com/)\nReynold (https://databricks.com/speaker/reynold-xin) on LinkedIn (https://www.linkedin.com/in/reynoldxin/) & Twitter (https://twitter.com/rxin)\nMichael (https://databricks.com/speaker/michael-armbrust) on LinkedIn (https://www.linkedin.com/in/michaelarmbrust/) & Twitter (https://twitter.com/michaelarmbrust)\nDeltaLake (https://delta.io/) and Announcement (https://databricks.com/session/announcing-databricks-delta)\nApple Presentation on DeltaLake (https://databricks.com/session/keynote-from-apple)\nMLFlow (https://mlflow.org/)\nVideos from Spark+AI Summit 2019 (https://databricks.com/sparkaisummit/north-america/sessions)\nReynold Keynote Recording (https://databricks.com/session/official-announcement-of-koalas-open-source-project) on Koalas\nMichael Keynote Recording (https://databricks.com/session/announcing-databricks-delta) on Delta\n\nDid you know we are on Spotify?\xa0 Tune in to The Big Data Beard! (https://open.spotify.com/show/62li7mm5ADkeXUS3tuOZ24)\n\n\nDon\u2019t forget that we are going to Domino Data Labs\u2019 upcoming REV2 Conference in NYC May 23-24. \xa0Visit the REV Conference Website (http://REV.dominodatalab.com) and use promo code BDB_REV100 to save $100 on your pass!\n\n\nMusic from this episode is by Andrew Belle (https://itunes.apple.com/us/artist/andrew-belle/37712246).\xa0 Please go check him out...you'll thank us!