IBM announced a major commitment to Spark last month, calling the open source project
potentially the most important new open source project in a decade.
The announcement covered a number of actions, including
- building Spark into the core of the company’s analytics and commerce platforms
- using Spark to power Watson Health Cloud
- open sourcing their SystemML machine learning technology and collaborating with Databricks to advance Spark’s machine learning capabilities
- offering Spark as a cloud service on IBM Bluemix
- having 3500 researchers and developers work on Spark-related projects
- educating more than 1m data analysts on Spark through extensive partnerships
