Huawei, this week announced that it has become the first global ICT vendor to obtain certification by Databricks for distribution of the Apache Spark open source big data processing framework. Databricks, a company founded by the creators of Spark, has developed the “Certified Spark Distribution” program to highlight and recognize third party vendors distributing Spark. Leveraging the high-performance big data computing architecture and the complete ecosystem of Spark, the Huawei-Spark platform is designed to help customers realize the full potential of data assets to drive agile operation and business innovation.
Huawei said that the company has a long-term commitment to technology innovations involving the Spark platform, and to the development of the Spark core, SparkSQL and for distributing key machine learning algorithms.
The Apache Spark community has become the most influential and active open source community with more than 50 institutions participating and making code contributions, making Spark as a new-generation mainstream standard for big data computing architecture, said Huawei.
Jia Yongli, Big Data Technology Leader, Huawei
Huawei's strategic big data positioning and proactive participation in the Spark community has played an important role in building and expanding the presence of the Spark platform. Our continued involvement will remain critical as we seek to keep abreast of cutting-edge technologies and enable our customers to access Spark applications towards the goal of establishing an open, cooperative, and win-win big data ecosystem.
Andy Konwinski, Founder, Databricks
Huawei’s contributions to the Spark program and community highlights its long-term commitment to Spark. We expect Huawei to bring more users and use cases to the community and drive further adoption of Spark in vertical markets.