The Hadoop Open Platform-as-a-Service (Hops)
Big Data is
Hadoop is the de-facto standard for Big Data, that is, large scale data processing and storage. At KTH/SICS, we are developing Hadoop Open Platform-as-a-Service (Hops), a new distribution of Apache Hadoop with scalable, highly availble, customizable metadata. In this talk, we will investigate the architectural challenges in designing and implementing distributed meta-data for both HDFS and YARN. We will also present a new framework, Karamel, for the automated installation of Hops.