QCRI launches RHEEM big data app
The Qatar Computing Research Institute (QCRI), a division of Hamad bin Khalifa University, has launched an application that can draw insights from big data across many software platforms.
The application, RHEEM, named after a native gazelle in Qatar, is the first general purpose system capable of what scientists call cross-platform data processing to be launched.
QCRI scientist Jorge-Arnulfo Quiané-Ruiz, who led the development of the software, said as the use and analysis of big data spread, organisations were using different specialised big data platforms to address specific needs.
“For example, social media and customer purchase analytics typically require separate software platforms,” Quiané-Ruiz said.
An airline could use RHEEM to mine data from a passenger database to target promotions to customers based on flight history data from information stored in a passenger list. RHEEM could then help the airline’s engineers to use this information to schedule extra flight capacity with data stored separately on multiple platforms. Qatar Airways has agreed to test the technology.
Hospitals could use the application to improve patient monitoring. For example, doctors might need to gather information about patients (whose information is typically stored in a database) who have received similar prescriptions, information usually stored in text files.
The oil industry could also use RHEEM to analyse structured and unstructured data to improve efficiency. During an exploration phase, for instance, data has to be acquired, integrated and analysed in order to predict if a reservoir will be profitable.
Quiané-Ruiz said RHEEM operated like a platform integrator or coordinator that used a set of rules to decide how to map a request from the application layer all the way down to the right platform. It works in a layered fashion, with the application sitting on the top layer and the bottom layer connecting with a myriad of popular platforms.
“Rheem can decide, for example that for certain tasks PostgreSQL is the right option but for others, distributed platforms like Hadoop or Spark could be more efficient,” Quiané-Ruiz said.
“The key challenge was to come up with a small set of rules that are not too complicated but at the same time could manage the diversity of data analysis tasks.”
RHEEM allows users to easily specify these tasks with easy-to-use interfaces, provides developers with opportunities to optimise performance in different ways and can run on any data-processing platform, such as PostgreSQL, Spark or GraphChi.
The software has been presented to scientists at leading international conferences including SIGMOD, VLDB and EDBT.
In the Media
As the world ends, will you lock arms and sing “Kumbayah” or embark on a path of law-breaking, anti-social behavior? A new study, based upon the virtual actions of more than 80,000 players of the ...
Researchers from MIT and the Qatar Computing Research Institute have developed a novel new facility in the current rush of interest towards computer vision – an algorithm that can identify overweight...
A growing number of people have expressed their concern about high levels of polarization in society. For instance, the World Economic Forum's report on global risks lists the increasing societal ...
The QCRI – MIT CSAIL Annual Research Project Review is open to the public on Monday, March 27, 2017, at the HBKU Research Complex Multipurpose Room. The annual meeting is a highlight of a ...
Machine Learning and Data Analytics Symposium - MLDAS 2017 Building on the success of the three previous events , Boeing and QCRI will hold the Fourth Machine Learning and Data Analytics Symposium (...
Artificial intelligence expert says humans should not consider AI to be a major threat to their existence but should use it to enhance it.
The Boeing Company has announced that it will once again partner with the Qatar Computing Research Institute (QCRI), part of Hamad bin Khalifa University, to host the fourth annual Machine Learning ...