Resources >‏ News >‏ News Details

News Details

QCRI launches RHEEM big data app

Publication Date:
10/07/2016
Category:
News
jorge.jpg

The Qatar Computing Research Institute (QCRI), a division of Hamad bin Khalifa University, has launched an application that can draw insights from big data across many software platforms.

The application, RHEEM, named after a native gazelle in Qatar, is the first general purpose system capable of what scientists call cross-platform data processing to be launched.

QCRI scientist Jorge-Arnulfo Quiané-Ruiz, who led the development of the software, said as the use and analysis of big data spread, organisations were using different specialised big data platforms to address specific needs.

“For example, social media and customer purchase analytics typically require separate software platforms,” Quiané-Ruiz said.

An airline could use RHEEM to mine data from a passenger database to target promotions to customers based on flight history data from information stored in a passenger list. RHEEM could then help the airline’s engineers to use this information to schedule extra flight capacity with data stored separately on multiple platforms. Qatar Airways has agreed to test the technology.

Hospitals could use the application to improve patient monitoring. For example, doctors might need to gather information about patients (whose information is typically stored in a database) who have received similar prescriptions, information usually stored in text files.

The oil industry could also use RHEEM to analyse structured and unstructured data to improve efficiency. During an exploration phase, for instance, data has to be acquired, integrated and analysed in order to predict if a reservoir will be profitable.

Quiané-Ruiz said RHEEM operated like a platform integrator or coordinator that used a set of rules to decide how to map a request from the application layer all the way down to the right platform.  It works in a layered fashion, with the application sitting on the top layer and the bottom layer connecting with a myriad of popular platforms.

“Rheem can decide, for example that for certain tasks PostgreSQL is the right option but for others, distributed platforms like Hadoop or Spark could be more efficient,” Quiané-Ruiz said.

“The key challenge was to come up with a small set of rules that are not too complicated but at the same time could manage the diversity of data analysis tasks.”

RHEEM allows users to easily specify these tasks with easy-to-use interfaces, provides developers with opportunities to optimise performance in different ways and can run on any data-processing platform, such as PostgreSQL, Spark or GraphChi.

The software has been presented to scientists at leading international conferences including SIGMOD, VLDB and EDBT.


Follow Us

  • YouTube
  • Twitter
  • Facebook
  • RSS Feed
  • Linkedin
  • github-web.png
Back to Top

In the Media

BBC newshack pic.jpg

QCRI team wins SUMMA BBC #NewsHack 'Best Audience Experience' prize

13/12/2017

Congratulations to Ahmed Ali, Yifan Zhang and Fahim Dalvi for winning the prize of the “Best Audience Experience” category at the news hack hosted by SUMMA and BBC in London on 21-22 November with ...

Read More

Neural networks MIT.jpg

Reading a neural network’s mind

12/12/2017

Neural networks, which learn to perform computational tasks by analyzing huge sets of training data, have been responsible for the most impressive recent advances in artificial intelligence, ...

Read More

CSAIl image october 2017 story.JPG

CSAIL hosts annual meeting highlighting innovative collaboration with QCRI

10/10/2017

This year CSAIL celebrates five years of collaboration with the Qatar Computing Research Institute (QCRI), an esteemed research institute that’s part of Hamad Bin Khalifa University in Doha. This ...

Read More

Events

2017

after school pic.JPG

QCRI's Creative Space launches free after-school computing courses for teenagers

Download ICS File 01/11/2017  - 20/12/2018 ,

We offer an App Inventor Course in Arabic for students aged 13-15 and an Arduino Programming Course in English for students aged 14-18. Courses are free. Please register quickly as places are limited.

Read More

Past Events

Summer Camp 2.jpg

QCRI conducts first summer computing camps for kids

Download ICS File 16/07/2017  - 27/07/2017 ,

Children and teenagers have been given a rare chance to develop their computing skills with world-class computing scientists at the first summer computing camp conducted by the Qatar Computing ...

Read More

CS 1.jpg

QCRI’s Creative Space holds Open House event for kids

Download ICS File 20/05/2017 ,

The Qatar Computing Research Institute’s new Creative Space, which conducts fun activities to teach children computing skills, has successfully held its first Open House event. About 100 children ...

Read More

News

Jim Jansen pic preferred.jpg

Research by QCRI's Jim Jansen among most influential of decade: top journals

13/12/2017

QCRI Social Computing group's principal scientist achieves rare honor.

Read More

yelena pic.JPG

#Halal now a lifestyle definition on Instagram

29/11/2017

The word “halal” is no longer being defined only in a religious context but is becoming a lifestyle term associated with health and fashion around the globe, a new study of Instagram posts led by ...

Read More

Dr. Mokbel.jpg

QCRI’s Mohamed Mokbel named Distinguished Scientist by world’s largest computing society ACM

21/11/2017

Chief scientist among only 43 scientists globally - and the only one from the Middle East - to be selected for the honor in 2017.

Read More