Resources >‏ News >‏ News Details

News Details

QCRI launches RHEEM big data app

Publication Date:
10/07/2016
Category:
News
jorge.jpg

The Qatar Computing Research Institute (QCRI), a division of Hamad bin Khalifa University, has launched an application that can draw insights from big data across many software platforms.

The application, RHEEM, named after a native gazelle in Qatar, is the first general purpose system capable of what scientists call cross-platform data processing to be launched.

QCRI scientist Jorge-Arnulfo Quiané-Ruiz, who led the development of the software, said as the use and analysis of big data spread, organisations were using different specialised big data platforms to address specific needs.

“For example, social media and customer purchase analytics typically require separate software platforms,” Quiané-Ruiz said.

An airline could use RHEEM to mine data from a passenger database to target promotions to customers based on flight history data from information stored in a passenger list. RHEEM could then help the airline’s engineers to use this information to schedule extra flight capacity with data stored separately on multiple platforms. Qatar Airways has agreed to test the technology.

Hospitals could use the application to improve patient monitoring. For example, doctors might need to gather information about patients (whose information is typically stored in a database) who have received similar prescriptions, information usually stored in text files.

The oil industry could also use RHEEM to analyse structured and unstructured data to improve efficiency. During an exploration phase, for instance, data has to be acquired, integrated and analysed in order to predict if a reservoir will be profitable.

Quiané-Ruiz said RHEEM operated like a platform integrator or coordinator that used a set of rules to decide how to map a request from the application layer all the way down to the right platform.  It works in a layered fashion, with the application sitting on the top layer and the bottom layer connecting with a myriad of popular platforms.

“Rheem can decide, for example that for certain tasks PostgreSQL is the right option but for others, distributed platforms like Hadoop or Spark could be more efficient,” Quiané-Ruiz said.

“The key challenge was to come up with a small set of rules that are not too complicated but at the same time could manage the diversity of data analysis tasks.”

RHEEM allows users to easily specify these tasks with easy-to-use interfaces, provides developers with opportunities to optimise performance in different ways and can run on any data-processing platform, such as PostgreSQL, Spark or GraphChi.

The software has been presented to scientists at leading international conferences including SIGMOD, VLDB and EDBT.


Follow Us

  • YouTube
  • Twitter
  • Facebook
  • RSS Feed
  • Linkedin
  • github-web.png
Back to Top

In the Media

MIT Tamer.JPG

Taming data

22/01/2017

The age of big data has seen a host of new techniques for analyzing large data sets. But before any of those techniques can be applied, the target data has to be aggregated, organized, and cleaned up...

Read More

BBC deep learning story pic.PNG

What is 'deep learning'?

08/01/2017

Every day we create billions of bits of data. Ever faster and more powerful computers can use that big data to learn, predict events and carry out key tasks. Surveillance, voice recognition and ...

Read More

EN Facebook story.jpg

Así influye Facebook en tus opiniones

08/12/2016

Hay varios presuntos culpables de la victoria de Donald Trump: la falta de visión de la campaña de Clinton, la globalización, la condescendencia de las elites. Facebook y su modo de seleccionar ...

Read More

Events

2017

ArabWic for web.jpg

Women in Data Science

Download ICS File 03/02/2017 ,

Here's a great chance to learn about the latest data science-related research in multiple domains, as part of a global project. Qatar's WiDS event will be held here at the HBKU Research Complex on ...

Read More

MLDAS 2017

(MLDAS 2017 )Machine Learning and Data Analytics Symposium

Download ICS File 13/03/2017  - 14/03/2017 , Qatar National Convention Center

Machine Learning and Data Analytics Symposium - MLDAS 2017 Building on the success of MLDAS 2016 and MLDAS 2015 , The Third Machine Learning and Data Analytics (MLDAS) Symposium , will be held on ...

Read More

Past Events

2016

QCRI IBM New.JPG

QCRI - IBM Data Science Connect 2016

Download ICS File 16/11/2016 ,

QCRI–IBM Data Science Connect 2016  Doha, Qatar 12.30pm –5:30pm, Wednesday, November 16 HBKU Research Complex, Ground Level Multi-Purpose Room Google Map link to location https://goo.gl/maps/...

Read More

News

Jalees10.jpg

QCRI’s Jalees Reader app launched in more languages

06/12/2016

French and German interfaces added for free app which allows users to upload books and read them offline.

Read More

IBM Watson robot (ex IBM Watson).JPG

IBM Watson scientist visits Qatar to present platform that 'thinks like a human'

16/11/2016

IBM Watson’s chief data scientist Romeo Kienzler has visited the Qatar Computing Research Institute to conduct a workshop on Watson, a question-answering platform that can “think like a human”. Mr ...

Read More

Stephan.JPG

QCRI’s BrailleEasy app launched on iOS store

31/08/2016

BrailleEasy, a custom one-handed Braille keyboard developed by the Qatar Computing Research Institute, is now available on the iOS App Store. The Braille keyboard was developed by Barbara Šepič, ...

Read More