Neamat Tazi

Course Description

In this course, we illustrate common technology stack available in most of the advanced database management frameworks. This course covers some of the advanced topics available in these technology stacks such as databases (No SQL databases), storage (HDFS, S3 on AWS, ..etc) and data access applications and technologies (Hive, Shark, Mlib,...etc). The course is heavily dependent on research papers where students read the papers and present them during the class.

Reading Assignments

Research papers are avilable for students as reading assignments. Each student should prepare a review document for reviewing the research paper. The review should follow the review template available in the attachments of the course.

1. Google File System (2003) [PDF]
2. HDFS (2010) [PDF]
3. Map Reduce (2004) [PDF]
4. Google Spanner (2012) [PDF] 
5. Hive (2010) [PDF]
6. Shark(2013) [PDF]
7. BigTable (2006) [PDF] 
8. NoSQL DBs [PDF]

Project

Students are required to deliver a project. The project can be one of the following:

• Data Analysis Project where they identify a question and a data set and answers the question through analyzing the data set.
• Research Area Topic that involves data management or data analysis.
• The project is a group project where 3 students maximum can collaborate in working on it.
• Use a competition data set and problem such as the ones in [KAGGLE] and conference competitions: [COMAD 2016]

Examples of Previous Projects

• Question Answering System by Mariam Hassan  [PDF]

• BigData System Interface by Adel Awd EL-Agawany [PDF]
• Hashtags Time Distribution Analysis by Michał Adamski and Krzysztof Sierszeń [PDF]

IBM BlueMix Accounts

• You can use IBM Bluemix Cloud account.. Ask for the promo code to give it to you.
• You can use IBM Watson for data analytics .. Ask for the promo code to give it to you.

Grading Scheme