Skip to main content

ID2221 Data-Intensive Computing 7.5 credits

Choose semester and course offering

Choose semester and course offering to see current information and more about the course, such as course syllabus, study period, and application information.

Application

For course offering

Autumn 2024 Start 26 Aug 2024 programme students

Application code

50253

Headings with content from the Course syllabus ID2221 (Spring 2019–) are denoted with an asterisk ( )

Content and learning outcomes

Course contents

Topics:

  • Distributed file systems
  • No SQL databases
  • Scalable messaging systems
  • Big Data execution engines: Map-Reduce, Spark
  • High level queries and interactive processing: Hive and Spark SQL
  • Stream processing
  • Graph processing
  • Scalable machine learning
  • Resource management.

Intended learning outcomes

The course complements distributed systems courses, with a focus on processing, storing and analyzing massive data. It prepares the students for master projects, and Ph.D. studies in the area of data-intensive computing systems. The main objective of this course is to provide the students with a solid foundation for understanding large scale distributed systems used for storing and processing massive data.

More specifically after the course is completed the student will be able to

  • explain the architecture and properties of the computer systems needed to store, search and index large volumes of data
  • describe the different computational models for processing large data sets for data at rest (batch processing) and data in motion (stream processing)
  • use various computational engines to design and implements nontrivial analytics on massive data
  • explain the different models for scheduling and resource allocation computational tasks on large computing clusters
  • elaborate on the tradeoffs when designing efficient algorithms for processing massive data in a distributed computing setting.

Literature and preparations

Specific prerequisites

No information inserted

Recommended prerequisites

No information inserted

Equipment

No information inserted

Literature

No information inserted

Examination and completion

If the course is discontinued, students may request to be examined during the following two academic years.

Grading scale

A, B, C, D, E, FX, F

Examination

  • LAB1 - Programming Assignments, 3.0 credits, grading scale: P, F
  • TEN1 - Examination, 4.5 credits, grading scale: A, B, C, D, E, FX, F

Based on recommendation from KTH’s coordinator for disabilities, the examiner will decide how to adapt an examination for students with documented disability.

The examiner may apply another examination format when re-examining individual students.

Written examination. Laboratory tasks.

Opportunity to complete the requirements via supplementary examination

No information inserted

Opportunity to raise an approved grade via renewed examination

No information inserted

Examiner

Ethical approach

  • All members of a group are responsible for the group's work.
  • In any assessment, every student shall honestly disclose any help received and sources used.
  • In an oral assessment, every student shall be able to present and answer questions about the entire assignment and solution.

Further information

Course room in Canvas

Registered students find further information about the implementation of the course in the course room in Canvas. A link to the course room can be found under the tab Studies in the Personal menu at the start of the course.

Offered by

Main field of study

Computer Science and Engineering

Education cycle

Second cycle

Add-on studies

No information inserted

Supplementary information

In this course, the EECS code of honor applies, see: http://www.kth.se/en/eecs/utbildning/hederskodex.