Computer Systems Performance (Spring 2023)

Abstract

In this course, you will learn how to evaluate the performance of a computer system.
The course combines a focus on low-level system components (hardware, operating system, etc.) with the analysis of complex data systems.

Description

In this class, students will learn how to design and conduct performance analysis experiments and how to troubleshoot existing complex data-intensive systems.

We live in a world that requires near-instant response times and increasingly faster access to very large volumes of business-critical data. Data scientists expect high-performance from their data systems in order to reduce time to insight. Software and DevOps engineers are expected to continuously improve the performance of IT systems.

In this world, delays and sub-optimal performance have a cost. This cost is not just monetary but is also about power consumption. Any system that cannot reach its full performance potential wastes both money and power.

To achieve sustainable management and growth of data-intensive systems (e.g., database management systems, big data processing systems, machine learning systems), we must exploit the available computer systems resources (e.g., hardware) well and avoid sub-optimal performance.

Performance analysis of computer systems can
(1) uncover the effects of design or implementation bugs leading to such sub-optimal performance and (2) help characterize the needs and behavior of different types of systems helping us target more effective performance optimizations.
This is what we will be learning in this course.

Formal prerequisites

Students should have taken introductory courses on database systems and operating systems, or something similar. They should have some familiarity with command line interface and C/CPP.

Intended learning outcomes

After the course, the student should be able to:

• Design and conduct performance evaluation experiments
• Formulate hypothesis about the causes of poor performance across different layers of a data system’s stack (i.e., data management components, operating system, file system, network, hardware).
• Select appropriate set of tools for troubleshooting performance problems.
• Analyze the performance of a complex real-world data system.

Learning activities

The course is composed of lectures and exercise sessions. The lectures will cover fundamental aspects of various systems components such as operating systems, storage systems, processors, data systems, etc. The exercises will introduce tools and methodology for troubleshooting and performance analysis. Students will also work on two project assignments during the semester in 2-3 person groups. They will be doing in-class presentations on these assignments as well.

Course literature

The relevant literature will be provided on LearnIT every week.

Student Activity Budget

Estimated distribution of learning activities for the typical student

• Preparation for lectures and exercises: 10%
• Lectures: 25%
• Exercises: 25%
• Project work, supervision included: 30%
• Exam with preparation: 10%

Ordinary exam

Exam type:
D: Submission of written work with following oral, External (7-point scale)
Exam variation:
D2G: Submission for groups with following oral exam supplemented by the submission. Shared responsibility for the report.

reexam

Exam type:
D: Submission of written work with following oral, External (7-point scale)
Exam variation:
D22: Submission with following oral exam supplemented by the submission.

Time and date

Ordinary Exam - submission Wed, 17 May 2023, 08:00 - 14:00
Ordinary Exam Wed, 7 June 2023, 09:00 - 21:00
Ordinary Exam Thu, 8 June 2023, 09:00 - 21:00
Reexam - submission Wed, 26 July 2023, 08:00 - 14:00