Principles and Techniques of Data Science

Combining data, computation, and inferential thinking, data science is redefining how people and organizations solve challenging problems and understand their world. This intermediate level class bridges between Data8 and upper division computer science and statistics courses as well as methods courses in other fields. In this class, we explore key areas of data science including question formulation, data collection and cleaning, visualization, statistical inference, predictive modeling, and decision making. Through a strong emphasizes on data centric computing, quantitative critical thinking, and exploratory data analysis this class covers key principles and techniques of data science. These include languages for transforming, querying and analyzing data; algorithms for machine learning methods including regression, classification and clustering; principles behind creating informative data visualizations; statistical concepts of measurement error and prediction; and techniques for scalable data processing.

This class is listed as STAT C100 and as COMPSCI C100.

Important Information:

When: Lectures Tuesdays and Thursdays from 11:00AM to 12:30PM
Where: Evans 10
What: See the lecture schedule
Section and Lab: The section and lab assignments will be obtained optimally using a linear program. To get the best assignment please complete the following Google Form.
News: We will post updates about the class on Piazza

Office Hours, Section, and Lab Schedule

For official holidays see the academic calendar.

Goals

Prepare students for advanced Berkeley courses in data-management, machine learning, and statistics, by providing the necessary foundation and context
Enable students to start careers as data scientists by providing experience in working with real-world data, tools, and techniques
Empower student to apply computational and inferential thinking to address real-world problems

Prerequisites

While we are working to make this class widely accessible we currently require the following (or equivalent) prerequisites :

Foundations of Data Science: Data8 covers much of the material in DS100 but at an introductory level. Data8 provides basic exposure to python programming and working with tabular data as well as visualization, statistics, and machine learning.
Computing: The Structure and Interpretation of Computer Programs CS61A or Computational Structures in Data Science CS88. These courses provide additional background in python programming (e.g., for loops, lambdas, debugging, and complexity) that will enable DS100 to focus more on the concepts in Data Science and less on the details of programming in python.
Math: Linear Algebra (Math 54 or EE 16a): We will need some basic concepts like linear operators, eigenvectors, derivatives, and integrals to enable statistical inference and derive new prediction algorithms. This may be satisfied concurrently to DS100.