Data-Centric Deep Learning (DCDL) is a four week class taught by Andrew Maas and Mike Wu on the Uplimit platform. This repository contains the open-sourced project material.
Build, improve, and repair deep learning applications with a data-centric approach. Data is the key to success in modern machine learning, and this course provides hands-on experience with the impact of data quality, improving models via data, realistic performance evaluation, and human-in-the-loop data improvement methods. Learn best practices for achieving production-quality deep learning results, and how new technologies like pre-trained foundation models can make development faster and simpler. Understand how data-centric principles apply when developing LLM-based applications, agents, and retrieval-augmented generation (RAG) systems.
The course is focused on a practical introduction to deep learning engineering and operations, with an emphasis on algorithmic challenges that practitioners face in the real world. To be "data-centric" means leveraging methods and tools that use data to improve, repair, and test deep learning models.
Students will walk through each step of a deep model's lifecycle, from annotation to training to testing to deployment to monitoring back to annotation. In each step, students will be introduced to new tools as well as the underlying methodology.
This class is an extremely hands-on project-driven course. Students will work with real data across images, speech audio, and natural language. Students will leverage state-of-the-art methods to achieve high performance, as well as break these models to analyze their shortcomings in practice.
In July '24, we have updated this course in light of recent advancements with large language models and the new ecosystem of data centric problems this new class of models present.
This course will have four weekly projects. Each project will build on concepts from the prior week but have its own standalone components.
- Week 1 will be completely in a colab notebook, so no code in this repository will be used. - Week 2 through 4 will each have their own folders in
course/. - In each week's folder, you will at least one subfolder. Each subfolder is a project component. The weekly course page on Uplimit will guide you through the different subfolders.
We expect students to be proficient in Python programming, and familiar with deep learning languages like PyTorch or Tensorflow. Students should have a basic understanding of machine learning and deep learning concepts. Optional knowledge of web applications may be beneficial.
These projects are best done through Github codespaces.
- Fork this repo (leave box checked for "Copy the main branch only")
- We recommend using Github Codespaces. If you click the green "Code" button at the top right of this page, you should be able to enter a dev environment for completing this assignment.