Data-Driven Design & Analysis of Structures & Materials (3dasm)

Miguel A. Bessa | miguel_bessa@brown.edu | Associate Professor

Introduction

What: This course aims to be an introduction to machine learning from a probabilistic perspective.

Where: This notebook comes from this repository

Reference: Murphy, Kevin P. Probabilistic machine learning: an introduction. MIT press, 2022. Available online here

How: We try to follow Murphy's book closely, but the sequence of Chapters and Sections is different. The intention is to use notebooks as an introduction to the topic and Murphy's book as a resource.

• If working offline: Go through this notebook and read the book.
• If attending class in person: listen to me (!) but also go through the notebook in your laptop at the same time. Read the book.
• If attending lectures remotely: listen to me (!) via Zoom and (ideally) use two screens where you have the notebook open in 1 screen and you see the lectures on the other. Read the book.

Folder structure

• The "Lectures" folder contains each lecture in a separate folder "LectureX" where X is the lecture number.
• Each "LectureX" folder contains:
  1. A jupyter notebook "3dasm_LectureX.ipynb" that you can run locally or in servers like Google Colab.
  2. A pdf "3dasm_LectureX slides.pdf" with the slides of that lecture.
  3. A "your_data" folder that you can use to create data or other things in your own computer.
• The preferred method to follow the course is to look directly into the jupyter notebook, as it contains additional notes and working code.

Grading

Homeworks 30%, Midterm 30%, and Final Project 40%.

Homeworks will be graded only with 5 levels: A+ (100%; fully correct), A (90%; has minor error), B (75%; has significant error), C (60%; mostly incorrect but homework was delivered), D (0%, not delivered). If you deliver something with an honest attempt at solving the homework you get 60% for that homework.

Note

Late Homework can only get up to A (90%).

The worst Homework is removed from the final grade.

Course outline

DATE	SUBJECT	Notebook	PDF	Homework	Colab
Wed 9/4	Introduction & Basics of univariate statistics	Lecture 1	Slides	HW1 assigned
Fri 9/6	Handling data with Pandas	Lecture 2	Slides
Mon 9/9	Introducing joint & conditional distributions; Bayes' rule	Lecture 3	Slides
Wed 9/11	Multivariate statistics; visualization of joint & conditional distributions	Lecture 4	Slides	HW1 due & HW2 assigned
Fri 9/13	Bayesian inference for one hidden rv: Part I	Lecture 5	Slides
Mon 9/16	Bayesian inference for one hidden rv: Part II	Lecture 6	Slides
Wed 9/18	Bayesian inference for one hidden rv: Part III	Lecture 7	Slides	HW2 due & HW3 assigned
Fri 9/20	Machine Learning without going Bayesian: Point Estimates	Lecture 8	Slides
Mon 9/23	Linear Regression: Part I	Lecture 9	Slides
Wed 9/25	Linear Regression: Part II	Lecture 10	Slides	HW3 due & HW4 assigned
Fri 9/27	Linear Regression: Part III	Lecture 11	Slides
Mon 9/30	Linear Regression: Part IV	Lecture 12	Slides
Wed 10/2	Gaussian process regression: Part I	Lecture 13	Slides	HW4 due & HW5 assigned
Fri 10/4	Gaussian process regression: Part II	Lecture 14	Slides
Mon 10/7	Gaussian process regression: Part III	Lecture 15	Slides
Wed 10/9	Bayesian model selection	Lecture 16	Slides	HW5 due & HW6 assigned
Fri 10/11	TBD	Lecture 17	Slides
Mon 10/14	HOLIDAY 🥹
Wed 10/16	TBD	Lecture 18	Slides	HW6 due
Fri 10/18	MIDTERM Exam 🦾
Mon 10/21	TBD	Lecture 19	Slides	Final Project assigned
Wed 10/23	Classification	Lecture 20	Slides
Fri 10/25	TBD	Lecture 21	Slides
Mon 10/28	TBD	Lecture 22	Slides
Wed 10/30	TBD	Lecture 23	Slides
Fri 11/1	TBD	Lecture 24	Slides
Mon 11/4	TBD	Lecture 25	Slides
Wed 11/6	TBD	Lecture 26	Slides
Fri 11/8	TBD	Lecture 27	Slides
Mon 11/11	TBD	Lecture 28	Slides
Wed 11/13	TBD	Lecture 29	Slides
Fri 11/15	TBD	Lecture 30	Slides
Mon 11/18	TBD	Lecture 31	Slides
Wed 11/20	TBD	Lecture 32	Slides
Fri 11/22	TBD	Lecture 33	Slides
Mon 11/25	Thanksgiving week 🦃
Wed 11/27	Thanksgiving week 🦃
Fri 11/29	Thanksgiving week 🦃
Mon 12/02	TBD	Lecture 34	Slides
Wed 12/04	TBD	Lecture 35	Slides
Fri 12/06	Final Project presentations			Final Project report due

Installation instructions

OPTION 1. Run this notebook locally in your computer:

Homework 1 contains detailed instructions to install the virtual environment with all the packages required for this course. Below are more concise instructions for people familiar with installing mamba and tensorflow:

1. Install Mamba as described here. (See Homework 1 for additional instructions)
2. Install Jupyter notebook and extensions in base environment

mamba install -c anaconda notebook nb_conda rise ipywidgets

3. Create a virtual enviroment for this course called '3dasm':

mamba create -n 3dasm python==3.10 numpy scipy matplotlib pandas scikit-learn ipykernel f3dasm

4. Install git, open command window & clone the repository to your computer:

git clone https://github.com/bessagroup/3dasm_course

5. Install tensorflow in the '3dasm' virtual environment. (See Homework 1 for additional instructions)

6. Install scikeras in '3dasm' virtual environment:

mamba activate 3dasm
pip install scikeras

After you installed every package, you are ready to go!

• Open a (mamba) command window and load jupyter notebook (it will open in your internet browser):

jupyter notebook

• Open notebook (for example: 3dasm_course/Lectures/Lecture1/3dasm_Lecture1.ipynb) and choose the '3dasm' kernel.

You're all set!

OPTION 2. Use Google's Colab (no installation required, but times out if idle):

1. go to Google Colab
2. Login with your credentials
3. File > Open notebook
4. Click on Github (no need to login or authorize anything)
5. paste the git link: https://github.com/bessagroup/3dasm_course
6. click search and then click on the notebook (for example: 3dasm_course/Lectures/Lecture1/3dasm_Lecture1.ipynb)