generated from jtr13/cctemplate
-
Notifications
You must be signed in to change notification settings - Fork 78
/
learning_data_science_visually.Rmd
189 lines (98 loc) · 10.7 KB
/
learning_data_science_visually.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
# What you see is what you understand: learning data science visually
Rohan Poddar
*"Visualization is the process of making an external spatial representation of information. Visualizing is a useful strategy for discovering structure and organizing information efficiently"* (Schwartz, Tsang, & Blair, 2016, p. 277)
Data Science consists of a lot of abstract concepts like Linear Algebra, Probability and Statistics, and Machine Learning. I believe a great way to develop a strong understanding and intuition of these concepts is by learning through interactive visualizations. I have curated a list of resources that cover some of the important topics in a visually interactive way.
------------------------------------------------------------------------
## Programming
### 1. Python Tutor
Link: <https://pythontutor.com/>
Writing code is very abstract and become difficult to follow as the length and complexity of the code increases. Python Tutor helps learn Python, JavaScript, C, C++, and Java programming by visualizing code execution.
### 2. Pandas Tutor
Link: <https://pandastutor.com/>
Transforming and manipulating Pandas data frames are the backbone of every Data Science project. However, manipulating data frames can become very complex to hard to follow. Using bulky print statements and copy-pasting snippets of the code to see what is happening can get cumbersome. Pandas Tutor lets you write code directly in the browser and helps visualize the data transformation step-by-step.
 {width="48%"}
### 3. TidyData Tutor
Link: <https://tidydatatutor.com/>
Similar to Pandas Tutor, Tidy Data Tutor lets you write R code in the browser and helps visualize how the data frame changes at each step of a data analysis pipeline.
{width="48%"} {width="48%"}
------------------------------------------------------------------------
## Probability and Statistics
### 1. Seeing Theory
Link: <https://seeing-theory.brown.edu/>
Seeing Theory was created by an undergraduate student at Brown University with the aim of making statistics more accessible through interactive visualizations. Seeing theory breaks down statistical concepts into 6 chapters:
1. **Basic Probability** - An introduction to the basic concepts of probability theory.\
*Chance Events, Expectation and Variance*
{width="48%"} {width="48%"}
2. **Compound Probability** - Further discusses concepts that lie at the core of probability theory.\
*Set Theory, Counting, Conditional Probability*
{width="48%"} {width="48%"}
3. **Probability Distributions** - Specifies the relative likelihoods of all possible outcomes.\
*Random Variables, Discrete and Continuous, Central Limit Theorem*
{width="48%"} {width="48%"}
4. **Frequentist Inference** - The process of determining properties of an underlying distribution via the observation of data. *Point Estimation, Interval Estimation, The Bootstrap*
{width="48%"} {width="48%"}
5. **Bayesian Inference** - Techniques specifying how one should update one's beliefs upon observing data. *Bayes' Theorem, Likelihood, Prior to Posterior*
{width="48%"} {width="48%"}
6. **Regression Analysis** - An approach for modeling the linear relationship between two variables.\
*Ordinary Least Squares, Correlation, Analysis of Variance*
{width="48%"} {width="48%"}
------------------------------------------------------------------------
## Linear Algebra
### 1. Immersive Linear Algebra
Link: <http://immersivemath.com/ila/index.html>
Linear Algebra is another important area of Data Science that is very abstract which makes it hard to understand at times. Immersive Linear Algebra uses interactive figures to explain and simplify the different concepts.
{width="48%"} {width="48%"}
------------------------------------------------------------------------
## Machine Learning
### 1. R2D3
Link: <http://www.r2d3.us/>
R2D3 describes itself as "an experiment in expressing statistical thinking with interactive design". The website visually introduces Machine Learning by visualizing the steps of understanding the data, creating and tuning a model that helps distinguish homes in New York from homes in San Francisco. It is broken down into 2 parts:
1. **A visual introduction to machine learning**\
(<http://www.r2d3.us/visual-intro-to-machine-learning-part-1/>)
{width="48%"} {width="48%"}
2. **Model Tuning and the Bias-Variance Tradeoff\
**(<http://www.r2d3.us/visual-intro-to-machine-learning-part-2/>)
{width="48%"} {width="48%"}
R2D3 also has a miscellaneous visualization piece on COVID-19.
1. **Making sense of COVID19 through simulations\
**(<http://www.r2d3.us/covid-19/>)
{width="48%"} {width="48%"}
### 2. ConvNetJS
Link: <https://cs.stanford.edu/people/karpathy/convnetjs/index.html>
ConvNetJS is a Javascript library for training Deep Learning models (Neural Networks) entirely in your browser. It has an additional functionality of visualizing the models and the outputs at various layers. It's a great resource to explore some frequently used data sets and models.
{width="48%"}
{width="48%"}
### 3. AI Notes by DeepLearning.AI
Link: <https://www.deeplearning.ai/ai-notes/index.html>
AI Notes is a series of long-form tutorials with interactive visualizations that help build intuition about foundational deep learning concepts. It is broken down into 2 parts:
1. **Initializing neural networks**
{width="48%"}
{width="48%"}
2. **Parameter optimization in neural networks**
{width="48%"}
{width="48%"}
### 4. OpenAI Microscope
Link: <https://microscope.openai.com/models>
OpenAI Microscope is a collection of visualizations of every significant layer and neuron of several common "model organisms" which are often studied in interpretability. Microscope makes it easier to analyze the features that form inside these neural networks, and move towards understanding these complicated systems.
{width="48%"}
{width="48%"}
### 5. MLU-Explain
Link: <https://mlu-explain.github.io/>
MLU-Explain exists to teach important machine learning concepts through visual essays in a fun, informative, and accessible manner.
It includes topics like: Cross-Validation, Linear and Logistic Regression, ROC & AUC, Train, test and validation sets, Precision & Recall, Decision Trees & Random Forests, etc.
{width="48%"}
![](resources/learning_data_science_visually/Screenshot%202022-11-14%20at%206.23.00%20PM.png"){width="48%"}
------------------------------------------------------------------------
## Journals and Publications
### 1. Distill
Link: <https://distill.pub/>
Distill is a scientific journal that operated between 2016 and 2021. However, most of the research papers and articles on the website are very engaging and remain highly relevant for Data Scientists. Distill shares Machine Learning Research in interactive and new ways to facilitate learning and thinking.
{width="48%"}
{width="48%"}
### 2. The Pudding
Link: <https://pudding.cool/>
The Pudding is a digital publication with the aim of making data fun through their various visual essay on contemporary topics. While Pudding does not explicitly teach Data Science concepts, it's a great resource to see the fun ways of visualizing projects.
{width="48%"}
{width="48%"}
------------------------------------------------------------------------