Prof. Michael J. Pyrcz, @GeostatsGuy, Resources

Howdy Folks, I'm Michael Pyrcz, an Associate Professor at The University of Texas. I teach and conduct research on data analytics, geostatistics and machine learning. I'm appointed in the Hildebrand Department of Petroleum and Geosystem Engineering, the Jackson School of Geosciences and the Bureau of Economic Geology. I'm also a principal investigator in the College of Natural Sciences Energy Analytics Freshmen Research Initiative and Inventors' Program and a core faculty in the Machine Learning Laboratory in Computer Sciences, all at The University of Texas at Austin.

I feel that the role of professor is a role of service, so I post all my lectures and supporting content online resulting in evergreen content that outlasts the semester and reaches beyond campus. I hope this content supports:

• my students for ongoing learning content long after they finish my courses
• working professionals facing the digital transformation and interested to learn new skills
• potential students by breaking down barriers and making our university a welcoming place for all interested to learn

Here's an inventory of my online resources that I have made to help people learn about spatial data analytics, geostatistics and machine learning. I have produced these resources to support my students and I thought they would be useful to my students after completion of the class (an evergreen resource), to other students and working professionals interested in this topic.

I hear from students, working professionals and potential students everyday that benefit from these products!

Michael Pyrcz, Associate Professor, University of Texas at Austin

Novel Data Analytics, Geostatistics and Machine Learning Subsurface Solutions

With over 17 years of experience in spatial, subsurface data analytics consulting, research and development, and leadership, Michael has returned to academia driven by his passion for teaching and enthusiasm for enhancing engineers' and (geo)scientists' impact in spatial, subsurface resource development.

For more about Michael, my research group (15 PhDs), my consortium (DiReCT), my publications, my background, my education startup etc. check out these links:

Twitter | GitHub | Website | GoogleScholar | Book | YouTube | LinkedIn | DiReCT Website | DiReCT GitHub | daytum

About Michael

Want to learn more about my story, my publications and other contributions to open source, check this out:

0. My story of how I got started in engineering and ended up as a professor at The University of Texas at Austin My Story

1. My research, approach to research and views on building an inclusive and diverse team My Research

2. Nothing is possible without awesome graduate students My Students

3. I've written a bit, here's the books My Books

4. My peer-reviewed publications My Papers

5. My other contributions My Other Contributions

6. I wrote an open source Python package for spatial data analytics and geostatistics. Much of it is a translation of GSLIB (Deutsch and Journel, 1998) from the original Fortran to Python for 2D geostatistical methods. I did this to support my students in my Spatial Data Analytics and Geostatistics courses. Check it out and consider contributing and become a coauthor at GeostatsPy on PyPi Repository and GitHub.

• NOTE, since GeostatsPy relies on the Numba package for code acceleration, and Numba is not updated to Python >= 3.9, please use Python < 3.9 with GeostatsPy.

7. I do quite a bit on social media, here's why I do it, My Social Media Efforts.

8. Check out my TEDx talk on 'A Professor's Secret Weapon' TED Talk

9. Check out my Twitter feed for resources, ideas and possitivity most days, where I'm the GeostatsGuy Twitter.

10. I post a lot of code, demonstration workflows and course material to support anyone that wants to learn My GitHub

11. I partnered with Prof. John Foster (UT Austin) and Bazean, a technology-enabled energy investment firm, to start the energy-focussed data science education company, daytum. We are currently offering short courses in Energy Data Science.

Michael Pyrcz, Associate Professor, University of Texas at Austin

Online Resources on Spatial Data Analytics, Geostatistics and Machine Learning

Recorded Lectures

I record all my university lectures and post them on YouTube. You are welcome to join my classes!

0. Introduction - Howdy, I'm Michael

1. YouTube Channel GeostatsGuy Lectures

2. Introduction to Data Analytics, Geostatistics and Machine Learning Undergraduate Lectures (Lec00-Lec21)

3. Subsurface Modeling Graduate Course (Lec00 - Lec22)

4. Subsurface Machine Learning Graduate Course (Lec00 - Lec18)

5. Data Science Basics in Python (Chapter I - III)

6. Open Source Spatial Data Analytics in Python with GeostatsPy

7. My TED Talk, A Professor’s Secret Weapon

8. Introduction to Spatial Continuity

9. Tutorial: Open Source Spatial Data Analytics in Python with GeostatsPy

10. Geostatistical Workflows for Unconventional Reservoirs)

11. Geostatistical Workflows for Unconventional Reservoirs at BEG

12. What Does a Geoscientist Need to Know About Geostatistics? And Why It Would Be Helpful?

13. Center for Petroleum and Geosystems Engineering Webinar - Big Data Analytics for Petroleum Engineering: Hype or Panacea?

14. Michael's Unsolicited Advice and Ideas for a Successful and Happy Career in Our Industry

15. My interview on AAPG's Digging Deeper podcast with the awesome host Vern Stefanic.

GeostatsPy Python Package Workflows

I wrote a Python Package called GeostatsPy for spatial data analytics and geostatistics. Here's a set of demonstration workflows in Python Jupyter Notebook for many of the fundamental workflow steps from data preparation, statistical inference to spatial prediction with uncertainty. They go along with my recorded lectures from my courses on my YouTube channels:

• Introduction to Data Analytics and Geostatistics
• Spatial Data Analytics
• Subsurface Machine Learning

Here's the workflows:

0. GeostatsPy: Reimplementation of GSLIB in Python
1. Data Distributions with GeostatsPy
2. Feature Ranking with GeostatsPy
3. Volume Variance Relations with GeostatsPy
4. Confidence Intervals and Hypothesis Testing with GeostatsPy
5. Monte Carlo Simulation with GeostatsPy
6. Bootstrap with GeostatsPy
7. Data Distributions
8. Data Distribution Transformations with GeostatsPy
9. Declustering with GeostatsPy
10. Ensemble Declustering with GeostatsPy
11. Inverse Distance Interpolation with GeostatsPy
12. Indicator Kriging with GeostatsPy
13. Kriging with GeostatsPy
14. Multivariate Analysis with GeostatsPy
15. Overfitting Models with GeostatsPy
16. Plotting Spatial Data with GeostatsPy
17. Directional Spatial Continuity with GeostatsPy
18. Spatial Updating with GeostatsPy
19. Spatial Trend Modeling with GeostatsPy
20. Multivariate Feature Ranking with GeostatsPy
21. Variogram Calculation with GeostatsPy
22. Variogram Modeling with GeostatsPy
23. Spatial Bootstrap with GeostatsPy
24. Spatial Simulation with GeostatsPy
25. Spatial Indicator Simuluation with GeostatsPy
26. Spatial Simulation Post-processing with GeostatsPy

Interactive Python Worklfows to Support Education

I think interactive workflows are excellent tools to support education. For data analytics and machine learning, turning a dial and watching a system or machine change is a great method to gain intuition and experience. I started to put together interactive workflows with ipywidgets and matplotlib. Check them out here:

1. General Bootstrap
2. Parametric Distributions
3. Monte Carlo Simulation
4. Bootstrap Colored Balls in a Cowboy Hat
5. Norms
6. Optimization
7. Overfit
8. DYI Central Limit Theorem
9. Confidence Interval by Bootstrap and Analytical
10. Sivia's Bayesian Coin
11. Spurious Correlation
12. Correlation Coefficient
13. LASSO Regression
14. Principal Components Analysis
15. Ridge Regression
16. Simple Kriging
17. String Effect
18. Stochastic Simulation
19. Uncertainty with Spatial Aggregation
20. Kriging String Effect
21. Uncertainty Model Checking
22. Variogram Calculation
23. Variogram Modeling
24. Combined Variogram Calculation and Modeling
25. Spectral Clustering
26. Artificial Neural Networks
27. Checking Uncertainty Models
28. Shapley Values

Resources on Statistics and Probability

1. Probability Theory – my undergraduate lecture
2. Statistics – undergraduate lecture
3. Marginal, Joint & Conditional Probability – slides

Parametric Distributions

Parametric Distributions are fundamental to statistics and data analytics inferential and predictive workflows. Sometimes they are required by theory and often they result from nature. Many students struggle with them so I made simple demonstrations in Microsoft Excel that cover how to make them from scratch and how to work with them:

1. How to make them in Excel
2. Poisson distribution in Excel
3. Gaussian transform in Excel and Python
4. Log normal distribution in Excel
5. Interactive parametric distributions in Python

Hypothesis Testing

Hypothesis Testing is all about recognizing the difference that makes a difference. These tests protect us from the belief in small numbers and are bias to see patterns in random phenomenon.

1. Difference in means in Excel and in Python
2. Difference in variances in Excel and in Python
3. Difference in distributions in Excel
4. Interactive hypothesis testing in Python

Demos of Bayesian Statistics

Bayesian Apporaches are powerful. They integrate prior belief with new observations, provide explicit uncertainty models and more intuitive credible intervals for uncertainty in model parameters. Here's some accessible demonstrations to get you started thinking like a Bayesian statician.

1. The Coin Problem from Sivia (1996) in Excel
2. Bayesian updating with Gaussian in Excel
3. Probability given a positive test in Excel
4. Sivia's Bayesian Coin in Interactive Python
5. Bayesian Regression in Python
6. Naive Bayes Regression and Classification in Python

Other

1. Bootstrap in Excel, in Python and in R
2. Spatial Bootstrap in Python
3. Linear regression in Excel and in R
4. Loss functions in Excel
5. Multivariate Analysis

Heterogeneity

Our subsurface systems are heterogeneous and heterogeneity matters in many subsurface prediction problems. Here are some accessible demonstrations to help you get started quantifying heterogeneity.

1. Making an example well in Excel
2. Lorenz coefficient in Excel
3. Hurst coefficient in R
4. Ripley Cross K in R
5. Ripley K-function in Python
6. Lozenz coefficient in Python
7. Lorenz coefficient functions in Python

Machine Learning

I have an new Subsurface Machine Learning Course that builds from fundamental probability to artificial neural networks. The recorded lectures are available here:

• Subsurface Machine Learning

You are welcome to follow along! The demonstration workflows from the lectures are here:

0. Feature Imputation in Python
1. Feature Ranking in Python
2. Feature Transformations in Python
3. Feature Uncertainty in Python
4. Dimensional Reduction in Python and in R
5. Clustering in Python
6. Principal Components Analysis in Python
7. Multidimensional Scaling and Random Projection in Python
8. Linear Regression in Python
9. Ridge Regression in Python
10. LASSO Regression in Python
11. Isotonic Regression in Python
12. Bayesian Regression in Python
13. Polynomial Regression in Python
14. Naive Bayes Regression and Classification in Python
15. Time Series Analysis
16. k Nearest Neighbour
17. Decision tree in PythonPython Advanced and in R
18. Gradient Boosting in Python and Advanced Gradient Boosting in Python
19. Support Vector Machines in Python
20. Neural Networks in Python
21. Convolution Operators in Python
22. Convolutional Neural Networks in Python
23. Convolutional Neural Networks Classifier in Python
24. Generative Adversarial Networks in Python
25. Conditional Generative Adversarial Network in Python
26. Course Conclusion
27. scikit learn Overview

Geostatistics

0. GeostatsPy: Reimplementation of GSLIB in Python
1. Introduction to Data Analytics, Geostatistics and Machine Learning Undergraduate Lectures (Lec00-Lec21)
2. What Does a Geoscientist Need to Know About Geostatistics? And Why It Would Be Helpful? and PPT
3. Exercises, hands-on and demonstrations PPT Inventory
4. Functions that reimplement or call GSLIB exes in Python
5. Demo of the functions in Python
6. Declustering in Python and with PyGSLIB Package
7. Declustering and Debiasing in Excel
8. Variogram calculation in Excel and in R
9. Full variogram Calculation and Modeling in Excel and in PyGSLIB Package

Supplemental Slides

1. Facies criteria in PPT
2. Value of quantification in PPT
3. Stationarity in PPT
4. Uncertainty in PPT
5. Suggested books in PPT
6. Simple kriging in Excel and in R
7. Uncertainty Away from Data in Excel
8. Convolution methods in Python
9. LU Simulation in Pyton
10. Sequential Gaussian simulation in Excel and in R
11. Truncated Gaussian simulation in Excel
12. Spatial uncertainty in Excel
13. Volume-variance relations in Excel
14. Working with realizations in R
15. Lecture on value in industry in PPT

I hope these resources are useful.

Want to Work Together?

I hope that this is helpful to those that want to learn more about subsurface modeling, data analytics and machine learning. Students and working professionals are welcome to participate.

• Want to invite me to visit your company for training, mentoring, project review, workflow design and consulting, I'd be happy to drop by and work with you!

• Interested in partnering, supporting my graduate student research or my Subsurface Data Analytics and Machine Learning consortium (co-PIs including Profs. Foster, Torres-Verdin and van Oort)? My research combines data analytics, stochastic modeling and machine learning theory with practice to develop novel methods and workflows to add value. We are solving challenging subsurface problems!

• I can be reached at mpyrcz@austin.utexas.edu.

I'm always happy to discuss,

Michael

Michael Pyrcz, Ph.D., P.Eng. Associate Professor The Hildebrand Department of Petroleum and Geosystems Engineering, Bureau of Economic Geology, The Jackson School of Geosciences, The University of Texas at Austin

More Resources Available at: Twitter | GitHub | Website | GoogleScholar | Book | YouTube | LinkedIn