Welcome to the course materials for BTW2401 - Data Science and Visualisation!
Here you can find the course materials for the Data Science course taught at the Bern University of Applied Sciences by Leandro von Werra in 2021. This course was originally co-developed with Lewis Tunstall.
Data science is a big deal in business these days, and with good reasons. Amongst them (Loukides, 2010):
- Almost every aspect of a business is open to data collection, be it web server logs, tweet streams, IoT sensors, online transactions, or some other source. Data science provides techniques to extract useful information from this data and thus generate added value;
- The question facing every company, startup, and non-profit that wants to attract a community in the modern era is how to use data effectively. Using data effectively requires something different from traditional statistics; namely an interdisciplinary approach that involves elements of statistics, computer science, and domain expertise. Data science is the methodology that synthesises these three domains.
In essence, data science is about the extraction of useful information and knowledge from large volumes of data, in order to improve business decision-making (Provost & Fawcett, 2013). With improved decision making comes improved productivity, market value, and competitive edge. Thus the main goal of data science is to enable data-driven decision making across the whole company, where decisions are based on the analysis of data rather than pure intuition.
There are many challenges involved with making data science an effective component of a business, but for those that succeed (Google, Amazon, Facebook, LinkedIn) the rewards are immense.
Figure: Data science in the context of various data-related processes in the organization (Provost and Fawcett, 2013).
This module provides students with a hands-on introduction to the methods of data science, with an emphasis on applying these methods to solve business problems. By the end of this course, it is expected that students will:
- Know how to approach business problems from a data science perspective;
- Understand the fundamental principles behind extracting useful knowledge from data;
- Understand the core concepts and terminology of machine learning;
- Gain hands-on experience with mining data for insights.
Throughout the course, students will also have the opportunity to learn several technical skills:
- Python programming and experience with the core libaries for data analysis, visualisation, and modelling.
- Working with data: collecting, cleaning, and transforming.
- Creating and interpreting descriptive statistics.
- Creating and interpreting data visualisations.
- Practical experience with machine learning.
The module structure consists of classroom sessions, self-study tasks, and group work. The classroom sessions will involve a mix of theoretical and practical (programming) work, with an emphasis on the latter. The self-study tasks will be used to read selected chapters from the module textbook. The outline for the module is shown in the table below.
| CW | Date | Topic | Links |
|---|---|---|---|
| 8 | 24.02 | Introduction to Data Science |    |
| 9 | 03.03 | Exploratory Data Analysis |   |
| 10 | 10.03 | Feature Engineering |   |
| 11 | 17.03 | Define group project |   |
| 12 | 24.03 | Introduction to Random Forests |   |
| 13 | 31.03 | No class | |
| 14 | 07.04 | Random Forest Deep Dive |   |
| 15 | 14.04 | Model Interpretation |   |
| 16 | 21.04 | Classification |   |
| 17 | 28.04 | Overfitting |   |
| 18 | 05.05 | Neighbours and Clusters |   |
| 19 | 12.05 | Dimensions |   |
| 20 | 19.05 | No class | |
| 21 | 26.05 | Natural language processing I |   |
| 22 | 02.06 | Natural language processing II & group project submission |    |
| 23 | 09.06 | Project presentations |   |
| 24 | 16.06 | Deep learning |   |
| 25 | 23.06 | Exam preparation | |
| 26 | 30.06 | Exam preparation | |
| 27 | TBC | Final exam |
Note: To download the notebooks, right-click on the badge 
.ipynb ending.
We will be teaching most of the class via Jupyter notebooks in Python. The notebooks for each class will be made available from links on this website. Note that some parts of the notebooks are removed for you to fill in as you follow along in class. You can open and run them directly on Binder by clicking on the Binder badge (see example below) at the top of each lecture notebook. We highly encourage the use of Binder, since it requires no local installation and runs for free.
Binder badge:
A few remarks about Binder:
- Binder is free to use.
- If you edit a notebook make sure you download it, since Binder does not save your changes.
- Binder will automatically shut down user sessions that have more than 10 minutes of inactivity (if you leave your browser window open, this will be counted as “activity”).
- Binder aims to provide at least 12 hours of session time per user session. Beyond that, it is not guaranteed that the session will remain running.
Since Binder does not save your changes permanently, you should download the notebooks you worked on at the end of your session. If you want to continue your session later on you can re-upload them to Binder. See the image below for instructions how to upload and download files.
Figure: Download and upload buttons on JupyterLab as seen in the binder environment.
You can also install the data science lecture material locally on your laptop. In general, when working with Python it is recommended to use virtual environments. This makes sure that the packages you install don't interfere with the packages you already installed in other projects.
To install the data science lectures library run the following command:
pip install dslecturesTo install JupyterLab (a more advanced environment than Jupyter notebooks) run:
pip install jupyterlabThen make sure you download all course material from the GitHub repository or just the missing notebooks. In general you will need to copy all materials, since some resources such as images are not self-contained in the notebooks.
Finally, to start JuypterLab run:
jupyter-labSince we are developing the materials throughout the course you will need to update your local environment every time we move on to the next lesson. To do so just run the following command before you start JupyterLab
pip install --upgrade dslecturesBefore class
We expect students to prepare for each class by completing the self-study tasks in advance.
During class
Please refrain from using your phone or social media (Facebook, Twitter, etc) during class; we do however encourage you to use the class Slack group! We also expect students to take an active role during the class by asking questions and contributing to the discussions.
Academic integrity and honesty
Your answers to homework, quizzes, and exams must be your own work (except for the group project, which is a collaborative task). Please don’t cheat or plagiarise other people’s work.
The assessment for this module involves two parts whose sum is 100 points: one group project (50 points), and one final written exam (50 points). The total number of points determines the overall grade for the module.
- Group project: Students will be allocated into small groups and tasked to solve an end-to-end data science project. The results from the analysis must be submitted in the form of a Jupyter notebook, followed by a 15 minute oral presentation to the class. The maximum score for this assessment is 50 points, evenly distributed across the analysis code (25 points) and presentation (25 points).
- Written examination: The final written examination will consist of multiple choice and short answer questions, covering the content of the lectures and the module textbook. Students will not be required to solve any Python programming questions in the exam. The exam has a maximum score of 50 points and the final date will be announced.
Data Science
- F. Provost and T. Fawcett, Data Science for Business, (O’Reilly Media 2013).
- J. VanderPlas, Python for Data Science Handbook, (O’Reilly Media 2016).
Provost & Fawcett will be used as the primary textbook for the module and is the standard data science text for business programs at over 150 universities around the world. The book by VanderPlas is an excellent reference for the Python programming aspects of the module.
Python Programming
- W. McKinney, Python for Data Analysis, 2nd ed (O’Reilly Media 2017).
We will use the Python programming language to analyse and visualise a variety of datasets in this module. McKinney’s book is an excellent reference to have at hand and covers the nuts and bolts of the NumPy and pandas packages.
Machine Learning
- A. Géron, Hands-On Machine Learning with Scikit-Learn and TensorFlow, (O’Reilly Media 2017).
- J. Howard, Introduction to Machine Learning for Coders, (fastAI 2018).
Although machine learning is not the only focus of this course, Géron’s book or fastAI’s MOOC provide the right level of technical detail to gain a deeper understanding of this exciting field.
Kaggle Learn
Kaggle Learn is a great resource to brush up on concepts like Python basics, data visualisation or pandas in an online notebook environment (similar to Binder).
- M. Loukides, What is Data Science?, (O’Reilly 2010). Retrieved from https://www.oreilly.com/ideas/what-is-data-science
- D. Conway, The Data Science Venn Diagram, (2010). Retrieved from http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram