Replit link: https://github.com/codedthinking/tender-home-bias/blob/main/replit.md Data link: https://github.com/codedthinking/tender-home-bias/releases/tag/v1.0

Introduction

Tools/ used before: R, Stata, JS, some Python

Interest: Python

Where coding will be useful

• analyzing data
• transforming data
• getting data
  • API: application programming interface
    • add some content
  • web scraping
• visualize
  • better insights
  • shape public opinion
  • interactive
• numerical /symbolic solution to equation
• decision making
  • rule-based -> machine learning
  • NLP: natural language processing

Topics

Shell

• markdown is a plain text format to add minimal structure and formatting to your text. It is popular
• CSV
• Linux / Unix

ls
ls -l
ls -l -h
man ls
help ls
ls --help
LS
ls -l
ls -lh 
# is this a comment?
mkdir data
mkdir data/raw
mkdir data/raw/european-commission
cd data/
ls
ls -l
cd raw/european-commission/
ls
curl --help
curl https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/ted-sample.csv
curl https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/ted-sample.csv
curl -o ted-sample.csv https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/ted-sample.csv
ls -l
curl -oL ted-sample.csv https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/ted-sample.csv
curl -Lo ted-sample.csv https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/ted-sample.csv
history
history > history-2023-01-10.txt

• write code that removes line numbers from bash history

The name of the virtual machine includes the username!

• Point to different shells, fish, Fig

Special folder names

.
..
~
/

absolute vs relative path

• some content on HTML
• keep full history on replit
• no "less" on replit

This is, unfortunately, only the last couple of commands

curl -L https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/country-codes.csv
curl -L https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/coun
curl https://www.scrapethissite.com/pages/simple/
curl -o data/raw/scrapethissite.html  https://www.scrapethissite.com/pages/simple/
ls -hal data/raw/
curl -o data/raw/datahub/country-codes.csv https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/country-codes.csv
curl -Lo data/raw/datahub/country-codes.csv https://github.com/codedthinking/tender-home-bias/releases/download/v1.0/country-codes.csv
curl -Lo data/raw/scrapethissite.html  https://www.scrapethissite.com/pages/simple/
cd data/raw/european-commission/
less ted-sample.csv 
head ted-sample.csv 
head --help
head -n 2 ted-sample.csv 
ls -hal 
ls -hal ted-sample.csv 
wc ted-sample.csv 
wc
wc
wc ted-sample.csv 
wc --help
wc -l ted-sample.csv 
cd
cd Unit1/
history
history > history.txt

Git

Python

Stata