1 - Intro, Shell :: STAT447 - Data Science Programming Methods - Fall 2021

DSPM > Lectures by Topics > 1 - Intro, Shell

1 - Intro, Shell

Objectives

Course Welcome and Overview
Introduction to the Shell

Topics

Shell is central:
- Common interface to all computing machinery
- Folders, paths (absolute and relative), wildcards, globbing
- Permissions for files and directories
- Job control: piping, sequences, one output is another input
Shell commands
Regular Expressions (and grep)
Shell programming
awk and sed
Intro to diff and patch

Core Material

Lecture Slides

Lecture Videos

Extras

Small examples/ directory on box.com and as a downloadable tar.gz
Example data archive downloadable as tar.gz

Supplementary Material (not required, but helpful)

Short motivational ‘Data Science’ video

Short BBC video about Hans Rosling at YouTube and 200 years that changed the world at gapminder.org with link to same short video

Extra Reading

Shell scripting tutorial free site, pdf for sale
Julia Evans ‘zine’ (not free but fairly inexpensive)
Surprisingly difficult to find a good reading list:
- Unix for the Impatient an old favourite of mine; might be a good 2nd-hand pick-up
Resources:
- Software Carpentry, The Unix Shell
Examples of tutorial-style sites
Some historical context: In the beginning was the command-line by Stephenson.
More advanced shell scripting resource: Pure Bash Bible
Andy Oram on Power and Promise of awk
Intro tutorial / overview: Understanding awk