Week 2

Data collection & EDA
Published

October 2, 2023

Modified

October 5, 2023

Day02

  • Data collection & numerical summaries
  • Sections 1.1-1.4

Slides

Recordings

  • Pre-recorded lessons are on Echo Cloud (aka echo 360 or echo video).
    • These can be accessed in Sakai by navigating to the BSTA 511/611 page and clicking on the Echo Cloud option in the left-side menu.
    • This will redirect you to an echo video page with a list of pre-recorded videos.
  • In-class recording links are on Sakai. Navigate to Course Materials -> Schedule with links to in-class recordings. Note that the password to the recordings is at the top of the page.

Class discussion

Please look over the following topics. We will be discussing these in class.

  • Slide 45: Robust estimates
  • HW 1
    • Book problems: 1.8, 1.20, 1.31
  • R packages: any difficulty installing packages?

Day03

  • Data visualization, exploratory data analysis (EDA), and summarizing categorical data
  • Sections 1.5-1.7 & supplementary material
Note

As I mentioned in the recording, the various options in more complex figures I usually look up how to implement when I need them. I show them so that you are aware of some of the functionality and options one has in creating figures using the ggplot2 package. At the end of the slides, we cover how to create tables summarizing data, especially categorical data. This part has some very useful code and data wrangling in it.

Slides

Class discussion

  • Can distribution shape and sample size be determined from a boxplot? (see slide 30)
  • Is there evidence of ethnicity (Hispanic vs. White non-Hispanic) discrimination in DDS expenditures? Why or why not?

Part 2 slides

The Day 3 Part 2 slides include extra EDA to examine further the question of whether there is evidence of ethnicity (Hispanic vs. White non-Hispanic) discrimination in DDS expenditures based on the data.

Part 3 slides: Data Wrangling

The Day 3 Part 3 slides provide more data wrangling examples. Some of the functions covered were used in the Day 3 Part 2 slides.

HW 2 makes reference to some of the functions in these slides.

Homework

  • HW 1 due on Sat, 10/7
    • Covers Days 1-2
  • HW 2 due on Sat, 10/14
    • Covers Days 3-5
  • HW 3 due on Sat, 10/21
    • Covers Days 6-7

Why is {.unnumbered} included at the end of some of the section headers on the HW?

  • I added the option for the sections to be numbered in the YAML (number-sections: true) so that the R exercises at the end of the file are numbered.
  • However, the book exercises already have their own numbering, and so I added {.unnumbered} to the section headers of the book exercises so that they are not numbered twice.

Recordings

  • Pre-recorded lessons are on Echo Cloud (aka echo 360 or echo video).
    • These can be accessed in Sakai by navigating to the BSTA 511/611 page and clicking on the Echo Cloud option in the left-side menu.
    • This will redirect you to an echo video page with a list of pre-recorded videos.
  • In-class recording links are on Sakai. Navigate to Course Materials -> Schedule with links to in-class recordings. Note that the password to the recordings is at the top of the page.