ic23050

Deliverables:

Presentation

We deliver a tableau notebook and data extract in the Tools for WTSC directory that has been enriched with demographic data and geocoding. Our intent is to give the WTSC the tools to continue their analysis after this challenge concludes.

To open the file, simply double click the .twb file with Tableau installed on your system.

The presentation is also available on Tableau public at this link: https://public.tableau.com/views/IC23050-WTSCL4/Story1?:language=en-US&:display_count=n&:origin=viz_share_link

Tools

Our philosophy in approaching the challenge was to give the WTSC the tools they need to continue working on the problem after the challenge ends. To that end we present:

The Enriched Notebook

As described above, we have taken care of enriching the data with US Census information about demographics and commuting, as well as reverse geo-coding the crash locations as ZIP codes. This is intended to be used in tableau and can be saved to a local machine and opened by clicking on the .twb file. (Note: the .hyper file must be in the same directory, that is the data that fuels the notebook)

The self-help geocoder.

We provide two notebooks that we intend to be run in google colab that will allow the WTSC to conduct self-help reverse geocoding in the future. They spoke in their introduction brief about how this was a big limitation of theirs, so we make available to them the tools to solve it themselves in future. One notebook allows for a single (Lat,Long) to be converted to ZIP, and the other will accept a .CSV with a Lat (y) and Long (x) fields, geolocate them and append the ZIP code to the record. To use on google collab, visit the collab website, and upload the .ipnb file to collab. This will allow users to interact with the workbook and follow the inbuilt instructions.

The Data-Dictionary.

The WTSC data dictionary is comprehensive but designed for a human user. We provide a .json encoding of the data dictionary. The .json contains around 20,000 key value pairs from the WTSC data dictionary that will allow future analysis and development to convert their encoded values into human-readable formats. If requested, we will package up the code we used to do the conversion from encoded to human-readable data using the data dictionary. It is currently located in the Analsis Artifacts / Data Cleaning directory.

Work Tracking:

Challenge Questions:

1. Among drivers involved in fatal crashes, what proportion are involved in crashes in communities where they live?

   a. Are there differences in the types of crashes and behavior factors in those crashes among “residents” versus those deemed to be not “from” the area?

2. Are there specific resident ZIP Codes that tend to produce higher-risk drivers that are involved in fatal crashes at a higher rate?

   a. What are the population demographics of these high-risk driver producing ZIP Codes?

Constraints:

1. Should be usable and interpretable by 'non-python' people
2. Should be usable and interpretable by 'non-GIS' people

Goals:

• Produce a report that addresses the answers to the two questions above.
• Prodice an interactive map to support the analysis and answers of the two questions above.
• Produce a tool that WTSC can use in future to convert reverse Geocode their data and become self-sufficient.
• Produce a presentation to communicate our findings.

Timeline

• 25 1130 Feb 23: Problem Brief

• 25 Feb 23: Geocoding Complete

• 26 Feb 23: Data Cleaning Complete

• 02 1200 Mar 23: 250 Word abstract due to Judges

• 03 1600 Mar 23: Full Rehearsal of Presentation

• 04 1000 Mar 23: Judging Day Begins

TO DO:

• Reverse Geocode of Coordinates

  • Google Maps API @Nicole -> Proceed with this
  • QGis Layer @Kent -> Have as backup

• Data Cleaning

  • Remove incomplete Records
  • Get Full addresses for each Lat/Long @ Nicole

• Data Dictionary Encoding @Kent

  • Turn data Dictionary into actual atomic dictionary. @Kent
    • CrashDataFile
    • PersonDataFile
    • Tables1
    • Tables2
    • Tables3
    • Tables4
    • Tables5
    • Tables6
    • Tables7
    • Tables8
    • Tables9
  • Manual Review & Edits @ Kent
    • CrashDataFile
    • PersonDataFile
    • Tables1
    • Tables2
    • Tables3
    • Tables4
    • Tables5
    • Tables6
    • Tables7
    • Tables8
    • Tables9

• Tableau Analysis

  • Generate Heatmaps of Crash Locations Hypothesis: There are "black spots" where many crashes occur @Kent

    • Complete. Some clustering apparent for driver home ZIP, NSTR for crash location overall.

  • Generate Graphic Showing which Crashes are In / Out of ZIP Codes Hypothesis: Most People Crash within their own ZIP Codes @Kent

    • Complete. 20% Crash in own ZIP, no real change Year on Year.

  • What Types of Crashes Are most common for In ZIP / Out of ZIP Crashes @Kent - Answer

    • Out Of Home Zip Crashes: (% of all crashes) (1) 9.075% Pedestrian in Road, (2) 8.664% From Opposite Direction Over Left Lane Line (3) 6.050% Off The Edge of The Road on the Right Side
    • In Zip Crashes (% of all Crashes) (1) 2.856% From Opposite Direction Over Left Lane Line, (2) 2.202% Off The Edge of The Road on the Right Side, (3) 2.130% Pedestrian in Road
    • As Proportion of total, they are both consistent types of accident. As proportion of each type of crash, they are also consistently the three biggest.
    • What Types of Behavioural Factors are most common for In ZIP / Ourt of ZIP Crashes
      • Not enough Data
    • What are the demographics of the Highest Crash Rate ZIPs @Nicole
      • No Defining Features by ZIP
      • Commuting Population Weakly Correlates with high Crash Rate ZIP
    • What are the demographics of the lowest Crash Rate ZIPs @Nicole
      • No Defining Features by ZIP
      • Commuting Population Weakly Correlated with High Crash Rate ZIP

  • Generate Graphic Showing Crash Concentration by Time of Day || Hypothesis: People Crash on their way home after a long commute

    • People Crash more at Rush Hour

  • Generate Graphic Showing Crash relation to driver distraction || Hypothesis: People Take More Zoom Calls while driving since COVID

    • Not enough data

  • Generate Graphic Showing the change over time (I.e. Add a Time-bar slider) || Hypothesis: Traffic Fatalities have increased since COVID

    • No significant changes

• Get Data From US Census @Harsh

  • Commuting Data By ZIP @Harsh
  • Employment Data By ZIP @Harsh
  • Schooling Data by ZIP @Harsh

• Embed in a web page / interactive workbook @harsh

  • Tableau Dashboard

• Write Abstract (DUE 02 1200 Mar 23)

Links to Other Datasets:

• Zipcode and OSM tag from Lat/Long using Geopy Geocoder Python library Nominatim
• Data from data.census.gov augmenting zipcode using uszipcode Python library
• Possible library to augment OSM tags with road network info and construction status: pyrosm Python Library
  • Distributions of proximity to speed cameras, stop lights, stop signs, etc.
  • Roads under construction or not