Analyzing NYC's 311 Street Flooding Complaints from 2010 to 2020

Mark Bauer

Table of Contents

• Introduction
• Prerequisites
• Analysis Notebooks
• Data
• Output Data
• Data Wrangling Notebooks
• Open Source Applications Used in Project
• Resources
• Media
• Further Reading
• Say Hello!

Introduction

Flooding poses a serious threat to coastal cities all around the world, and New York City is no exception. Hurricane Sandy in 2012 devastated the area, with many communities still suffering from its effects or unable to fully recover. What can citizen science data tell us about where flooding occurs and how it is changing over time? Additionally, how can this data potentially play a role in how New York City prepares and ultimately mitigates flooding in the future?

In this project, I explored NYC's 311 street flooding complaints data. Specifically, I attempted to answer the following questions:

1. The distribution of street flooding complaints throughout the five boroughs
2. How street flooding complaints are changing over time
3. The average and median response hours to 311 street flooding complaints
4. Case studies from Midland Beach, Staten Island and Arverne, Queens

You can run an interactive example on MyBinder through your browser - no installation required: click here . Loading MyBinder is a bit slow, but it will load eventually.

Prerequisites

• Basics of Python or other programming languages (R, SQL, etc.)
• Knowledge of Data Analysis
• Basics of Jupyter Notebooks

This project recommends beginner-level proficiency with Python and is focused on applying Python to data analysis.

Analysis Notebooks

You can view these notebooks through your browser by clicking View under the Static Webpage column.

File Name	Description	Static Webpage
analysis_mapping.ipynb	Analyzing street flooding complaints by location.	View
analysis_timeseries.ipynb	Analyzing street flooding complaints through time.	View
analysis_streets_and_case_studies.ipynb	Analyzing street flooding complaints by street and case studies from Arverne and Midland Beachs.	View

Data

Dataset	Description
311 Street Flooding Complaints	All 311 Service Requests from 2010 to present.
Streets	The NYC Street Centerline (CSCL) is a road-bed representation of New York City streets containing address ranges and other information such as traffic directions, road types, segment types.
Neighborhood Tabulation Areas	GIS data: Boundaries of Neighborhood Tabulation Areas as created by the NYC Department of City Planning using whole census tracts from the 2010 Census as building blocks. These aggregations of census tracts are subsets of New York City's 55 Public Use Microdata Areas (PUMAs).
Boroughs	GIS data of NYC boroughs.

Data dictionaries for the datasets above can be found in the data-raw folder.

Output Data

Output data saved as .csv files for most of the plots can be found in the data-output folder.

Data Wrangling Notebooks

You can view these notebooks through your browser by clicking View under the Static Webpage column.

File Name	Description	Static Webpage
data_wrangling_311_data.ipynb	Querying 311 street flooding complaints records from NYC Open Data using the Python library sodapy.	View
data_wrangling_streets_data.ipynb	Cleaning the streets dataset.	View
data_inspection.ipynb	Inspecting data before analysis.	View

Open Source Applications Used in Project

• Anaconda: A distribution of the Python and R programming languages for scientific computing (data science, machine learning applications, large-scale data processing, predictive analytics, etc.), that aims to simplify package management and deployment.
• Project Jupyter: Project Jupyter is a non-profit, open-source project, born out of the IPython Project in 2014 as it evolved to support interactive data science and scientific computing across all programming languages.
• Jupyter Notebook: The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text.
• nbviewer: A web application that lets you enter the URL of a Jupyter Notebook file, renders that notebook as a static HTML web page, and gives you a stable link to that page which you can share with others.
• Binder: The Binder Project is an open community that makes it possible to create sharable, interactive, reproducible environments.

Resources

• NYC Open Data: Open Data is free public data published by New York City agencies and other partners.

• About NYC 311: NYC311’s mission is to provide the public with quick, easy access to all New York City government services and information while offering the best customer service. We help Agencies improve service delivery by allowing them to focus on their core missions and manage their workload efficiently. We also provide insight to improve City government through accurate, consistent measurement and analysis of service delivery.

• 311 Service Requests from 2010 to Present Webpage: 311 dataset on NYC Open Data.

• Report Street Flooding to NYC 311: The 311 portal to report flooding or ponding on a street.

Media

• NYC DOT Facebook post about NYC 311 Street Flooding.

• NYC 311 Twitter post about NYC 311 Street Flooding.

Further Reading

Inspiration for the project came from an article by Localize.city titled, "Puddles or Small Ponds? Where New Yorkers Feel Most Deluged by Street Flooding."

Say Hello!

I can be reached at:

Twitter
LinkedIn
GitHub