StreamSets

StreamSets

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only
Back to discussions
Expand all | Collapse all

Load Real-Time 911 Data to Snowflake

  • 1.  Load Real-Time 911 Data to Snowflake

    Posted Sat March 12, 2022 12:55 AM

     

    Read 911 Event Data and Load to Snowflake

    This pipeline uses the HTTP client to read real time 911 event data from the Seattle Fire Department. 

    • The pipeline then flattens a nested JSON object
    • It also uses the latitude and longitude of the incident location to lookup the Census block information from the Census Bureau’s geocoding API.

    Fun fact: While building this pipeline, an event came through for a dumpster fire currently happening on my block !