Batch geospatial analytics

DesignHard50 minUber and Databricks style

Your task

Design a batch geospatial analytics pipeline that answers questions like 'how many of yesterday's 100M trips passed through each city district' and 'join 500M GPS pings to administrative boundary polygons', a large-scale point-in-polygon spatial join over billions of points against millions of polygons, run daily. Cover the partitioning, the join algorithm, and how you avoid skew.

It covers

  • Spatial join
  • Batch
  • Analytics