software engineer, data pipeline

Skyhook, a leader in location technology and intelligence, is seeking an experienced Spark and big data processing engineer to lead our mission to manage and process a massive and growing set of diverse location information to solve global challenges. 

As our lead engineer on our Geospatial Insights product line, you will be part of the team that is building the next generation of capabilities and scale for our system that currently pushes billions of mobile observations through the pipeline.

This pipeline requires an understanding and familiarity with mobile location data and how to combine this with myriad geospatial layers to create true insights into behaviors and mobility around the globe. You will be working closely with other engineers as well as our Product, Data Analyst, Data Science, DevOps and Geo teams to implement new capabilities and drive continued scalability and resilience into the system.

Apply Now

qualified candidates will have:

    • 3+ years of full-time, industry experience
    • Experience as tech lead on multiple projects
    • Experience with large-scale distributed systems, handling billions of records a day with tight processing windows
    • Strong knowledge around system design, data modeling, data access, and data storage techniques.
    • Ability to develop in a fast-paced environment and capable of self-direction
    • Understanding of the value of collaboration within the team and across the organization
    • Strong SQL knowledge
    • 2+ years experience with Java / Scala is preferred
    • Strong scripting ability in Python / Bash
    • 2+ years experience with open source data processing          technologies (including Spark, Hive, Hadoop, and Athena)
  • Knowledge of and experience with geospatial data/technologies
  •    Knowledge of AWS technologies

About Skyhook

Skyhook is dedicated to inventing and reinventing location. And the innovation in our technology is rivaled only by the innovation of our culture. Our offices in Boston, MA and Wayne, PA are filled with Idea Paint, standing desks, bean bag chairs, crowd-controlled Sonos radio and a world class snack selection. If you love data and are fanatical about improving user experiences, we want to talk to you! If you are looking for a place where you are valued not just based on what you accomplish but how you accomplish it, then you should consider joining us.