About the role
PulsePoint, a post-acquisition health and adtech company of 300+ people, is hiring a Data Engineer to join the team behind a pipeline processing over 80 billion impressions a day, roughly 20TB of data (220TB uncompressed), against near-real-time SLAs. The role covers installing and monitoring Kafka, Hadoop, Presto, and RDBMS systems, ingesting and validating internal and third-party data, and building Spark Streaming consumers for near-real-time aggregation.
You will also maintain Hive and SQL data flows, review DDL, evaluate new tools, and join a 24x7 on-call rotation. The stack includes Airflow, Docker, Kubernetes, Hive, Impala, Kafka, Presto, Spark Streaming, and SQL Server. Requirements include a CS degree or related field, 5+ years of software engineering, strong Spark, Python fluency, Linux proficiency, and solid SQL. Remote work is offered with EU, UK, or US employment.
Highlights
- Enormous scale: 80B+ impressions daily with tight, near-real-time SLAs
- Remote role with EU/UK/US employment and salary up to 150k USD, higher negotiable
- Flat hierarchy, ownership, and room to shift focus as interests evolve
- Modern data stack: Spark Streaming, Kafka, Presto, Hive, Airflow, Kubernetes
This recap is dataskew's editorial summary, not the company's copy.