Company Overview
Our client is transforming the future of healthcare marketing through the power of real-world data and real-time decisioning. The organization combines innovative technology, proprietary datasets, and a mission-driven culture to help brands connect the right health audiences with precision and scale. Recognized as a fast-growing leader in digital health innovation, the company fosters a collaborative, inclusive environment where data, technology, and purpose come together to drive meaningful outcomes. As the company continues to expand its data and technology footprint, they are seeking a Sr. Data Engineer to help power the next phase of growth in advanced analytics, AI, and real-time data activation.
Position Overview
This role offers the opportunity to work at massive data scale—processing 80+ billion daily events—while helping evolve the data infrastructure that fuels the company’s most mission-critical products. The Sr. Data Engineer will design and optimize distributed data systems that power real-time reporting, analytics, and machine-learning pipelines used by global clients and internal product teams. This is a highly visible position with direct impact on data accessibility, performance, and product innovation across the organization. For an engineer who wants to own modern, high-throughput data architecture and influence cloud-migration strategy, this role provides both technical depth and long-term growth into Lead or Principal-level ownership.
Top 3 Career Selling Points
- Work with cutting-edge open-source and cloud-based data tech at true enterprise scale (20TB+ processed daily, 200TB uncompressed).
- High visibility role with ownership of core data pipelines that directly power revenue-generating products.
- Opportunity to mentor junior engineers and help shape data platform modernization, including cloud migration and next-gen streaming systems.
Key Responsibilities
- Design, build, and maintain scalable distributed data processing systems supporting real-time workloads.
- Optimize data ingestion, transformation, and performance using technologies such as Kafka, Hadoop, Spark, Presto, and Kubernetes.
- Ensure data quality, reliability, and observability across pipelines and storage layers.
- Partner cross-functionally with data science, analytics, and product engineering teams to expand data accessibility and usability.
- Mentor junior engineers and contribute to best practices, code reviews, and architectural decisions.
- Maintain and evolve frameworks supporting Spark, Hive, and Kafka-based aggregation and streaming jobs.
- Evaluate and implement new tools, technologies, and approaches for scale, automation, and efficiency.
- Support high-availability architecture, backup/recovery, and capacity planning for production data systems.
Sr. Data Engineer Job Descripti…
Position Qualifications
Required
- Proven track record building and optimizing distributed data systems at large scale.
- 8+ years of data engineering experience, including advanced SQL and Python skills.
- 3+ years of hands-on experience with Spark in production environments.
- Experience with Hadoop, Hive, and on-premise data infrastructure.
- Strong understanding of RDBMS internals, query optimization, and data performance engineering.
- Experience working in Linux environments.
- Must be able to work U.S. East Coast hours (remote OK).
Preferred
- Experience with cloud data platforms (GCP, AWS, or Azure) and/or migration of legacy systems to cloud.
- Experience with Scala or Java.
- Background in ad-tech, mar-tech, health data, or high-volume event data environments.
- Experience with Airflow, Presto/Trino, Kafka Streaming, Kubernetes, or Apache Iceberg.
Call to Action
If you’re ready to take on high-impact engineering work at massive data scale while shaping the future of healthcare technology, we’d love to hear from you. Apply today and a member of Talentfoot’s recruitment team will be in touch if your background is a match.
Talentfoot Overview
Talentfoot Executive Search specializes in future-proofing organizations by securing forward-thinking leaders across sales, marketing, eCommerce, product, data, operations, finance, and technology with a track record of accelerating growth, innovation and profitability. Since 2010, we’ve partnered with more than 2,500 companies and lead the industry with a 98% client success rate. Learn more at Talentfoot.com.