Work Hard EverywhereJob Description
Headquarters: Austin, TX, United States
URL: http://sbgi.net
Description
Location: United States (Remote)
Reports to: SVP of Tech
As the Sr. Principal Data Engineer, you will be the primary architect of Digital Remedy’s next-generation data platform. You won't just move data; you will design the blueprints for how we handle massive-scale AdTech telemetry. You will bridge the gap between business priorities and technical execution, ensuring our "Partner" integrations are scalable, cost-efficient, and resilient.
Key Responsibilities
- Architectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using Databricks.
- Production Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelines.
- Strategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements. This requires the ability to multi-task across various high-priority workstreams without losing sight of architectural integrity.
- Infrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and production.
- Mentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and Databricks.
- Work with engineers across multiple geographies and time zones.
Mandatory Requirements
- Expert-Level Databricks: Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon).
- The Stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plus.
- Scale: Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred).
- Independent Execution: Must be a self-starter capable of taking a high-level...
URL: http://sbgi.net
Description
Location: United States (Remote)
Reports to: SVP of Tech
As the Sr. Principal Data Engineer, you will be the primary architect of Digital Remedy’s next-generation data platform. You won't just move data; you will design the blueprints for how we handle massive-scale AdTech telemetry. You will bridge the gap between business priorities and technical execution, ensuring our "Partner" integrations are scalable, cost-efficient, and resilient.
Key Responsibilities
- Architectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using Databricks.
- Production Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelines.
- Strategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements. This requires the ability to multi-task across various high-priority workstreams without losing sight of architectural integrity.
- Infrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and production.
- Mentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and Databricks.
- Work with engineers across multiple geographies and time zones.
Mandatory Requirements
- Expert-Level Databricks: Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon).
- The Stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plus.
- Scale: Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred).
- Independent Execution: Must be a self-starter capable of taking a high-level...