Senior Data Engineer - Remote / Telecommute

The candidate will review and translate requirements to end-to-end technical design with a goal of building data products. The candidate will develop pipelines in Databricks using PySpark and DBT to onboard various sources. The role requires working knowledge in Kafka to stream data into the Databricks platform. The successful candidate will identify common approaches and best practices to data integration such as metadata-driven ingestion, data validations, and complex data type handling. The candidate will drive standards for reusability while developing pipelines, create or update documentation associated with key decisions on requirements, design, and development, and liaise with architects, data owners, and users for daily reviews to ensure high quality of deliverables.

• 8+ years of overall IT experience with 6 years as a Data Engineer.
• Experience in providing data engineering solutions.
• Working knowledge of cloud platforms (Azure/AWS).
• Working knowledge of Databricks, Data Mesh, and Data as a Product.
• Working knowledge of Python.
• Working knowledge of data streaming tools (Kafka, EventHub, Kinesis, SNS).
• Cloud-based API management experience is nice to have.
• Immuta experience is nice to have.
• Multi-cloud and on-prem application integration experience is nice to have.