Data engineer - Seattle WA
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra. Develop, optimize, and manage data pipelines for ETL processes using Databricks, with a focus on data integrity and quality. Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices. Ensure data security and compliance with regulations using Databricks and Privaceraβs features. Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices. Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups. Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.
Requirements
Microsoft Windows Azure, Cisco Unity, Data Modeling, Data Management, Database Extract Transform and Load (ETL), Data Quality, Sales Pipeline, Regulatory Compliance, Information/Data Security (InfoSec), Metadata, Azure Data bricks Azure data piplelines Azure data factory Azure data lakes Real time experience with migration to Unity Catalog- 1-2 years of hands on experience is good to have. Experience in implementing Unity catalog Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices. Good to have Privacera, and Collibra experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦