Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a highly motivated Data Engineer - Privacy to design, develop, and support scalable data architectures and enterprise data pipelines across cloud, on-premises, and hybrid environments. The ideal candidate will have strong expertise in Azure data services, Snowflake, Databricks, and modern data engineering practices, along with experience building privacy-compliant, AI-enabled data solutions.
This role collaborates closely with cross-functional teams to architect and deliver high-performance data solutions that drive business intelligence, analytics, and privacy initiatives at scale., * Design and develop scalable data pipelines using Azure Data Factory (ADF).
- Build and optimize ETL/ELT solutions using Azure Databricks, ADLS, Snowflake, Oracle, Python, and SQL.
- Develop robust data models and optimize data structures for analytics and reporting.
- Implement data ingestion frameworks utilizing Snowflake features such as:
- Stored Procedures
- Streams
- Tasks
- Snowpipe
- Dynamic Tables
- Iceberg Tables
- Storage Integrations
- Views
- Build big data processing workflows using Apache Spark and Azure Databricks with Unity Catalog.
- Optimize SQL queries, data pipelines, and cluster configurations for performance and cost efficiency.
- Implement data quality, validation, monitoring, and governance mechanisms.
- Ensure compliance with data privacy and regulatory requirements.
- Diagnose and resolve data pipeline issues to ensure reliable data delivery.
- Develop and operate AI-driven privacy data engineering solutions using:
- Foundation Models
- Prompt Engineering
- Retrieval-Augmented Generation (RAG)
- AI Agents
- Implement audit logging, observability, and human-in-the-loop controls for AI-assisted workflows.
- Mentor team members and contribute to technical excellence and innovation.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, or a related field.
- 2-3 years of hands-on experience designing and supporting data engineering and ETL solutions.
- Strong experience with:
- Microsoft Azure Platform
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Data Lake Storage (ADLS)
- Snowflake
- Oracle
- Python
- SQL
- Expertise in writing complex, scalable, high-performance SQL queries and stored procedures.
- Experience building data solutions using Azure Flink, dbt, and open-source frameworks.
- Experience implementing CI/CD pipelines using Azure DevOps or GitLab.
- Strong analytical, troubleshooting, and problem-solving abilities.
- Excellent communication and stakeholder management skills.
- Ability to thrive in a fast-paced, agile environment.
Preferred Qualification
- Experience with privacy engineering and data governance initiatives.
- Familiarity with AI productivity tools such as Claude, Cursor, or similar IDEs.
- Experience developing vendor-agnostic data engineering solutions.
- Knowledge of Agile methodologies and software engineering best practices.