Data Engg with DQ Exp
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+30 more
Job description
We are seeking an experienced Azure Architect with strong expertise in Data Engineering and Data Quality (DQ) frameworks to design, implement, and govern scalable enterprise data platforms on Microsoft Azure. The ideal candidate will have deep experience in cloud-native data architectures, modern ETL/ELT pipelines, data governance, and enterprise-grade data quality practices.
The role involves working closely with business stakeholders, data engineers, architects, analytics teams, and leadership to build reliable, secure, and high-performing data ecosystems., Azure Data Architecture
- Design scalable and secure enterprise data platforms on Microsoft Azure.
- Define end-to-end cloud data architecture using Azure-native services.
- Develop reference architectures, reusable frameworks, and best practices.
- Lead migration of on-premise data platforms to Azure cloud.
- Ensure architecture aligns with business, security, governance, and compliance requirements.
Data Engineering
- Build and optimize large-scale batch and real-time data pipelines.
- Design ETL/ELT frameworks using modern Azure data services.
- Implement lakehouse/data warehouse architectures.
- Enable data integration from structured, semi-structured, and unstructured sources.
- Optimize performance, scalability, and cost of Azure data solutions.
Data Quality & Governance
- Define enterprise data quality standards, controls, and monitoring frameworks.
- Implement DQ checks including completeness, accuracy, consistency, uniqueness, and timeliness.
- Design automated DQ validation and reconciliation frameworks.
- Collaborate with governance teams on metadata management, lineage, and master data initiatives.
- Establish data observability and monitoring mechanisms.
Stakeholder Management
- Work with business users to understand analytical and operational data requirements.
- Collaborate with cross-functional teams including BI, AI/ML, governance, and infrastructure teams.
- Mentor junior engineers and provide technical leadership.
- Participate in architecture reviews, design discussions, and client presentations.
Requirements
Technical Skills
Azure Services
Strong hands-on expertise in:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- Azure SQL Database
- Azure Purview / Microsoft Purview
- Azure Event Hub / Stream Analytics
- Azure Functions
- Azure DevOps
Data Engineering
- Expertise in SQL and Python/PySpark.
- Strong understanding of data modeling techniques.
- Experience building distributed data processing systems.
- Knowledge of batch and streaming architectures.
- Experience with Delta Lake/Lakehouse concepts.
Data Quality
- Experience implementing enterprise Data Quality frameworks.
- Knowledge of DQ tools/frameworks such as Great Expectations, Deequ, Monte Carlo, Informatica DQ, or custom validation frameworks.
- Experience in data profiling, validation, reconciliation, and anomaly detection.
- Understanding of data governance and metadata management.
Cloud & DevOps
- CI/CD implementation for data pipelines.
- Infrastructure as Code (IaC) exposure using Terraform/Bicep/ARM templates.
- Experience with monitoring and logging frameworks.
- Understanding of cloud security best practices., * Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.
- 8+ years of experience in Data Engineering and Cloud Architecture.
- 4+ years of hands-on experience with Azure Data Platform.
- Experience working in enterprise-scale cloud transformation programs.
- Azure certifications preferred:
- Azure Solutions Architect Expert
- Azure Data Engineer Associate
- Azure AI Engineer (preferred)
Preferred Experience
- Experience in BFSI, Healthcare, Retail, Manufacturing, or CPG domains.
- Exposure to AI/ML data platforms.
- Experience with multi-cloud or hybrid-cloud environments.
- Familiarity with Agile delivery models.
- Client-facing consulting experience.
Soft Skills
- Strong communication and stakeholder management skills.
- Excellent problem-solving and analytical thinking.
- Ability to lead technical discussions and architecture reviews.
- Strong collaboration and mentoring capabilities.
- Ability to work in fast-paced and cross-functional environments.
Benefits & conditions
Pulled from the full job description
- Parental leave
- Paid time off
- Vision insurance
- Dental insurance
- Life insurance
- Paid holidays
- Benefits from day one, The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $140,000 - $160,000. In addition, you may be eligible for a discretionary bonus for the current performance period., As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.
About the company
Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers