Fabric Data Engineer - Data Security & DevOps Focus
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+50 more
Job description
We are seeking a skilled Fabric Data Engineer - Data Security & Dev Ops Focus candidate with strong expertise in data security, DevOps practices, and Microsoft Fabric to design, build, and maintain secure, scalable, and highly automated data pipelines and infrastructure. In this role, you will leverage Microsoft Fabric’s unified analytics platform (including Lakehouse, Data Factory, Spark, Real-Time Analytics, and OneLake) to ensure that data is collected, processed, stored, and accessed securely while applying modern DevOps principles for reliability, observability, and continuous delivery. You will partner closely with security, compliance, platform, data science, and engineering teams to embed security and operational excellence throughout the data lifecycle., * Design, develop, and optimize secure ETL/ELT pipelines and data workflows using Microsoft Fabric (Data Factory, Spark notebooks, pipelines) as well as complementary modern tools (e.g., Airflow, dbt, Kafka).
- Build and maintain Lakehouses, warehouses, and data platforms in Microsoft Fabric (OneLake) and related cloud services, with strong emphasis on encryption, access controls, sensitivity labels, and data isolation.
- Implement and enforce data security controls including encryption at rest and in transit, tokenization, masking, row-level and column-level security, workspace and item-level permissions, and fine-grained access management within Fabric and connected Microsoft services.
- Integrate security and compliance requirements (GDPR, CCPA/CPRA, HIPAA, SOC 2, ISO 27001, or industry-specific regulations) into Microsoft Fabric architectures and pipelines, leveraging Microsoft Purview and Fabric governance capabilities where applicable.
- Apply DevOps practices to data infrastructure: design and maintain CI/CD pipelines for Fabric workspaces, notebooks, pipelines, and infrastructure-as-code (IaC); automate testing and deployment of data services.
- Containerize supporting data applications and services (Docker) and orchestrate them where appropriate (Kubernetes or managed equivalents); manage infrastructure using tools such as Terraform, Azure Resource Manager, Bicep, or Pulumi.
- Implement monitoring, logging, alerting, and observability for Fabric pipelines, Lakehouses, and related platforms (e.g., Azure Monitor, Fabric monitoring, Prometheus, Grafana, Datadog, or ELK stack) with a focus on security events and performance.
- Automate security testing, vulnerability scanning, compliance checks, and policy-as-code within CI/CD pipelines for Fabric and supporting data infrastructure.
- Monitor data pipelines for anomalies, unauthorized access attempts, and potential breaches; collaborate with security and platform teams on incident response and reliability improvements.
- Develop and maintain data governance frameworks, including data cataloging, lineage tracking, classification, and retention policies with security and operational controls in mind (including Fabric and Purview integration).
- Collaborate with stakeholders to translate security, reliability, and business requirements into technical solutions that balance usability, performance, protection, and maintainability on the Microsoft Fabric platform.
- Document architectures, security controls, runbooks, and operational processes; contribute to security awareness and DevOps best practices across the data and platform teams.
Requirements
-
Strong proficiency in SQL and at least one programming language commonly used in data engineering (Python preferred; Scala or Java a plus);
- Familiarity with data governance, privacy regulations, and compliance frameworks; exposure to Microsoft Purview is a plus.
- Solid understanding of distributed systems, data modeling, and performance optimization in secure, automated environments.
- Excellent problem-solving skills and the ability to communicate technical security and operational concepts to both technical and non-technical audiences., * Bachelor’s degree in Computer Science, Information Security, Engineering, or equivalent practical experience.
- 5+ years of hands-on experience as a Data Engineer building production data pipelines and platforms.
- Hands-on experience with Microsoft Fabric (Lakehouse, Data Factory pipelines, Spark, OneLake) or closely related Microsoft analytics services (Synapse Analytics, Azure Data Factory, Azure Databricks).
- Experience with cloud data platforms (especially Azure) and their security services (e.g., Microsoft Entra ID / Azure AD, Key Vault, Private Endpoints, Defender for Cloud, or equivalents).
- Demonstrated experience implementing data security measures: encryption, access control, data masking/anonymization, sensitivity labeling, and secure data sharing.
- Solid DevOps experience, including CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, GitLab CI, or similar), infrastructure-as-code, containerization (Docker), and basic orchestration concepts.
- Experience with monitoring, logging, and alerting tools in production environments.
- US Citizenship required., * Experience with Spark (PySpark) is highly desirable.
- Direct production experience with Microsoft Fabric workspaces, shortcuts, mirroring, Real-Time Analytics, or Data Activator.
- Certifications such as Microsoft Fabric Analytics Engineer Associate, Azure Data Engineer Associate, Azure Security Engineer, AWS Certified Security - Specialty, Kubernetes (CKA/CKAD), CISSP, CISM, or equivalent.
- Hands-on experience with Kubernetes, Helm, or managed container services in data workloads.
- Experience with modern data stack tools that support security and automation features (dbt, Fivetran/Airbyte with secure connectors, Great Expectations or similar for data quality/security checks).
- Knowledge of zero-trust architecture principles and GitOps practices applied to Microsoft Fabric and Azure data platforms.
- Experience with real-time streaming security considerations, secure API/data product design, and policy-as-code tools.
- Prior work in regulated industries (finance, healthcare, government, etc.).
Benefits & conditions
Our health and welfare benefits are designed to support you and your priorities. Offerings include:
- Health, dental, and vision insurance
- Paid time off and holidays
- Retirement benefits (including 401(k) matching)
- Educational reimbursement
- Parental leave
- Employee stock purchase plan
- Tax-saving options
- Disability and life insurance
- Pet insurance
Note: Benefits may vary based on employment type, location, and applicable agreements. Positions governed by a Collective Bargaining Agreement (CBA), the McNamara-O’Hara Service Contract Act (SCA), or other employment contracts may include different provisions/benefits.
About the company
Amentum is a global leader in advanced engineering and innovative technology solutions, trusted by the United States and its allies to address their most significant and complex challenges in science, security and sustainability. Our people apply undaunted curiosity, relentless ambition and boundless imagination to challenge convention and drive progress. Our commitments are underpinned by the belief that safety, collaboration and well-being are integral to success. Headquartered in Chantilly, Virginia, we have approximately 50,000 employees in more than 70 countries across all 7 continents.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…