Senior Data Engineer
Role details
Job location
Tech stack
Job description
- Design, build, and operate Azure Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure Data Factory to support analytical and operational workloads.
- Develop, maintain, and optimize scalable ETL/ELT pipelines using Databricks Workflows, Spark jobs, and Delta Lake to ensure reliability, performance, and enterprise-grade data quality.
- Process large-scale structured and unstructured datasets using optimized batch and streaming pipelines leveraging Apache Spark, Delta Lake, Python, SQL, and Scala.
- Collaborate with cross-functional teams to deliver enterprise solutions on Azure and support production deployments, monitoring, and operational excellence.
- Implement data quality, performance tuning, and cost-optimization practices for data platforms and pipelines.
Requirements
- Must be able to OBTAIN and MAINTAIN a Federal or DoD "Public Trust" security clearance; candidates must obtain approved adjudication of clearance prior to onboarding with Guidehouse. Candidates with an ACTIVE "Public Trust" or higher-level clearance are preferred.
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or equivalent experience.
- FIVE (5) or more years of experience as a Data Engineer, including THREE (3) years delivering enterprise solutions on Azure, specifically using Azure Databricks and Azure-native data services.
- Hands-on experience designing, building, and operating Azure Lakehouse architectures using Azure Databricks, ADLS Gen2, Azure Synapse Analytics, and Azure Data Factory.
- Experience in Apache Spark, Delta Lake, Python, SQL, and Scala, with demonstrated ability to process large-scale structured and unstructured datasets using optimized batch and streaming pipelines.
- Experience designing, developing, and maintaining scalable ETL/ELT pipelines using Databricks Workflows, Spark jobs, and Delta Lake, ensuring reliability, performance, and data quality at enterprise scale.
- Experience with real-time and batch data processing.
What Would Be Nice To Have:
- Azure certifications (for example, Azure Data Engineer) or equivalent cloud/data platform certifications.
- Experience implementing CI/CD for data engineering, MLOps pipelines, or data platform automation.
- Familiarity with data governance, observability, and cost-optimization practices at scale.
Benefits & conditions
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
Benefits include:
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Position may be eligible for a discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan
- Basic Life & Supplemental Life
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
About Guidehouse
Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.