> Markdown version of [/jobs/ext/1103795-data-engineer](https://www.wearedevelopers.com/jobs/ext/1103795-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Guidehouse Inc. - **Location:** San Antonio, TX, United States - **Experience:** Expert - **Salary:** $106,000.0 - $176,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing, Code Review, Information Systems, Continuous Integration, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Security, Identity and Access Management, Python (Programming Language), Performance Tuning, Azure Data Lake, SQL Databases, Data Streaming, Data Logging, Data Processing, Azure Data Factory, Apache Spark, Event Driven Architecture, Data Lakes, Information Technology, Apache Kafka, Data Management, Terraform, Data Pipelines, Databricks - **Published:** June 8, 2026 - **Apply:** https://www.careerboard.com/us/en/find-jobs-in-United-States/-A6D59CADE3F2A1BF8B/ ## About the Role * US Citizenship required. * An ACTIVE and MAINTAINED "SECRET" Federal or DoD security clearance. * Bachelor's degree obtained or equivalent experience. * Seven (7+) years of progressive experience in data engineering, data platform delivery, or data architecture roles, including leading technical teams or workstreams. * Strong hands-on experience with AWS data platforms, including designing and operating production systems leveraging Databricks on AWS. * Deep expertise with Apache Spark, Databricks, Delta Lake, Python, and SQL, including performance tuning of distributed workloads. * Experience designing scalable, secure data architectures that support analytics, reporting, and advanced use cases (eg, AI/ML enablement). * Familiarity with Agile delivery methods and proven ability to collaborate effectively with cross-functional and client teams. * Strong written and verbal communication skills, including the ability to explain complex technical topics to non-technical stakeholders. What Would Be Nice To Have * Experience delivering Azure-based data platforms, including Azure Databricks, ADLS Gen2, Azure Data Factory, or Synapse Analytics. * Bachelor's degree obtained. Computer Science, Engineering, Information Systems, or a related technical field. * Experience with Databricks Unity Catalog, including permissions management and governance enablement. * Infrastructure-as-Code experience (eg, Terraform) and advanced CI/CD automation for data platforms. * Experience with streaming and event-driven architectures (eg, Kafka, Kinesis). * Cloud or platform certifications (AWS, Databricks, or Azure). * Prior experience supporting DoD or Defense & Security federal clients. ## Description As a Manager in Guidehouse's AI & Data practice, you will serve as a hands-on technical leader and delivery manager designing and implementing modern cloud-native data platforms for federal clients, with a primary emphasis on AWS and Databricks. You will lead architecture decisions, mentor engineers, and ensure high-quality, secure, and scalable delivery aligned to mission outcomes., * Architect and lead delivery of AWS-based lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. * Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. * Define and enforce data architecture standards including ingestion patterns, layered/medallion designs, schema evolution, performance tuning, and cost optimization. * Implement production-grade engineering practices, including data quality validation, reconciliation, logging, monitoring, and operational alerting. * Apply data security and governance controls appropriate for federal and defense environments, including role-based access, controlled data handling, and auditability. * Partner with client stakeholders and product owners to translate mission and business requirements into technical designs, delivery roadmaps, and implementation plans. * Lead and mentor data engineers through code reviews, architecture reviews, and delivery execution; contribute to reusable accelerators and reference architectures. * Establish and mature CI/CD pipelines for Databricks workloads and supporting infrastructure, improving reliability, repeatability, and compliance of releases. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Implementing Feature Environments with AWS and Terraform](https://www.wearedevelopers.com/videos/531-implementing-feature-environments-with-aws-and-terraform) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)