Databricks Data Engineer

Leidos, Inc.
Decatur, GA, United States
3 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$87,100.0 - $157,450.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Code Review Continuous Integration Data Architecture Information Engineering Data Governance Data Integrity Extract Transform Load (ETL) Data Transformation
+29 more
Data Systems Data Warehousing DevOps Dimensional Modeling Distributed Computing Environment Document-Oriented Databases Apache Hive Identity and Access Management Python (Programming Language) Machine Learning Metadata Performance Tuning Cloud Services Data Streaming Unstructured Data Workflow Management Systems Google Cloud Data Ingestion Apache Spark Git Containerization Data Lakes Pyspark Information Technology Software Coding Stream Processing Software Version Control Data Pipelines Databricks

Job description

Leidos is seeking a skilled Databricks Data Engineer to design, develop, and maintain scalable data engineering solutions on the Databricks Lakehouse Platform for the National Healthcare Safety Network (NHSN) support contract. This position is critical to supporting NHSN’s modern data platform strategy by leveraging the Databricks Lakehouse Platform to build scalable, cloud-native data engineering solutions. The Databricks Data Engineer will enable efficient data ingestion, transformation, governance, and analytics while reducing operational complexity, improving data accessibility, and accelerating business insights. This role will help establish a modern enterprise data ecosystem capable of supporting advanced analytics, artificial intelligence, machine learning, and data-driven decision-making across the organization. The ideal candidate will have hands-on experience building enterprise-grade data pipelines using Apache Spark, PySpark, Delta Lake, and cloud-native technologies. This role will be responsible for developing high-performance ETL/ELT pipelines, implementing modern data architecture, optimizing distributed workloads, and enabling analytics and reporting across the organization. The successful candidate will work closely with data architects, business analysts, data scientists, and application teams to deliver reliable, secure, and scalable data solutions that support business intelligence, machine learning, and advanced analytics initiatives., * Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark.

  • Build data ingestion frameworks to integrate structured, semi-structured, and unstructured data from various enterprise systems.
  • Develop data transformation logic using PySpark and Spark SQL.
  • Design, implement, and optimize Delta Lake tables for high performance, reliability, and scalability.
  • Implement Medallion Architecture (Bronze, Silver, Gold) for enterprise data processing.
  • Optimize Spark jobs through partitioning, caching, file compaction, and performance tuning techniques.
  • Develop and maintain data workflows using Databricks Workflows, Jobs, or orchestration tools such as Apache Airflow.
  • Implement data quality, validation, reconciliation, and monitoring processes to ensure data integrity.
  • Collaborate with cross-functional teams to understand business requirements and deliver high-quality data solutions.
  • Develop reusable data engineering frameworks, utilities, and coding standards.
  • Document data lineage, transformation logic, metadata, and technical designs.
  • Participate in code reviews and implement CI/CD processes using Git and DevOps tools.
  • Ensure compliance with enterprise data governance, security, and access management standards.

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, or a related discipline.
  • 3-7+ years of experience in Data Engineering or ETL development.
  • Hands-on experience with Databricks and Apache Spark.
  • Strong proficiency in Python and PySpark.
  • Advanced SQL development skills.
  • Experience designing and developing enterprise-scale ETL/ELT pipelines.
  • Experience working with Delta Lake and Lakehouse architecture.
  • Strong understanding of distributed data processing concepts.
  • Experience with data modeling, dimensional modeling, and data warehousing.
  • Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
  • Experience with Git-based source control and CI/CD deployment processes.
  • Strong analytical, troubleshooting, and problem-solving skills., * Databricks Certified Data Engineer Associate or Professional certification.
  • Experience with Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows.
  • Experience with Structured Streaming and real-time data processing.

Benefits & conditions

If you’re looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo - because the mission demands it. We’re not hiring followers. We’re recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We’re already at step 30 - and moving faster than anyone else dares. Original Posting: July 29, 2026 For U.S. Positions: While subject to change based on business needs, Leidos reasonably anticipates that this job requisition will remain open for at least 3 days with an anticipated close date of no earlier than 3 days after the original posting date as listed above. Pay Range: Pay Range $87,100.00 - $157,450.00 The Leidos pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. About Leidos Leidos is an industry and technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. Headquartered in Reston, Virginia, with 47,000 global employees, Leidos reported annual revenues of approximately $16.7 billion for the fiscal year ended January 3, 2025. For more information, visit . Pay and Benefits Pay and benefits are fundamental to any career decision. That’s why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at . Securing Your Data Beware of fake employment opportunities using Leidos’ name. Leidos will never ask you to provide payment-related information during any part of the employment application process (i.e., ask you for money), nor will Leidos ever advance money as part of the hiring process (i.e., send you a check or money order before doing any work). Further, Leidos will only communicate with you through emails that are generated by the Leidos.com automated system - never from free commercial services (e.g., Gmail, Yahoo, Hotmail) or via WhatsApp, Telegram, etc. If you received an email purporting to be from Leidos that asks for payment-related information or any other personal information (e.g., about you or your previous employer), and you are concerned about its legitimacy, please make us aware immediately by emailing us at . If you believe you are the victim of a scam, contact your local law enforcement and report the incident to the . Commitment to Non-Discrimination All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws. #Remote

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all