Data Engineer, Databricks

As a Data Engineer in this role, you will be responsible for designing, building, and maintaining robust data pipelines that support the organization’s analytical and operational needs. You will work closely with cross-functional teams to ensure data is collected, processed, and made available in a reliable and scalable manner. Leveraging your expertise, you will optimize data workflows and implement best practices for data integration, transformation, and storage. Your contributions will directly impact the efficiency and effectiveness of data-driven decision-making across the business. To excel in this position, you will utilize tools such as Databricks for advanced data processing and analytics, and Terraform for infrastructure automation and management. Familiarity with cloud-based environments, version control systems, and CI pipelines will further enhance your ability to deliver high-quality solutions. Experience with large-scale data architectures, real-time data streaming, and performance tuning will help you address complex challenges and drive continuous improvement. Your background in collaborating with diverse technical teams and managing end-to-end data solutions will be instrumental in achieving success in this dynamic environment.

Position Responsibilities:

• Design, build, and maintain scalable data pipelines using Databricks
• Develop and implement infrastructure as code solutions with Terraform
• Collaborate with cross-functional teams to understand data requirements and deliver robust solutions
• Optimize data workflows for performance, reliability, and scalability
• Monitor, troubleshoot, and resolve issues related to data processing and infrastructure
• Ensure data quality and integrity throughout the data lifecycle
• Automate repetitive tasks to improve efficiency and reduce manual intervention

• U.S. Citizenship
• 2+ years of engineering experience on Databricks and large-scale big data projects (Delta Lake, DLT, Apache Spark, unity Catalog).
• Bachelor’s Degree
• 4+ years of experience in Python, Java, or equivalent. Comfortable with evaluation tooling, logging, monitoring, and observability
• Experience with government contracting

Supporting critical missions at the intersection of data and science, KeyLogic provides mission management, systems analysis, data analytics, digital transformation, and cybersecurity to customers in the energy, federal civilian, and defense sectors, with a 20+ year portfolio of successes supporting DOE, DOC, EPA, DOD, DHS, FBI, and other federal agencies challenged with complex missions. We help our customers solve the world’s most challenging problems with unsurpassed anticipatory service.

KeyLogic employs over 400 team members, including systems designers, developers, data scientists, IT and cybersecurity specialists, engineers, mission experts, program managers, and more than 70 Ph.D. scientists. This multidisciplinary team works together solving challenging problems with anticipatory service-always staying one step ahead-benefiting our customers, and ultimately helping build a better world.

We are committed to the success of each customer’s mission. We care enough to make their mission our mission and their success our success. We take technical service delivery to a level above our peers. Our anticipatory service is best-in-class.

KeyLogic is an Equal Opportunity/Equal Access Employer. KeyLogic is committed to a policy of non-discrimination against individuals on the basis of any legally protected status.