Data Engineer

• Build and optimize ETL data pipelines using Databricks and Apache Spark
• Develop scalable data models leveraging Spark Data Frames and Spark SQL for efficient querying, aggregation, and integration against numerous diverse data sources
• Utilize Python and Regular Expressions for advanced text parsing, pattern matching, and data cleansing to prepare structured datasets for downstream [CM1] ingestion
• Use APIs for seamless data exchange and automation across systems
• Manage SharePoint data (lists, libraries, files, metadata) programmatically using Python and Microsoft Graph API[CM2]
• Leverage Microsoft 365 tools for documentation and collaboration
• Develop and maintain Amazon Web Services (AWS) including S3
• Fully utilize the Microsoft 365 environment for cross-functional data sharing and productivity
• Use Jira to track and manage issues, tasks, and project workflows
• Collaborate with cross-functional teams and technical stakeholders to define data transformations of legacy systems to modern schemas
• Leverage SME collaboration to interpret business rules and build business logic into data extracts and transformation processes
• Build and maintain strong working relationships with SME’s, helping to identify requirements for data transformations based upon iterative product feedback

This is currently a remote position with participation twice year at an in-person workshop customer. We are seeking a skilled, customer-focused Data Engineer with experience in Databricks, Apache Spark, Python, AWS, Microsoft 365, and SharePoint. Ideal candidates will have a solid grasp of supply chain logistics and prior Department of Defense experience. This position supports the Air Force’s Maintenance, Repair, and Overhaul (MRO) program to streamline depot-level operations across the Air Force Sustainment Center. If you’re passionate about data-driven transformation and ready to support mission-critical operations, we’d love to hear from you., * Bachelor’s degree in computer science, engineering, or a related field

Technical skills, hands-on experience and proficiency with:

• Databricks, Apache Spark, and cloud-based data engineering and modeling (2-3 years preferred)
• SQL for querying and managing relational data (4 years preferred)
• AWS cloud services, including S3 (3 years preferred)
• Python for data analysis, cleansing, and visualization (4 years preferred)
• SharePoint lists, document libraries, and Microsoft Graph
• Microsoft 365 apps and integration workflows
• Developing and consuming APIs for data exchange between different systems
• Jira or other agile workflow management systems for issue and project tracking

Relationship Management and Teamwork:

• Proven ability to build trust and maintain strong partnerships with customers and stakeholders
• Takes initiative and drives projects forward with minimal supervision, anticipating challenges before they arise
• Meticulous in managing complex tasks and deadlines, ensuring accuracy and consistency across deliverables
• Thrives in cross-functional environments, fostering open communication and teamwork across diverse groups
• Rapidly assimilates new technologies and processes, adapting to evolving requirements in dynamic settings
• Ability to work collaboratively with a diverse team of contractors and government personnel
• Ability to work collaboratively with a diverse team of contractors, government personnel, and stakeholders from multiple organizations
• Skilled in building strong customer relationships and engaging with Subject Matter Experts (SMEs) to derive business logic for data transformation methods and rules

Preferred Licenses/Certifications:

• AWS Certified Solutions Architect
• Databricks Certified Data Engineer
• U.S federal government security clearance

Pulled from the full job description

• Referral program
• Tuition reimbursement
• 401(k)
• Health insurance
• 401(k) matching
• Paid time off
• Vision insurance, * 401(k)
• 401(k) matching
• Dental insurance
• Flexible spending account
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Referral program
• Tuition reimbursement
• Vision insurance

Established in 2006, LDSS is a Woman-Owned Small Business (WOSB) based in Dayton, Ohio, with 20 years of proven success delivering high-impact solutions and services to federal agencies. LDSS is unwavering in its commitment to quality, collaboration, and delivering measurable outcomes that foster long-term success. Our thriving culture is powered by our A.C.T.I.V.E. core values