> Markdown version of [/jobs/ext/1407501-data-engineer](https://www.wearedevelopers.com/jobs/ext/1407501-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** LDSS, INC. - **Location:** United States (Remote available) - **Experience:** Experienced - **Salary:** $120,000.0 - $135,000.0 - **Contract:** Permanent contract - **Skills:** Microsoft Windows, Application Programming Interfaces (APIs), Amazon Web Services, Amazon S3, Business Logic, JIRA, Cloud Database, Data Cleansing, Extract Transform Load (ETL), Data Transformation, Data Sharing, Relational Databases, Electronic Data Interchange (EDI), Apache Hive, Python (Programming Language), Metadata, Parsing, Pattern Recognition, Regular Expressions, Microsoft SharePoint, SQL Databases, Workflow Management Systems, Office365, Apache Spark, Information Technology, Integration Frameworks, Legacy Systems, Databricks - **Published:** July 23, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=db7fb38b05d56cf3 ## About the Role This is currently a remote position with participation twice year at an in-person workshop customer. We are seeking a skilled, customer-focused Data Engineer with experience in Databricks, Apache Spark, Python, AWS, Microsoft 365, and SharePoint. Ideal candidates will have a solid grasp of supply chain logistics and prior Department of Defense experience. This position supports the Air Force's Maintenance, Repair, and Overhaul (MRO) program to streamline depot-level operations across the Air Force Sustainment Center. If you're passionate about data-driven transformation and ready to support mission-critical operations, we'd love to hear from you., * Bachelor's degree in computer science, engineering, or a related field Technical skills, hands-on experience and proficiency with: * Databricks, Apache Spark, and cloud-based data engineering and modeling (2-3 years preferred) * SQL for querying and managing relational data (4 years preferred) * AWS cloud services, including S3 (3 years preferred) * Python for data analysis, cleansing, and visualization (4 years preferred) * SharePoint lists, document libraries, and Microsoft Graph * Microsoft 365 apps and integration workflows * Developing and consuming APIs for data exchange between different systems * Jira or other agile workflow management systems for issue and project tracking Relationship Management and Teamwork: * Proven ability to build trust and maintain strong partnerships with customers and stakeholders * Takes initiative and drives projects forward with minimal supervision, anticipating challenges before they arise * Meticulous in managing complex tasks and deadlines, ensuring accuracy and consistency across deliverables * Thrives in cross-functional environments, fostering open communication and teamwork across diverse groups * Rapidly assimilates new technologies and processes, adapting to evolving requirements in dynamic settings * Ability to work collaboratively with a diverse team of contractors and government personnel * Ability to work collaboratively with a diverse team of contractors, government personnel, and stakeholders from multiple organizations * Skilled in building strong customer relationships and engaging with Subject Matter Experts (SMEs) to derive business logic for data transformation methods and rules Preferred Licenses/Certifications: * AWS Certified Solutions Architect * Databricks Certified Data Engineer * U.S federal government security clearance ## Description * Build and optimize ETL data pipelines using Databricks and Apache Spark * Develop scalable data models leveraging Spark Data Frames and Spark SQL for efficient querying, aggregation, and integration against numerous diverse data sources * Utilize Python and Regular Expressions for advanced text parsing, pattern matching, and data cleansing to prepare structured datasets for downstream [CM1] ingestion * Use APIs for seamless data exchange and automation across systems * Manage SharePoint data (lists, libraries, files, metadata) programmatically using Python and Microsoft Graph API[CM2] * Leverage Microsoft 365 tools for documentation and collaboration * Develop and maintain Amazon Web Services (AWS) including S3 * Fully utilize the Microsoft 365 environment for cross-functional data sharing and productivity * Use Jira to track and manage issues, tasks, and project workflows * Collaborate with cross-functional teams and technical stakeholders to define data transformations of legacy systems to modern schemas * Leverage SME collaboration to interpret business rules and build business logic into data extracts and transformation processes * Build and maintain strong working relationships with SME's, helping to identify requirements for data transformations based upon iterative product feedback ## Related Videos - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)