> Markdown version of [/jobs/ext/537834-senior-big-data-engineer-java-kafka-spark-etl](https://www.wearedevelopers.com/jobs/ext/537834-senior-big-data-engineer-java-kafka-spark-etl). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Big Data Engineer (Java, Kafka, Spark, ETL) - **Company:** Systems, Inc - **Location:** Arlington, VA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Agile Methodology, Amazon Web Services, Business Analytics Applications, Data Analysis, Microsoft Azure, Big Data, Cloud Computing, Information Systems, Computer Programming, Databases, Data Validation, Data Discovery, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Mapping, Data Transformation, Data Migration, Data Structures, Relational Databases, Linux, DevOps, Distributed Data Store, Electronic Data Interchange (EDI), Elasticsearch, Apache Hadoop, Apache HBase, Java Web Services, Spring Framework, JSON, PostgreSQL, Enterprise Messaging Systems, MongoDB, NoSQL, Oracle (Applications), Pentaho Data Integration, Systems Development Life Cycle, Standard Sql, Software Engineering, SQL Databases, SQL Server Integration Services, Data Streaming, Systems Integration, Talend, Extensible Markup Language (XML), Enterprise Search, Enterprise Data Management, Google Cloud, Cloud Platform System, Real Time Systems, Informatica Powercenter, Apache Spark, Spring-boot, Software Application Programming, Event Driven Architecture, Build Management, Data Lakes, Semi-structured Data, Kubernetes, Information Technology, AWS Glue, Enterprise Integration, Apache Kafka, Apache Nifi, Spark Streaming, Data Management, Cloud Migration, Restful APIs, Docker, Amazon Redshift - **Published:** June 13, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=4101b4f33c020b4b ## About the Role Do you have experience in XML?, * U.S. Citizen. * Bachelor's degree in Computer Science, Information Systems, Engineering, or related field (or equivalent experience). * 5-10+ years of experience in Data Engineering, Software Engineering, ETL Development, or Enterprise Data Integration. * Strong hands-on Java development experience. * Experience designing and implementing ETL and data integration solutions. * Experience building and supporting Apache Kafka producers, consumers, and streaming applications. * Experience developing applications using Apache Spark and/or Spark Streaming. * Strong SQL and relational database experience, including Oracle. * Experience creating and maintaining source-to-target data mappings. * Experience with data transformation, data migration, and data validation activities. * Experience developing REST APIs and integration services. * Experience working with XML, JSON, CSV, and other structured or semi-structured data formats. * Experience supporting Linux/Unix environments. * Strong analytical, troubleshooting, and problem-solving skills. Preferred Qualifications * Experience with Elasticsearch and enterprise search platforms. * Experience with Hadoop ecosystem technologies. * Experience with Scala development. * Experience with MongoDB, DocumentDB, HBase, Delta Lake, Redshift, or other Big Data technologies. * Experience with ETL tools such as Apache NiFi, AWS Glue, Talend, Informatica, Pentaho, or SSIS. * Experience with event-driven architectures and enterprise messaging technologies. * Experience with Docker and Kubernetes. * Experience supporting AWS, Azure, or Google Cloud Platform environments. * Experience supporting enterprise data migration or modernization initiatives. * Experience working in Agile software development environments. * Experience supporting large-scale analytics, risk assessment, investigative, intelligence, law enforcement, or operational decision-support systems. ## Description SDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer to support the development and modernization of enterprise data ingestion, integration, search, and analytics platforms. This role is responsible for building scalable solutions that collect, normalize, enrich, transform, and distribute large volumes of data across enterprise systems, analytics platforms, and operational environments. The ideal candidate combines strong Java development and data integration expertise with hands-on experience building modern Big Data solutions using technologies such as Kafka, Spark, Elasticsearch, and cloud-based platforms. This position is ideal for engineers who enjoy solving complex data challenges and working across the full data lifecycle-from ingestion and transformation to search, analytics, and operational support. Core Technologies Java | Kafka | Spark | Elasticsearch | Oracle | SQL | ETL | Data Integration | Data Mapping | REST APIs | MongoDB | AWS | Linux What You'll Do * Design, develop, and maintain enterprise data ingestion, ETL, and data transformation solutions supporting both batch and real-time processing. * Build and support scalable Kafka-based streaming architectures for processing and distributing high-volume data. * Develop Java-based applications and services supporting enterprise data integration and transformation workflows. * Create Spark and Spark Streaming solutions to process, enrich, and analyze large datasets. * Design and support enterprise search capabilities using Elasticsearch to enable data discovery, investigative workflows, analytics, and operational decision-making. * Analyze source and target data structures and develop source-to-target mapping specifications. * Integrate data from multiple structured and semi-structured sources while ensuring data integrity, consistency, traceability, and performance. * Develop REST APIs and system integration services that enable data exchange across enterprise platforms. * Support data migration, modernization, and cloud transformation initiatives. * Perform data validation, reconciliation, profiling, and quality assurance activities. * Implement and support data quality, governance, lineage, and validation processes across ingestion and transformation pipelines. * Optimize SQL queries, database processes, and distributed data pipelines. * Troubleshoot production issues and improve platform reliability, scalability, and performance. * Collaborate with architects, developers, analysts, and stakeholders to design and implement technical solutions. * Support onboarding efforts for data consumers and integration partners. * Evaluate emerging technologies and develop proof-of-concept solutions. * Mentor junior engineers and contribute to technical leadership initiatives., Programming & Development * Java * Scala * SQL * Spring Framework * Spring Boot * REST APIs Data Integration & ETL * ETL Development * Data Mapping & Transformation * Data Migration * Apache NiFi * AWS Glue * Informatica * Talend Big Data & Streaming * Apache Kafka * Apache Spark * Spark Streaming * Hadoop * HBase * Delta Lake Search & Analytics * Elasticsearch Databases * Oracle * PostgreSQL * MongoDB * DocumentDB * Redshift * Relational & NoSQL Databases Cloud & DevOps * AWS * Azure * Google Cloud Platform * Docker * Kubernetes * CI/CD Pipelines Why Join SDA? * Work with modern Big Data, cloud, and enterprise integration technologies. * Design and build large-scale data platforms supporting mission-critical operations. * Collaborate with highly skilled engineers, architects, and data professionals. * Influence technical direction and solution architecture. * Competitive compensation and benefits package. * Flexible hybrid work environment. * Opportunities for professional growth and technical leadership. If you're passionate about building scalable data platforms, solving complex integration challenges, and working with modern Big Data technologies, we'd love to hear from you. About SDA Systems Development and Analysis, Inc. (SDA) has decades of success making system concepts an operational reality for agencies on the front lines of homeland security, law enforcement and national defense. We are focused on our clients' missions and hold ourselves accountable for their operational success. We operate with independence and integrity so that we can provide unfettered advice. By understanding and appreciating their world, we earn the trust to innovate and apply leading edge technology on behalf of our clients. SDA is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. SDA is also committed to compliance with all fair employment practices regarding citizenship and immigration status. ## Related Videos - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)