> Markdown version of [/jobs/ext/4736221-big-data-developer](https://www.wearedevelopers.com/jobs/ext/4736221-big-data-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Developer - **Company:** System Soft - **Location:** Chantilly, VA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Big Data, Computer Programming, Databases, Data Deduplication, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Mining, Data Profiling, Information Lifecycle Management, Python (Programming Language), Linux System Administration, Software Engineering, Data Ingestion, Sql Optimization, Fastapi, Machine Learning Operations, Restful APIs - **Published:** November 15, 2026 - **Apply:** https://www.thejobnetwork.com/job/b397a484-1c9a-4b45-bb1c-6cc86838a1f5/big-data-developer ## About the Role We are seeking an experienced Data Engineer with 10+ years of software development/programming experience to design, develop, and optimize large-scale data ingestion, ETL, data transformation, and processing solutions in a Big Data environment., Minimum Qualification: High School Diploma/GED with 10+ years of relevant software development experience ## Description n \n * Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and data loading pipelines. \n * Strong programming experience in Python and/or Java, with advanced SQL and database knowledge. \n * Hands-on experience with Python technologies, including environment management, asynchronous development, FastAPI, and REST APIs. \n * Experience with Big Data environments and the complete data lifecycle, from data ingestion to visualization. \n * Strong experience with Apache Airflow, ETL development, and Linux-based environments. \n * Develop data profiling, deduplication, matching logic, and custom data integration solutions. \n * Leverage Big Data for AI/ML-based analytics and collaborate with Data Scientists to support AI/ML workflows. \n * Maintain data layer documentation and perform basic Linux server administration. \n