> Markdown version of [/jobs/ext/131436-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/131436-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Engineer - **Company:** Noblis Inc. - **Location:** Chantilly, VA, United States - **Experience:** Expert - **Salary:** $146,200.0 - $228,400.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Business Analytics Applications, Big Data, Cloud Storage, Cyber Security, Information Systems, Information Engineering, Extract Transform Load (ETL), Data Security, Data Warehousing, Distributed Systems, Identity and Access Management, JSON, Python (Programming Language), NoSQL, Performance Tuning, Salesforce.Com, Software Engineering, SQL Databases, Tableau (Software), Unstructured Data, Extensible Markup Language (XML), Parquet, Data Storage Technologies, AWS Lambda, Information Technology, Avro, Data Pipelines - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=f95e9be288e2eb2c ## About the Role * Active Top Secret/SCI with Counterintelligence (CI) Polygraph. * US Citizenship is required. * Bachelor's degree and 14 years or more experience OR Master's degree and 12 years or more experience OR PhD and 9 years or more experience. * Demonstrated experience with Python. * Ability to maintain SQL and NO-SQL databases. * Demonstrated experience with Tableau or Salesforce. * Ability to create and manage AWS resources, including provisioning EC2 instances, writing and deploying Lambda functions, creating and writing to S3, and managing authorization appropriately across resources with IAM policies. * One Active Certification: CCISO, CISM, CISSP, GSLC, SSCP, Sec+ or GSEC., * Degree in Information Technology, Cybersecurity, Computer Science, Information Systems, Data Science, or Software Engineering. * Proven experience optimizing data pipelines, performing large-scale data processing, and ensuring data quality. * Strong knowledge of data warehousing concepts, ETL processes, and distributed computing environments. ## Description Noblis ESI is seeking an experienced Big Data Engineer to support our government customer in Chantilly, VA. Responsibilitites Include: * Designs scalable data architectures, leading ETL processes, and oversees the implementation of data storage solutions to include creating, manipulating, and maintaining large databases. * Support the development, integration, and visualization of advanced analytics tools, ensuring efficient data access and insights generation. * Optimize system performance and scalability, implementing continuous improvement initiatives. * Architect, deploy, and maintain multiple, fast-turnaround capabilities used to perform various highly-visible and high-priority collection efforts. * Strategically apply AI/ML to extract, format, and expose in indexed search tools relevant content such as raw text, tabular (CSV, Parquet, Avro) or nested (JSON, JSONL, XML), and other structured /unstructured data types. Data is expected to be of varying formats, schemas, and structures. * Provide Data Engineering support to include cleaning, modeling, and formatting data of unknown formats. * Move data between different cloud storage environments for critical requests. * Coordinate with multiple entities, including mission partners, to ensure capabilities and deliverables meet defined requirements and tradecraft needs. * Create and maintain collection capabilities and deliverables within the Customer's Amazon Web Services environment utilizing Customer approved AWS services. * Validate collected data to ensure it meets data format requirements. * Document all source code, including how to execute the code. * Perform operations and maintenance on the collection capabilities and deliverables to adapt to changes in collection target, technologies, data formats, and naming conventions. ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)](https://www.wearedevelopers.com/videos/254-tomorrow-s-cloud-data-platforms-fully-managed-database-as-a-service-dbaas) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Best Paying Jobs in Technology](https://www.wearedevelopers.com/magazine/256-best-paying-jobs-in-technology)