> Markdown version of [/jobs/ext/1948618-data-engineer](https://www.wearedevelopers.com/jobs/ext/1948618-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** E-INFOSOL LLC - **Location:** Washington, DC, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Data Analysis, Apache HTTP Server, Confluence, Big Data, Databases, Continuous Delivery, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Normalization, Data Warehousing, Software Debugging, Python (Programming Language), PostgreSQL, Microsoft Office, Software Engineering, Web Services, Data Processing, Delivery Pipeline, Apache Spark, Data Lakes, Pyspark, Information Technology, Data Analytics, Apache Nifi, Data Delivery, Data Pipelines, Databricks - **Published:** August 6, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9078293/data-engineer ## About the Role Active Top Secret clearance Bachelor's degree in a quantitative field (i.e. Statistics or Operations Research) or technical field (i.e. Computer Science or Engineering). Four (4) years of Exceptional proficiency in writing and editing skills using MS Office. Minimum of 2-4 years of work experience in data analytics or data engineering role. Minimum 10 years of relevant experience., Experience with designing, implementing and maintaining big data processing, normalizing, and enriching pipelines in languages such as Python, PySpark, or Spark. Experience with architecting, designing and building modern medallion ETL processes for data lake, data warehouse or lakehouse. Experience with building and Knowledge of automating data pipeline and workflow on Apache Niagra Files (NiFi) or Databricks for ease of maintenance. Experience with implementing automated data Cl/CD pipelines with Continuous Integration/Continuous Delivery (CI/CD). Experience with data frame processing with filtering conditions. Experience with organizing data version history to optimize processing and retrieval performance. Experience with data indexing for robust searching and querying. Strong verbal and written communication skills to effectively collaborate and integrate with enterprise partners and customers. Excellent at troubleshooting, debugging and researching. Ability to focus and a desire to learn. Knowledge of PostgreSQL is preferred. ## Description Update and maintain the information residing on the Private Sector Portal (PSP) tool, using automation when appropriate. Assist in the relationship management team in identifying and documenting technical requirements around the PSP system Develop guidance around appropriate use of the PSP system and ensure consistent data standards across the enterprise. Provide expertise and customer service to HQ/field users Maintain the PSP system, to include auditing content for missing or inappropriate metadata, reporting technical user problems to the contractor. Ensure the scheduling, processing, and documentation of data delivery and implementation, using automation when appropriate. Design, implement, automate, and maintain Enterprise level of scalable Extract, Transform and Load (ETL) data pipelines and data analysis pipelines. Build and maintain robust data processing, enriching, and analysis pipelines that aggregate and normalize large datasets across diverse sources, including sources from web services. data from disparate sources. Automate and optimize database and data workflows for best performance and efficiency. Identify and propose emerging technologies, automation or alternative solutions to efficiently improve support for developers and application stakeholders. Develop and maintain documentation, inline comments, confluence and stand-alone documents, wherever necessary for the readability of the software design and code. Ability to focus on producing results efficiently. Ability to work independently and coordinate with team members. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)