> Markdown version of [/jobs/ext/1726247-data-engineer-10-yrs-shiloh-il](https://www.wearedevelopers.com/jobs/ext/1726247-data-engineer-10-yrs-shiloh-il). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer | 10+ yrs | Shiloh IL - **Company:** Silverthorne Advisory Group LLC - **Location:** Shiloh, IL, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), Amazon Web Services, Amazon S3, Data Analysis, Software Applications, Big Data, Computer Programming, Data Auditing, Data Cleansing, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Database Design, IBM Cognos Business Intelligence, JSON, Python (Programming Language), Power BI, Standard Sql, Scala (Programming Language), SQL Databases, Teradata SQL, Jupyter Notebook, Qliksense, Data Processing, Apache Spark, Data Pipelines, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9038407/data-engineer-10-yrs-shiloh-il ## About the Role * Extract, Transform, Load (ETL) experience: Experience with establishing and maintaining data load processes as well as manipulating and combining various data sources. * Business Intelligence experience: Creating and updating applications, reports, dashboards, etc. Cognos Analytics, Qlik Sense, and Power BI especially are relevant to the role. * Python and Coding experience: Hands-on experience with languages/technologies such as Python, Spark, Scala, JavaScript/JSON, and SQL. * Databricks experience: Familiarity with Databricks, Amazon AWS/S3, Jupyter Notebooks will be helpful in the role. * Strong problem-solving skills and ability to solve complex data-related issues. * Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently. * Understanding of data modeling/visualization, database design principles, and data governance practices. * Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams. * Detail-oriented mindset with a commitment to delivering high-quality results. * Teradata experience is a plus. Knowledge of Multiloads, BTEQs, and other assorted Teradata procedures will be helpful in the role. * Accounting knowledge is a plus. Some background on DoD accounting system (DEAMS, TFMS, NERP etc.) and transportation policies will be helpful in the role. ## Description Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our client's cloud and data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis., * Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. * Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing. * Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets. * Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency. * Troubleshoot data-related problems and provide innovative solutions to address complex data challenges. * Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices. * Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures. * Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes. * Maintain documentation for software applications, workflows, and processes. * Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement., * Strong SQL knowledge: Ability to write, troubleshoot, and modify complex SQL procedures and queries across a variety of datasets. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)