> Markdown version of [/jobs/ext/188849-data-engineer](https://www.wearedevelopers.com/jobs/ext/188849-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** National Computing Group - **Location:** United States (Remote available) - **Salary:** $124,800.0 - $147,576.0 - **Contract:** Temporary to permanent - **Skills:** Airflow, Microsoft Azure, Big Data, Software as a Service, Cloud Computing, Cloud Database, Profiling, Code Review, Databases, Continuous Integration, Data as a Services, Data Validation, Data Governance, Data Integrity, Extract Transform Load (ETL), Data Profiling, Data Sharing, DevOps, Apache Hadoop, Python (Programming Language), Microsoft Office, Microsoft SQL Server, MySQL, Oracle (Applications), Platform as a Service (PAAS), Power BI, Kusto Query Language, Shell Script, SQL Databases, Data Streaming, Systems Integration, Tableau (Software), Technical Data Management Systems, Google Cloud, Data Storage Technologies, Data Ingestion, Azure Data Factory, Sql Optimization, Flask (Web Framework), Software Troubleshooting, Multi-Cloud, Git, Fastapi, Pandas, Data Lakes, Pyspark, Information Technology, Data Lineage, Apache Kafka, Wikis, Data Management, Tools for Reporting, Cloud Integration, Api Design, Restful APIs, Stream Processing, Oracle Cloud Infrastructure, Data Pipelines, Docker, Databricks - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=1b8d0e4da4ad2fd7 ## About the Role · Bachelor's degree in computer science or related fields with 5+ years' experience as a Data Engineer. · Strong experience in building, maintaining, and optimizing ETL/ELT data pipelines using and orchestrating workflows like Apache Airflow and Kedro framework. · Advanced SQL/ KQL query development and optimization across Oracle, MSSQL, and MySQL databases (hosted on-premises or via PaaS offerings). · Developing and consuming Flask-based and Fast API RESTful APIs for data services and integration. · Proficiency in Linux shell scripting for automation and data workflow management. · Experience with DevOps practices, including CI/CD for data pipelines and use of tools such as Git, Docker, and IaaC frameworks for provisioning and deployment. · Hands-on experience deploying solutions across multiple clouds (OCI, Azure, GCP), including the setup of cross-cloud data integration and transfer techniques. · Experience with cloud platforms (, Azure, Google) and big data tools (, Hadoop, , Databricks) · Understanding data modeling, data profiling, data quality, data lake/warehouse architectures, and data indigestion from operational technologies. · Familiarity with industrial protocols, time-series databases (like OSIsoft PI), and manufacturing data (MES, PLC) · Strong troubleshooting, process automation, and root-cause analysis skills Preferred Skills: * Data Ingestion Pipeline - Python, PySpark, Airflow, Kedro, Linux shell scripting * API Development - Flask, Fast API, RESTful design * Data Storage & Querying - SQL (Oracle, MSSQL, MySQL), KQL (Azure Data Explorer), Bigdata (Hadoop, Oracle BDS), OSIsoft PI * Cloud Integration - Multi-cloud platforms (OCI, Azure, GCP), Data Sharing across cloud (Data Bricks) * Real-Time Data Streaming - Kafka, Azure Event Hub, EMQX * Reporting Tools - Tableau, OAC, Power BI * Collaboration - Wiki, Azure DevOps Boards, MS Office 365 * Data Governance & Quality - Data profiling/validation tools (Pandas Profiling), SaaS monitoring (e.g., Great Expectations), lineage tracking (Cloud Data Catalogs), * Working with offshore teams: 1 year (Preferred) * ETL/ELT Pipeline: 3 years (Required) * Data Engineering: 4 years (Required) * Advanced SQL/ KQL query development : 2 years (Required) * Flask/API's: 1 year (Required) ## Description We are seeking an experienced Data Engineer contractor to support our steel manufacturing operations. This individual will design, build, and optimize data pipelines and infrastructure, enabling advanced analytics, process automation, and data-driven decision-making. The Data Engineer will work closely with data scientist, process engineering, and IT teams to ensure data reliability and actionable insights across the manufacturing lifecycle., · Develop/maintain scalable and reliable data pipelines for industrial data (like real-time streaming, time series, IoT, sensors, MES, ERP systems data) · Integrate data from different sources (databases, clouds, on-premises) and Engineer workflows for efficient ETL/ELT processing and data validation. · Collaborate with architects, data engineers, data scientists, analysts, and business stakeholders to define and deliver solutions. · Collaborate with IT admins, network/security engineers, and cross-functional teams to support stable production operations and troubleshoot infrastructure issues (including managing and integrating IaaC, PaaS, and SaaS solutions). · Capable of managing backlog, supporting QA/testing, and communicating requirements with business stakeholders in the steel manufacturing domain. · Mentoring team members, providing guidance, facilitating skill growth, offering technical coaching, and encouraging best practices across teams via code reviews. · Build and maintain data infrastructure in compliance with data governance and security best practices ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [The Impact of AI on Game Development and the Industry](https://www.wearedevelopers.com/videos/100297-the-impact-of-ai-on-game-development-and-the-industry) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Branch your database like your code: How schema changes and pull requests go hand in hand](https://www.wearedevelopers.com/videos/350-branch-your-database-like-your-code-how-schema-changes-and-pull-requests-go-hand-in-hand) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)