> Markdown version of [/jobs/ext/4604070-data-engineer](https://www.wearedevelopers.com/jobs/ext/4604070-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Prolim Global Corporation - **Location:** Peoria, IL, United States - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Apache HTTP Server, Microsoft Azure, Unix, Cloud Computing, Computer Programming, Databases, Continuous Integration, Data Governance, Extract Transform Load (ETL), Data Warehousing, Linux, DevOps, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Scrum Methodology, SQL Databases, Data Streaming, Unstructured Data, Data Processing, Google Cloud, Azure Data Factory, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Real Time Data, Apache Kafka, Restful APIs, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** November 6, 2026 - **Apply:** https://www.juju.com/job/7_8CFA583F1C2525153BA0A897AB969FE5 ## About the Role security, and privacy standards.Required Skills5+ years of experience as a Data Engineer.Strong programming skills in Python.Excellent SQL skills.Hands-on experience with Apache Spark / PySpark.Experience with ETL/ELT development.Strong knowledge of Data Warehousing concepts.Experience with Hadoop ecosystem (Hive, HDFS).Experience with Databricks.Experience with Apache Kafka.Hands-on experience with Apache Airflow or similar workflow orchestration tools.Experience working on Linux/Unix environments.Knowledge of Git and CI/CD pipelines.Cloud SkillsExperience with one or more of the following:Microsoft Azure (ADF, ADLS, Synapse)Amazon Web Services (AWS)Google Cloud Platform (GCP)Preferred SkillsSnowflakeDelta LakeDockerKubernetesTerraformScala or JavaPower BI or TableauREST APIsAgile/Scrum methodologyExperience working with large-scale enterprise data platformsExperience5-10 yearsSkillsPYTHON, SQL, Apache Spark, PySpark, Hadoop, Hive, ETL, ELT, Data Pipeline Development, Apache Kafka, Databricks, Azure Data Factory (ADF), Azure Synapse, Snowflake, Azure, AWS, GCP, Delta Lake, DATA WAREHOUSING, Data Modeling, LINUX, UNIX, Airflow, REST APIs, Git, CI/CD ## Description The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT workflows.Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark).Develop batch and real-time data ingestion pipelines.Work with structured and unstructured datasets from multiple data sources.Design and implement cloud-based data solutions using Azure, AWS, or GCP.Develop and maintain data models, data lakes, and enterprise data warehouses.Integrate data from APIs, databases, and streaming platforms.Optimize data pipeline performance and ensure data quality.Collaborate with Data Scientists, Business Analysts, and Software Engineers.Implement CI/CD pipelines and DevOps best practices for data engineering.Troubleshoot production issues and provide ongoing support.Ensure compliance with data governance