> Markdown version of [/jobs/ext/3970663-data-engineer](https://www.wearedevelopers.com/jobs/ext/3970663-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** PROLIM Global Corporation - **Location:** Austin, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Microsoft Azure, Cloud Computing, Computer Programming, Databases, Information Engineering, Data Files, Data Governance, Extract Transform Load (ETL), Data Warehousing, DevOps, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Scrum Methodology, Systems Development Life Cycle, Power BI, Standard Sql, SQL Databases, Data Streaming, Tableau (Software), Workflow Management Systems, Enterprise Data Management, Privacy Controls, Data Processing, Scripting, Google Cloud, Cloud Platform System, Data Ingestion, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Kubernetes, Real Time Data, Apache Kafka, Data Management, Restful APIs, Terraform, Data Pipelines, Docker, Databricks - **Published:** October 27, 2026 - **Apply:** https://www.careerbuilder.com/job-details/data-engineer-austin-tx--6f649d01-faaf-47a5-9562-950f0dc8e717 ## About the Role Database Extract Transform and Load (ETL), Data Management, Python Programming/Scripting Language, Cloud Computing, SQL (Structured Query Language), Technical Support, Scalable System Development, Data Processing, Apache Spark, Data Sets, * 5+ years of experience as a Data Engineer. * Strong programming skills in Python. * Excellent SQL skills. * Hands-on experience with Apache Spark / PySpark. * Experience with ETL/ELT development. * Strong knowledge of Data Warehousing concepts. * Experience with Hadoop ecosystem (Hive, HDFS). * Experience with Databricks. * Experience with Apache Kafka. * Hands-on experience with Apache Airflow or similar workflow orchestration tools. * Experience working on Linux/Unix environments. * Knowledge of Git and CI/CD pipelines. Cloud Skills Experience with one or more of the following: * Microsoft Azure (ADF, ADLS, Synapse) * Amazon Web Services (AWS) * Google Cloud Platform (GCP) Preferred Skills * Snowflake * Delta Lake * Docker * Kubernetes * Terraform * Scala or Java * Power BI or Tableau * REST APIs * Agile/Scrum methodology * Experience working with large-scale enterprise data platforms ## Description We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics., * Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. * Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark). * Develop batch and real-time data ingestion pipelines. * Work with structured and unstructured datasets from multiple data sources. * Design and implement cloud-based data solutions using Azure, AWS, or GCP. * Develop and maintain data models, data lakes, and enterprise data warehouses. * Integrate data from APIs, databases, and streaming platforms. * Optimize data pipeline performance and ensure data quality. * Collaborate with Data Scientists, Business Analysts, and Software Engineers. * Implement CI/CD pipelines and DevOps best practices for data engineering. * Troubleshoot production issues and provide ongoing support. * Ensure compliance with data governance, security, and privacy standards.