Data Engineer

Robotics Technologies LLC
Austin, TX, United States
4 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Microsoft Azure Big Data BigQuery Cloud Storage Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Migration Data Warehousing
+16 more
Data Flow Control Python (Programming Language) Operational Databases Performance Tuning Azure Data Lake SQL Databases Data Streaming Google Cloud Azure Data Factory Apache Spark Software Troubleshooting Pyspark Integration Frameworks Terraform Data Pipelines Databricks

Job description

We are seeking Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), data pipeline development, ETL/ELT, and large-scale data processing.

Requirements

The client is transitioning its enterprise data environment from Azure to GCP. Candidates must have solid, practical GCP data engineering experience, including building, optimizing, and supporting production data pipelines., * 6+ years of experience in data engineering, data integration, and data pipeline development.

  • Strong hands-on GCP data engineering experience is mandatory.
  • Experience with BigQuery, Dataflow, Cloud Storage, and relevant GCP data services.
  • Strong expertise in Python, SQL, ETL/ELT development, and data transformations.
  • Experience building scalable batch and/or streaming data pipelines.
  • Experience with PySpark/Spark and data processing frameworks.
  • Strong understanding of data warehousing, data modeling, data quality, and performance optimization.
  • Experience with data pipeline orchestration and scheduling tools such as Airflow/Cloud Composer.
  • Strong troubleshooting, problem-solving, and communication skills.

Preferred Skills

  • Experience migrating data platforms and pipelines from Azure to GCP.
  • Knowledge of Azure Data Factory, Databricks, Azure Data Lake, or Synapse Analytics.
  • Experience with Terraform, CI/CD, Pub/Sub, and automated data deployments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…