Data Engineer

Robert Half
Atlanta, GA, United States
22 days ago
Apply on www.atlantacareerpath.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Microsoft Azure Cloud Computing Information Technology Consulting Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Security Data Systems Digital Assets Python (Programming Language) Key Management
+9 more
Machine Learning DataOps Microsoft Fabric Pyspark Core Data Data Management Software Version Control Data Pipelines Databricks

Job description

  • Build and maintain robust data pipelines that move, transform, and prepare information for reporting, analytics, and operational use.
  • Design end-to-end data solutions within Azure-based environments, using the right services and frameworks to support performance, reliability, and scale.
  • Develop engineering workflows with Python and PySpark to process both structured datasets and more complex unstructured sources.
  • Create and support data architecture components in Microsoft Fabric, Databricks, and related platforms to enable efficient data access and delivery.
  • Implement pipeline orchestration and workflow automation through Databricks tools to streamline recurring data operations.
  • Support machine learning initiatives by preparing high-quality datasets and building pipelines that feed model development and deployment processes.
  • Apply sound data management practices to ensure consistency, usability, and governance across data assets.
  • Work within Azure DevOps-driven delivery environments to contribute to version control, deployment processes, and collaborative engineering practices.

Requirements

  • Partner with stakeholders to understand business objectives, translate requirements into technical solutions, and deliver strong client-focused outcomes. Requirements - At least 4 years of experience in data engineering or a closely related field.
  • Strong understanding of core data management concepts, including data quality, organization, and lifecycle considerations.
  • Proven experience developing ETL or ELT pipelines in cloud-based environments.
  • Hands-on expertise with Microsoft Azure, including Azure Databricks and related data platform services.
  • Proficiency in Python and PySpark for large-scale data processing and transformation.
  • Experience working with Microsoft Fabric, Databricks workflows, and modern table or storage formats such as Iceberg.
  • Ability to work effectively with both structured and unstructured data sources.
  • Strong analytical thinking, problem-solving ability, and a balanced approach to customer service and business priorities. Technology Doesn’t Change the World, People Do., All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

Benefits & conditions

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

About the company

Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.atlantacareerpath.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

4:21 min

Challenges of traditional mobile data synchronization

Timothy Marland · World Congress 2023

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all