Data Engineer (SQL/Databricks/PySpark

Advent Global Solutions
Irving, TX, United States
8 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

.NET Framework Artificial Intelligence Data Analysis Microsoft Azure C Sharp (Programming Language) Information Engineering Extract Transform Load (ETL) Data Warehousing Database Development Dimensional Modeling Distributed Computing Environment Python (Programming Language)
+11 more
Microsoft SQL Server SQL Azure Performance Tuning SQL Databases Transact-SQL .NET Core Apache Spark AngularJS Pyspark Data Pipelines Databricks

Requirements

Candidate must have databricks, SQL, Pyspark and python, T SQL

preferred .net, C#, Angular.

This is a data intense position that has performance tuning, ETL processes. This is not an architect or lead position it is hand-on dev work. They need to be able to solve, they can use tools in their onsite interview to find the solution but have to be able to explain why they went the route they chose…they must also talk about their previous experience in why they chose the route to solve and logic.

  • 7+ years of relevant experience required.
  • Experience developing and supporting database solutions using SQL Server or Azure SQL required.
  • Strong proficiency in T-SQL, including query development, performance tuning, and optimization required.
  • Hands-on experience using Python for data processing, analytics, or data engineering workflows required.
  • Experience with Databricks, Apache Spark, or similar distributed data processing platforms required.
  • Understanding of data warehousing concepts, dimensional modeling, and ETL/ELT pipelines required.
  • Experience working in Azure cloud environments required.
  • Experience with .Net, C#, .Net Core, Angular and AI/ML preferred.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

5:46 min

Evolution of the Angular framework from AngularJS

Valentine Awe · WWC 2023

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:27 min

Preventing command injection during system process execution

Sebastian Leuer Sebastian Leuer · WWC 2024

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:52 min

Maintaining backward compatibility across major versions

Jessica Janiuk · JS Congress

Videos

See all

Related articles

See all