Lead Data Engineer / AI Native Engineer

Propertyvalue Quantum Technologies Llc
Austin, TX, United States
4 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$187,200.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Data Analysis Cloud Engineering Information Engineering Extract Transform Load (ETL) Data Systems Programming Tools Software Tools Software Engineering Data Ingestion GitHub Copilot
+6 more
Apache Spark Pyspark Data Management Data Pipelines Amazon Elastic Mapreduce (EMR) Databricks

Job description

Provide inputs for identifying best-fit architectural solutions for one or more projects; develop design of application, provide regular support/guidance to project teams on complex coding and issue resolution WITH the objective of ensuring best-fit and high quality technical solutions WITHIN the area of technology specialization and in compliance with guidelines, policies and norm.

Requirements

  • 8+ years of Data Engineering and Software Engineering experience.
  • 3+ years leading complex data engineering initiatives or engineering teams.
  • Proven experience building enterprise scale data platforms and pipelines.
  • Experience delivering cloud native analytics and AI solutions.

Technical Skills:

  • Build highly available, secure, and scalable cloud native data solutions.
  • Develop ETL/ELT frameworks for ingesting, transforming, and publishing enterprise data.
  • Implement high volume distributed processing using Spark and PySpark.
  • Leverage GitHub Copilot, Claude Code CLI, and AI assisted development tools to accelerate engineering productivity.
  • Build Proof of Concepts (POCs) and MVPs using AI powered development approaches.
  • Develop cloud native solutions leveraging AWS and Databricks ecosystems.
  • Build scalable architectures for data ingestion, processing, storage, and analytics.

Key Expectations:

  • Strong experience in building enterprise grade data pipelines, modern Lakehouse architectures, AI enabled data products, and cloud native platforms leveraging Databricks, AWS EMR, Spark, PySpark, and AI native engineering tools such as GitHub Copilot and Claude Code.
  • The role aligns with enterprise initiatives around AI assisted engineering, intelligent automation, and AI powered development workflows

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · WWC Europe 2026

4:15 min

Bridging operational and analytical systems using formal data contracts

Matthias Niehoff Matthias Niehoff · WWC 2024

Videos

See all

Related articles

See all