Data Engineer with AI

IT America

Austin, United States of America

2 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Austin, United States of America

Artificial Intelligence

Azure

Information Engineering

Data Infrastructure

Python

Cloud Services

Standard Sql

Software Engineering

SQL Databases

Application Enhancement Tool

Large Language Models

Snowflake

Prompt Engineering

Data Lake

PySpark

Kubernetes

Production Code

Virtual Agents

Software Version Control

Serverless Computing

Databricks

10+ years of data engineering or software engineering experience, with hands-on work in cloud data platforms (Databricks, Snowflake, Azure)
Proven experience developing automation solutions, agents, or AI-powered tools (e.g., using LLMs, prompt engineering, or orchestration frameworks like Databricks Agent Framework (or LangChain, AutoGen)
Strong proficiency in Python and SQL with focus on production-grade code quality
Demonstrated experience with Azure Databricks (notebooks, jobs, workflows, DLT) or equivalent modern data platforms
Expert-level Python programming with strong software engineering practices (testing, documentation, version control)
Strong SQL and PySpark optimization skills
Hands-on experience with LLM APIs, prompt engineering, and AI agent frameworks (e.g., Databricks Agent Bricks, LangChain, OpenAI, Azure OpenAI)
Proficiency in Azure Databricks, including Delta Lake, workflows, and Databricks Asset Bundles
Experience designing and implementing automation workflows using orchestration tools or serverless platforms