Senior Databricks AI Engineer

Q1 Technologies, Inc.
Aurora, IL, United States
2 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Cloud Foundry Information Engineering Extract Transform Load (ETL) Data Transformation Apache Hive Python (Programming Language) Machine Learning Unstructured Data
+8 more
Data Ingestion Generative AI Data Lakes Pyspark Data Management Machine Learning Operations Data Pipelines Databricks

Job description

We are seeking a highly skilled Senior Databricks AI Engineer to design, develop, and deploy scalable data and AI solutions using the Databricks Lakehouse Platform. The ideal candidate will have expertise in Data Engineering, Machine Learning, Generative AI, and cloud technologies, with hands-on experience building enterprise-grade AI applications and data platforms.

Key Responsibilities

Data Engineering

Design and develop scalable data pipelines using Databricks, PySpark, Delta Lake, and Spark SQL.

Build ELT/ETL solutions for structured and unstructured data.

Implement Medallion Architecture (Bronze, Silver, Gold layers).

Optimize Databricks jobs, clusters, and workflows for performance and cost efficiency.

Manage data ingestion from multiple cloud and on-premise sources.

AI & Machine Learning

Develop and deploy Machine Learning models using Databricks ML and Python.

Implement MLOps practices for model training, deployment, monitoring, and governance.

Requirements

Essential Skills: Experience in healthcare or banking domains is beneficial. Familiarity with AI governance and agentic AI is a plus. Knowledge of MLOps practices is advantageous. Understanding of data modernization programs is helpful. Certification in Databricks or machine learning is preferred.Strong expertise in Databricks and data engineering is essential. Proficiency in machine learning and AI model deployment is critical. Experience with cloud platforms like Azure or AWS is necessary. Familiarity with data pipeline design and optimization is required. Knowledge of generative AI technologies is a must. Desirable Skills: Keyword: Skills: Digital : Machine Learning~Digital : Cloud Foundry~Digital : Databricks~Digital : PySpark~Generative AI Experience Required: 4-6

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…