Sr. AI Engineer with Databricks experience

TalentOla View all jobs
Irving, TX, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Computer Programming Continuous Integration Data Architecture Distributed Systems Github Python (Programming Language)
+23 more
Open Source Technology Tensorflow Search Technologies SQL Databases Google Cloud Enterprise Software Applications Pytorch Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Prompt Engineering Apache Spark Model Validation Generative AI Data Lakes Kubernetes HuggingFace Machine Learning Operations Api Design GPT Docker Databricks Microservices

Job description

We are hiring a Senior AI Engineer with strong experience in customized LLMs, RAG pipelines, and Databricks Lakehouse. The role involves building and deploying enterprise-grade GenAI solutions using tools like Mosaic AI, MLflow, and vector databases, along with expertise in Python, cloud platforms, and AI orchestration frameworks Roles and Responsibilities Design, develop, and deploy customized LLM-based applications Build scalable Generative AI and RAG (Retrieval-Augmented Generation) solutions on Databricks Lakehouse architecture. Fine-tune and optimize open-source and proprietary LLMs using enterprise datasets. Develop prompt engineering frameworks and AI orchestration workflows. Work with Databricks Mosaic AI, MLflow, Vector Search, and Unity Catalog. Build and manage vector databases, embeddings pipelines, and semantic search solutions. Integrate AI solutions with enterprise applications, APIs, and cloud platforms. Optimize model performance, scalability, inference latency, and cost efficiency. Implement AI governance, monitoring, security, and responsible AI practices. Collaborate with business stakeholders, data engineers, and product teams to deliver AI solutions. Support AI model deployment, MLOps pipelines, and production monitoring

Requirements

Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable. Skills: - Mandatory skills Strong hands-on experience with Databricks and Lakehouse architecture. Experience with Databricks Mosaic AI, MLflow, Delta Lake, and Unity Catalog. Strong programming skills in Python and SQL. Hands-on experience with LLMs such as GPT, Llama, Mistral, Claude, or similar models. Experience with RAG architectures, embeddings, and vector search implementations. Knowledge of LangChain, LangGraph, Semantic Kernel, or similar AI orchestration frameworks. Experience with cloud platforms such as AWS, Azure, or GCP. Familiarity with APIs, Docker, Kubernetes, and microservices architecture. Understanding of AI governance, model evaluation, and monitoring. Preferred Qualifications: Experience deploying GenAI applications in enterprise environments. Knowledge of distributed computing and Spark optimization. Experience with Databricks Model Serving and AI Gateway. Familiarity with CI/CD and MLOps practices. Experience with multimodal AI models and AI agents. Technologies & Tools Databricks, Mosaic AI, MLflow, Delta Lake Python, SQL, PyTorch, TensorFlow OpenAI API, Hugging Face LangChain, LangGraph Vector databases: Pinecone, FAISS, ChromaDB AWS, Azure, GCP Docker, Kubernetes, GitHub Actions “

Benefits & conditions

SaidGig

  • Dallas, TX
  • $50.00 per hour Biomedical engineering professionals can apply their specialized knowledge to enhance the capabilities of Large Language Models (LLMs) through innovative AI research projects. This…

  • 22 hours ago

About the company

SaidGig

  • Dallas, TX
  • $500,000 per year This role focuses on advancing the evaluation and development of cutting-edge coding agents. You will operate at the intersection of AI research, software engineering, and model ev…

  • Just now

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · WWC 2025

Videos

See all

Related articles

See all