> Markdown version of [/jobs/ext/1239477-data-engineer-with-python-spark-databricks-and-aiml](https://www.wearedevelopers.com/jobs/ext/1239477-data-engineer-with-python-spark-databricks-and-aiml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer with Python Spark Databricks and AIML

- **Company:** TekCommands Inc
- **Location:** Dallas, TX, United States
- **Salary:** $41,600.0 - $124,800.0
- **Contract:** Temporary to permanent
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Cloud Database, Continuous Integration, Information Engineering, Data Systems, Python (Programming Language), PostgreSQL, Machine Learning, Enterprise Data Management, Data Ingestion, Retrieval-Augmented Generation, Large Language Models, Snowflake, Prompt Engineering, Apache Spark, Generative AI, Build Management, Data Lakes, Pyspark, HuggingFace, Data Management, Virtual Agents, Artificial Intelligence Markup Language (AIML), Data Pipelines, Automation Anywhere, Docker, Databricks
- **Published:** July 11, 2026
- **Apply:** https://www.careerjet.com/jobad/us474a3db2c79e5c261d24a02dfdbe8ec9

## About the Role

We are seeking an experienced Data Engineer with expertise in Python, Spark, Databricks, and AI/ML technologies to build scalable data platforms and Generative AI solutions. The ideal candidate should have experience developing data pipelines, LLM applications, AI agent workflows, and cloud-based data engineering solutions. Key Responsibilities
Design and build scalable data pipelines using Python, Spark, Databricks, and Delta Lake.
Develop and manage data solutions on Azure, Snowflake, and PostgreSQL.
Build and optimize LLM/GenAI pipelines, including data ingestion, prompt engineering, fine-tuning, and deployment.
Develop AI workflows using LangChain, LangGraph, AI Agents, and RAG architectures.
Integrate with OpenAI, Azure OpenAI, Hugging Face, and other LLM APIs.
Collaborate with data scientists, AI engineers, and business teams.
Ensure data quality, governance, security, and performance across enterprise data platforms. Required Skills
7 12 years of Data Engineering experience.
Strong expertise in Python, PySpark, and Apache Spark.
Hands-on experience with Databricks and Delta Lake.
Experience with Snowflake and PostgreSQL.
Experience building LLM/GenAI applications and pipelines.
Strong knowledge of LangChain, LangGraph, AI Agents, and RAG (Retrieval-Augmented Generation).
Experience with OpenAI, Azure OpenAI, or Hugging Face APIs.
Good understanding of Azure Cloud architecture and scalable data solutions.
Strong analytical, problem-solving, and communication skills. Preferred Skills
Telecom domain experience.
Experience with Model Context Protocol (MCP).
AI Agent orchestration.
Docker.
CI/CD pipelines.
Azure or GCP cloud platforms. Top Skills
Python & PySpark
Databricks & Apache Spark
LLM/GenAI (LangChain, LangGraph, RAG, OpenAI/Azure OpenAI)
Snowflake & Delta Lake
Azure Cloud Nice to Have
Telecom industry experience
MCP (Model Context Protocol)
Docker & CI/CD
GCP Cloud Experience

## Description

As a Computational Engineering Expert, you will leverage your specialized knowledge to enhance the training of next-generation AI systems. Your contributions will directly influenc…

 + 1 month ago


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)