> Markdown version of [/jobs/ext/1955508-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1955508-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** LTM Inc
- **Location:** Irving, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Big Data, Code Review, Data as a Services, Data Systems, Decision Support Systems, Distributed Systems, Apache Hive, Python (Programming Language), Scala (Programming Language), Data Processing, Apache Spark, Data Pipelines, Databricks
- **Published:** August 6, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-irving-tx-usa-58819721

## About the Role

decision and stakeholders to map business requirements to technical solutions * Review code and mentor junior engineers on coding standards and practices * Participate in architectural discussions and contribute to evolving big data platforms * Monitor the health, availability, and reliability of Spark clusters and data services * Stay up-to-date with Spark, Scala, Python, and related big data technologies to continuously improve capabilities * Optimize Spark jobs for performance and efficiency in distributed environments * Ensure data quality and consistency across multiple data sources Tasks * 3 to 5 years of experience * Proficiency in Python, Scala, and Spark * Experience with Spark SQL and the Databricks Spark ecosystem * Ability to design and optimize scalable data processing pipelines * Strong collaboration and ability to translate business requirements into technical solutions * Experience troubleshooting performance bottlenecks and maintaining data quality Key requirements *

## Description

Experteer Overview In this role you will design and optimize scalable big data pipelines using Spark, Python, Scala, and Spark SQL within the Databricks ecosystem. You will work closely with cross-functional teams to translate business needs into robust data solutions and drive data-driven decision making. You will ensure data quality, monitor cluster health, and continuously improve processing capabilities in a distributed environment. This position offers the opportunity to shape big data platforms and mentor junior engineers in best practices, within a collaborative, standards-driven team. Join us to advance scalable data processing and deliver impactful insights. Compensation / Benefits * Design, develop, and deploy complex data processing workflows with Apache Spark, Scala, Python, and SparkSQL * Write efficient, reusable, and maintainable Spark applications * Identify and resolve performance bottlenecks in Spark jobs and data pipelines * Collaborate with data engineers, data scientists, and stakeholders to map business requirements to technical solutions * Review code and mentor junior engineers on coding standards and practices * Participate in architectural discussions and contribute to evolving big data platforms * Monitor the health, availability, and reliability of Spark clusters and data services * Stay up-to-date with Spark, Scala, Python, and related big data technologies to continuously improve capabilities * Optimize Spark jobs for performance and efficiency in distributed environments * Ensure data quality and consistency across multiple data sources Tasks * 3 to 5 years of experience * Proficiency in Python, Scala, and Spark * Experience with Spark SQL and the Databricks Spark ecosystem * Ability to design and optimize scalable data processing pipelines * Strong collaboration and ability to translate business requirements into technical solutions * Experience troubleshooting performance bottlenecks and maintaining data quality Key requirements *


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)