> Markdown version of [/jobs/ext/527550-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/527550-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** LTM Inc
- **Location:** Irving, TX, United States
- **Experience:** Expert
- **Salary:** $79,851.0 - $107,720.0
- **Contract:** Internship / Graduate position
- **Skills:** Application Programming Interfaces (APIs), Airflow, Data Analysis, Bash Shell, Big Data, Unix, Code Review, Continuous Integration, Data Validation, Extract Transform Load (ETL), Database Queries, Database Testing, File Systems, Perl (Programming Language), Apache Hadoop, Python (Programming Language), Korn Shell, Shell Script, SQL Databases, Apache Spark, Pyspark, Build Process, Data Delivery, Software Coding, Data Pipelines
- **Published:** June 5, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=ffafa1b5ea181cd0

## About the Role

Do you have experience in UNIX?, * Exp 4 to 6 Years Must have good technical experience and should be able to provide technical solutions for multiple modules in parallel on need basis and bring the task to closure on time

 * Unix SQL and Shell Scripting experience is a must have
 * Expertise in Designing and developing scalable Apache spark ETL based Data processing pipelines
 * Strong commandline knowledge in UnixLinux with Shell scripting using Bash Kornshell or Perl and File processing using awk scripts
 * Expertise in SQL querying and complex joins
 * Implementing comprehensive Spark based Data validation frameworks transforming large volumes of Financial data within the Project lifecycle
 * Expertise with complex Data workflows with Apache AirFlow managing task dependencies SLAs etc to ensure timely data delivery and corresponding automated validation controls
 * Strong Analytical skills and expertise on SparkSQL for Data analysis and validation ensuring the delivery of clean queryready datasets for business consumption
 * Expertise in Data quality checks and monitoring
 * Handson with Automation Framework Design for ETL and API
 * SME in Data Analysis Database testing Messaging queues
 * Experience with coding standards code reviews source management build processes CICD pipeline

Skills

Mandatory Skills : Apache Spark, Big Data Hadoop Ecosystem, Python, Python for DATA, SparkSQL
Other details

## Description

* This role is for Quality Engineering team where 70percent of effort will be for developing automation frameworks for testing Remaining 30percent effort will be on manual testing until its fully automated


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)