> Markdown version of [/jobs/ext/559447-senior-specialist-data-engineering](https://www.wearedevelopers.com/jobs/ext/559447-senior-specialist-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Specialist - Data Engineering - **Company:** LTM Inc - **Location:** Charlotte, NC, United States - **Experience:** Expert - **Salary:** $100,000.0 - $120,000.0 - **Contract:** Internship / Graduate position - **Skills:** Agile Methodology, Big Data, Code Review, Information Engineering, Data Systems, Distributed Systems, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Apache Oozie, Performance Tuning, Scrum Methodology, Sqoop, Data Processing, Data Ingestion, System Availability, Apache Spark, Fastapi, Pyspark, Data Analytics, Apache Kafka - **Published:** June 14, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=a63da6463dc8cff4 ## About the Role Do you have experience in Writing skills? ## Description Seeking a Senior Specialist with 7 to 11 years of experience to design develop and maintain scalable big data solutions using the Big Data Hadoop Ecosystem Spark SparkSQL and Python, Utilize the Big Data Hadoop Ecosystem to efficiently process and analyze large datasets Develop and optimize data workflows leveraging Hadoop Spark and SparkSQL for largescale data analytics Develop Python applications and scripts to automate data processing and integration within the Hadoop ecosystem Collaborate with crossfunctional teams to understand data requirements and deliver optimized solutions aligned with business goals Ensure data quality integrity and governance across distributed systems Integrate various data ingestion and transformation tools such as HDFS Hive Sqoop Oozie and Kafka Stay updated with emerging technologies and best practices in Hadoop Spark Python and big data frameworks Optimize system performance and troubleshoot issues related to big data infrastructure to ensure high availability and reliability, Design develop and deploy scalable big data solutions using Hadoop and Spark ecosystems Implement and optimize SparkSQL and PySpark jobs to enhance performance and resource utilization Monitor and maintain Hadoop clusters for stability capacity planning and performance tuning Collaborate with data engineers analysts and stakeholders to deliver actionable insights and highquality data solutions Conduct code reviews provide technical guidance and mentor junior team members Participate actively in Agile ceremonies including sprint planning code reviews and release cycles Document technical specifications processes and best practices related to big data projects Ensure security and compliance standards are met within big data environments ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)