> Markdown version of [/jobs/ext/512544-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/512544-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Master Compliance - **Location:** Phoenix, AZ, United States - **Experience:** Expert - **Salary:** $107,370.0 - $129,314.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Agile Methodology, Amazon Web Services, Microsoft Azure, Bash Shell, Big Data, Cloud Computing, Computer Programming, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Warehousing, Relational Databases, Database Design, Apache Hadoop, Apache Hive, Python (Programming Language), Linked Data, Unix Shell, Microsoft SQL Server, Oracle (Applications), Query Optimization, Azure Data Lake, Shell Script, SQL Databases, Data Streaming, Systems Integration, Talend, Data Processing, Scripting, Informatica Powercenter, Database Optimization, Apache Spark, Vba Programming Language, Restful APIs, Looker Analytics, Data Pipelines, Programming Languages - **Published:** June 6, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=ce5b8ffd36870fad ## About the Role Do you have experience in Spark?, We are seeking a dynamic and highly skilled Senior Data Engineer to join our innovative data team. In this role, you will lead the development and optimization of our data infrastructure, enabling advanced analytics and data-driven decision-making across the organization. Your expertise will drive the design, implementation, and maintenance of scalable data solutions that support complex business needs. This position offers an exciting opportunity to work with cutting-edge technologies in a fast-paced environment dedicated to transforming raw data into actionable insights., * Proven experience as a Data Engineer or similar role with a strong understanding of Big Data ecosystems including Hadoop, Spark, Hive, and Azure Data Lake. * Proficiency in SQL programming with extensive experience working with Microsoft SQL Server, Oracle, or similar relational databases. * Hands-on expertise in ETL processes using tools like Informatica or Talend; shell scripting (Bash/Unix shell) is highly desirable. * Strong knowledge of cloud platforms such as AWS and Azure for deploying scalable data solutions. * Skilled in Python and Java for developing automation scripts and processing pipelines; VBA experience is a plus. * Familiarity with database design principles, data warehouse architecture, and linked data concepts for integrating diverse datasets. * Experience working within Agile methodologies to deliver iterative improvements efficiently. * Ability to analyze complex datasets using analytics tools like Looker or equivalent visualization platforms; familiarity with RESTful APIs for system integration is advantageous. * Excellent problem-solving skills combined with effective communication abilities to collaborate across teams on technical projects. Join us to leverage your expertise in big data technologies and cloud platforms while shaping innovative solutions that empower our organization through insightful analytics! ## Description * Design, develop, and maintain robust data pipelines using ETL tools such as Informatica, Talend, and Shell Scripting to ensure seamless data flow across systems. * Build and optimize large-scale data warehouses utilizing technologies like Hadoop, Apache Hive, Spark, and Azure Data Lake to support high-performance analytics. * Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications for database design and architecture. * Implement best practices for database management, including schema design, indexing strategies, and query optimization using SQL, Microsoft SQL Server, Oracle, and other relational databases. * Develop RESTful APIs for data access and integration with external systems while ensuring security and scalability. * Lead efforts in model training and analysis skills to support predictive analytics initiatives. * Utilize programming languages such as Python and Java for scripting, automation, and advanced data processing tasks in an Agile environment. * Conduct analysis of linked data sources to enhance data quality and consistency across platforms. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Intermediate Bitcoin Script](https://www.wearedevelopers.com/videos/25-intermediate-bitcoin-script) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)