Senior Data Engineer

• Design, develop, and maintain robust data pipelines using ETL tools such as Informatica, Talend, and Shell Scripting to ensure seamless data flow across systems.
• Build and optimize large-scale data warehouses utilizing technologies like Hadoop, Apache Hive, Spark, and Azure Data Lake to support high-performance analytics.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications for database design and architecture.
• Implement best practices for database management, including schema design, indexing strategies, and query optimization using SQL, Microsoft SQL Server, Oracle, and other relational databases.
• Develop RESTful APIs for data access and integration with external systems while ensuring security and scalability.
• Lead efforts in model training and analysis skills to support predictive analytics initiatives.
• Utilize programming languages such as Python and Java for scripting, automation, and advanced data processing tasks in an Agile environment.
• Conduct analysis of linked data sources to enhance data quality and consistency across platforms.

Do you have experience in Spark?, We are seeking a dynamic and highly skilled Senior Data Engineer to join our innovative data team. In this role, you will lead the development and optimization of our data infrastructure, enabling advanced analytics and data-driven decision-making across the organization. Your expertise will drive the design, implementation, and maintenance of scalable data solutions that support complex business needs. This position offers an exciting opportunity to work with cutting-edge technologies in a fast-paced environment dedicated to transforming raw data into actionable insights., * Proven experience as a Data Engineer or similar role with a strong understanding of Big Data ecosystems including Hadoop, Spark, Hive, and Azure Data Lake.

• Proficiency in SQL programming with extensive experience working with Microsoft SQL Server, Oracle, or similar relational databases.
• Hands-on expertise in ETL processes using tools like Informatica or Talend; shell scripting (Bash/Unix shell) is highly desirable.
• Strong knowledge of cloud platforms such as AWS and Azure for deploying scalable data solutions.
• Skilled in Python and Java for developing automation scripts and processing pipelines; VBA experience is a plus.
• Familiarity with database design principles, data warehouse architecture, and linked data concepts for integrating diverse datasets.
• Experience working within Agile methodologies to deliver iterative improvements efficiently.
• Ability to analyze complex datasets using analytics tools like Looker or equivalent visualization platforms; familiarity with RESTful APIs for system integration is advantageous.
• Excellent problem-solving skills combined with effective communication abilities to collaborate across teams on technical projects. Join us to leverage your expertise in big data technologies and cloud platforms while shaping innovative solutions that empower our organization through insightful analytics!

4.34.3 out of 5 stars 255 North 5th Street, Phoenix, AZ 85004 $51.62 - $62.17 an hour - Contract