Senior Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a dynamic and highly skilled Senior Data Engineer to join our innovative data team. In this pivotal role, you will lead the design, development, and maintenance of robust data systems that empower data-driven decision-making across the organization. Your expertise in big data technologies, cloud platforms, and data modeling will drive the creation of scalable data pipelines and architectures. This is an exciting opportunity to work with cutting-edge tools and collaborate with cross-functional teams to unlock the full potential of our enterprise data assets., * Design, develop, and optimize large-scale data pipelines using ETL (Extract, Transform, Load) processes to ensure efficient data flow across systems.
- Build and maintain scalable data architectures leveraging cloud platforms such as AWS, Azure Data Lake, and Public Cloud environments.
- Implement and manage big data systems utilizing Hadoop, Spark, Apache Hive, and other distributed processing frameworks to handle vast datasets.
- Develop and refine data models including dimensional modeling for data warehousing solutions to support business intelligence initiatives.
- Collaborate with business analysts and stakeholders to translate requirements into technical specifications; utilize tools like Looker for analytics visualization.
- Ensure high standards of data quality, security, and compliance through rigorous validation and governance practices.
- Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement efforts using software development best practices.
Requirements
- Proven experience in software development with proficiency in Java, Python, SQL (including Microsoft SQL Server and Oracle), and shell scripting (Bash/Unix Shell).
- Extensive hands-on experience with big data systems such as Hadoop, Spark, Apache Hive, and cloud-based databases like Azure Data Lake or cloud-native solutions.
- Strong understanding of data management integration techniques including Informatica or Talend for ETL pipeline development.
- Demonstrated ability in designing complex data models and implementing efficient query management strategies for SQL databases.
- Familiarity with business intelligence tools such as Looker or similar platforms for analytics reporting.
- Knowledge of cloud environments (AWS, Azure) with experience deploying scalable solutions on public cloud infrastructure.
- Excellent analysis skills with a focus on data warehousing design, dimensional modeling, and query optimization.
- Experience working within Agile methodologies to deliver iterative enhancements in fast-paced environments.
- Strong communication skills to collaborate effectively across technical teams and business units.
Join us as a Senior Data Engineer to shape the future of our enterprise data landscape! Bring your passion for innovation, your expertise in big data ecosystems, and your drive to create impactful solutions that propel our organization forward.
Benefits & conditions
$55 - $65 an hour - Contract