Senior Data Engineer

We are seeking a highly skilled and motivated Senior Data Engineer to join our dynamic data team. In this role, you will lead the design, development, and management of large-scale data systems that support business intelligence, analytics, and data-driven decision-making. You will leverage your expertise in cloud platforms, big data technologies, and data modeling to build robust data pipelines and ensure seamless data integration across diverse sources. Your innovative approach will empower stakeholders with reliable, accessible, and insightful data solutions that drive strategic growth., The main thing I will do is design and implement data pipelines. These pipelines will be used to get data change it and get it ready for checking and analysis.

I will make sure the data is good by developing logic to check if it is complete and correct.

I will build a web application using Dash and Mantine components. This application will help users look at the data and make sure it is okay.

I will put in place rules to check the data and make sure it is good. I will also make checks to find any problems with the data.

I will take what the business people and analysts need and turn it into a plan for the data. This plan will include what fields we need and how we will change the data.

I will make features that let users look at the data that has problems and do something, about it.

I will make sure we can track where the data comes from and what happens to it. This is so we can see what we did and do it again if we need to.

I will work with people to understand how they do things and make the application easy to use.

I will make the application run faster by optimizing the queries and backend processes.

• Proven experience as a Data Engineer or similar role with a strong background in software development and database management.
• Extensive knowledge of cloud platforms such as AWS (Amazon Web Services), Azure (including Data Lake), and experience working with public cloud environments.
• Proficiency in programming languages including Java, Python, VBA, Bash (Unix shell), along with strong SQL skills for query management across various databases like SQL Server, Oracle, and cloud-based systems.
• Deep understanding of big data systems such as Hadoop ecosystem components (Hive, Spark), along with expertise in ETL pipeline development for large datasets.
• Hands-on experience designing scalable data warehouses using dimensional modeling principles for efficient analytics processing.
• Familiarity with business intelligence tools like Looker for creating dashboards and visual reports that facilitate decision-making.
• Strong analytical skills with the ability to interpret complex datasets and translate them into meaningful insights.
• Knowledge of modern data management practices including linked data concepts, metadata management, and data governance standards.
• Experience working within Agile teams to deliver iterative improvements on large-scale projects involving cloud databases like Azure Data Lake or similar platforms.

Join us if you're passionate about transforming raw data into powerful insights! Bring your expertise in big data systems, cloud technologies, and software development to help shape innovative solutions that elevate our organization's strategic capabilities.