Senior Data Engineer

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines using tools like Airflow and custom scripting in Python to process large volumes of big data efficiently.
• Architect and optimize data models for data warehouses and data lakes utilizing dimensional modeling principles and best practices in SQL databases such as Postgres, Snowflake, AWS.
• Collaborate with cross-functional teams to gather requirements, define data management strategies, and implement solutions that support analytics and reporting needs.
• Implement advanced analytics workflows including model training, machine learning integration, and linked data management to enhance predictive capabilities.
• Write complex SQL queries for analysis, reporting, and query management using SQL Server Management Studio or similar tools; optimize performance for large datasets.
• Ensure adherence to best practices in data warehousing design, data governance, security protocols, and compliance standards across all projects.

We are seeking a highly skilled and motivated Senior Data Engineer to join our dynamic data team. In this pivotal role, you will lead the design, development, and management of complex data pipelines and architectures that empower data-driven decision-making across the organization. Your expertise will help optimize data workflows, ensure robust data quality, and facilitate seamless integration of diverse data sources. This is an exciting opportunity for a passionate professional eager to leverage cutting-edge technologies and innovative solutions to transform raw data into actionable insights., * Proven experience with cloud databases such as AWS, Snowflake, Postgres and a strong understanding of cloud-based data warehousing solutions.

• Proficiency in programming languages such as Java, Python, VBA (Visual Basic for Applications), and Shell Scripting for automation and pipeline development.
• Hands-on experience with SQL databases including Postgres, Microsoft Access, and other relational database systems; expertise in database design and query optimization.
• Strong understanding of ETL processes, data modeling techniques including dimensional modeling for enterprise data warehouses.
• Experience with RESTful APIs for integrating external systems.
• Excellent analysis skills with the ability to interpret complex datasets; experience in model training for predictive analytics is a plus.

WCKD Analytics Remote $80,000 - $100,000 a year - Full-time