Senior Data Engineer - Forecasting Platforms - #26-27213

The Senior Data Engineer will develop, maintain, and improve data pipelines and integrations supporting load, wind, and solar energy forecasting within the AURA ecosystem. The role combines data engineering with production application support, ensuring data flows reliably and forecasting applications remain operational., * Design, build, and maintain ETL/ELT pipelines using Python and SQL.

• Integrate data from APIs, databases, flat files, SFTP, cloud storage, and external sources.
• Support PostgreSQL and other relational databases.
• Implement data-quality checks, monitoring, logging, and automated recovery processes.
• Troubleshoot failed data pipelines, scheduled jobs, cloud applications, and data-delivery issues.
• Support AWS-hosted applications and services, including S3, Lambda, ECS, EC2, and CloudWatch.
• Assist with deployments, incident resolution, root-cause analysis, and production support.
• Automate manual processes and document technical procedures and system dependencies.
• Collaborate with Data Scientists to provide reliable data for forecasting models.

• Strong experience developing and supporting ETL/ELT or data-integration pipelines.
• Proficiency in Python and advanced SQL.
• Experience with relational databases such as PostgreSQL, Oracle, or SQL Server.
• Experience integrating data through APIs, SFTP, databases, and cloud storage.
• Experience troubleshooting production data pipelines and scheduled jobs.
• Experience with AWS or similar cloud platforms.
• Knowledge of monitoring, logging, root-cause analysis, Git, and software-development practices.

Skills:

• Python - Data processing, automation, and pipeline development.
• SQL & Databases - Advanced SQL and PostgreSQL, Oracle, or SQL Server.
• ETL/ELT Data Pipelines - Building and maintaining data ingestion and transformation workflows.
• AWS Cloud - Experience with S3, Lambda, EC2, ECS, and CloudWatch.
• Production Support & Troubleshooting - Fixing failed pipelines, scheduled jobs, data integrations, and application issues.

Education:

• Bachelor’s degree, Information Technology, Computer Science, Engineering, or a related discipline. Equivalent relevant professional experience will be considered.