Data Engineer

As a Data Engineer at Calpine Inc., you will contribute to the BI development to optimize energy operations, enhance forecasting, and improve operational efficiency. This role is ideal for professionals with 10+ years of experience who are passionate about comprehensive data and BI solutions development and solving real-world energy sector challenges using PySpark and Azure Data Factory., * Engage with business users to gather requirements and translate them into comprehensive data and BI solutions.

• Design and implement scalable data pipelines using PySparkand Azure Data Factory, integrating with Azure Data Lake, Synapse Analytics, DataBricks, and Microsoft Fabric.
• Develop and optimize data models and visualizations using Power BI, ensuring performance and usability across business units.
• Lead modernization efforts by migrating legacy BI systems to cloud-based platforms.
• Collaborate with cross-functional teams to ensure alignment with architectural standards and business objectives.
• Oversee system testing, user acceptance testing (UAT), and production deployments.
• Maintain and enhance existing BI solutions, ensuring reliability and scalability.
• Document data flows, transformation logic, and architectural decisions.
• Communicate effectively with stakeholders regarding upcoming changes and coordinate change management activities.

• Minimum 8-10 years of experience in data engineering and BI development.
• Proven expertise in PySpark for data transformation and pipeline development.
• Extensive experience with Azure Data Services, including Data Factory, Data Lake, Synapse,Microsoft Fabricand DataBricks.
• Strong proficiency in Power BI dashboard development and data modeling.
• Solid understanding of cloud architecture, data governance, and performance optimization.
• Advanced SQL skills with a focus on query performance and scalability.
• Experience with dimensional modeling (Star and Snowflake schemas).
• Excellent communication and collaboration skills in cross-functional environments.
• Ability to manage multiple priorities in a dynamic and fast-paced setting.
• Familiarity with SSIS, SSRS, and SSAS(tabular and multi-dimensional models).
• Experience with DAX and MDX query languages.
• Exposure to Power Apps, Data Flows
• Knowledge of machine learning (ML)and artificial intelligence (AI) concepts and their application in data analytics.
• Have worked with Azure ML Services, and understand OpenAI LLM Model.
• Experience implementing role-based and row-level security in BI platforms.