Senior Data Engineer / Software Engineer Energy Trading Platform
Role details
Job location
Tech stack
Job description
We are looking for a Data Engineer / Software Engineer to build and operate an energy trading platform that supports energy trading, analytics, and decision-making. This role sits at the intersection of data engineering and software engineering, with ownership of scalable services and data pipelines running on AWS. In this role, you will design, implement, and maintain data pipelines and long-running services that process large volumes of energy market data. You will work closely with traders, analysts, and other engineers to ensure that critical data is available, accurate, and timely for dashboards and decision-making tools. This role is best suited for senior-level engineers with experience in taking end-to-end ownership of critical data services in production.
- Develop and maintain containerized services deployed on ECS
- Build and orchestrate workflows using Airflow and/or Prefect
- Apply software engineering best practices: modular design, testing, CI/CD, code reviews, and versioning
- Design and maintain analytics-ready data models tailored to trading, risk, and performance reporting
- Collaborate with traders, analysts, and engineers to define metrics, KPIs, and data contracts
- Connect curated datasets to dashboards and BI tools (e.g., Grafana)
- Ensure data correctness, timeliness, and availability for business-critical dashboards
- Implement monitoring, alerting, retries, and backfills for pipelines and services
- Optimize performance, scalability, and cost across AWS components
- Document systems, services, and data models to support self-service analytics
- We care more about strong engineering fundamentals than experience with every specific tool listed Who you are
Requirements
-
Strong experience in Data Engineering or Software Engineering, focused on data-intensive systems
-
Solid understanding of ETL/ELT patterns, workflow orchestration, and data modeling
-
Hands-on production experience with Airflow and/or Prefect
-
Experience running containerized workloads in production using AWS ECS
-
Proficiency in Python, with an emphasis on clean, maintainable, testable code
-
Strong SQL skills and experience with relational databases
-
Solid working knowledge of AWS services (e.g. ECS, S3, IAM, CloudWatch)
-
Infrastructure-as-code experience Nice to have:
-
Experience in energy trading, power markets, commodities, or financial markets
-
Familiarity with time-series data, market curves, and forecast data
-
Experience operating streaming systems for market or operational data
-
Practical experience with Apache Spark and/or Apache Flink
-
Knowledge of AWS-native streaming tools (Kinesis)
-
Experience with data observability, quality checks, and SLAs
-
Exposure to quantitative, forecasting, or optimization systems