Senior Data Engineer - Forecasting Platforms & Operations
Brillfy Technology
Juno Beach, FL, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Amazon Web Services
Amazon Elastic Compute Cloud
Amazon S3
Cloud Storage
Databases
Continuous Integration
Data Validation
Information Engineering
Data Integration
Extract Transform Load (ETL)
Relational Databases
+20 more
Supervisory Control and Data Acquisition (SCADA)
Python (Programming Language)
PostgreSQL
Machine Learning
Microsoft SQL Server
Operational Databases
Oracle (Applications)
Software Deployment
SQL Databases
Systems Integration
Software Organization
Data Logging
File Transfer Protocol (FTP)
Data Ingestion
Apache Spark
Git
Pyspark
Cloudwatch
Data Pipelines
Databricks
Job description
We are seeking an experienced Senior Data Engineer to support data engineering, integrations, and production operations for an energy forecasting platform. The ideal candidate will have strong hands-on experience in Python, SQL, ETL/ELT pipelines, AWS cloud services, and production troubleshooting., * Design, develop, maintain, and optimize ETL/ELT data pipelines.
- Build automated data ingestion and transformation workflows using Python and SQL.
- Integrate data from APIs, databases, flat files, SFTP, and cloud storage.
- Support PostgreSQL and other relational databases.
- Troubleshoot production issues, failed jobs, and data pipeline failures.
- Support AWS services, including S3, Lambda, ECS, EC2, and CloudWatch.
- Implement data-quality checks, monitoring, logging, and automated recovery.
- Support application deployments, incident management, and root-cause analysis.
- Collaborate with Data Scientists to ensure reliable data for forecasting models.
Requirements
- Strong experience in ETL/ELT development and data integration.
- Proficiency in Python and advanced SQL.
- Experience with relational databases such as PostgreSQL, Oracle, or SQL Server.
- Hands-on experience with AWS or comparable cloud platforms.
- Experience supporting production data pipelines and scheduled jobs.
- Knowledge of APIs, SFTP, cloud storage, and data validation.
- Experience with Git and modern software development practices.
Preferred Qualifications:
- Experience with AWS S3, Lambda, ECS, EC2, CloudWatch, or Step Functions.
- Knowledge of Databricks, Spark/PySpark, Redshift, or Aurora.
- Experience with CI/CD, application deployments, and production monitoring.
- Exposure to energy forecasting, renewable generation, weather, telemetry, or SCADA data.
- Experience supporting machine-learning or forecasting data pipelines.
Interested candidates: Please share your updated resume along with your current location, work authorization, and contact details.
Hiring #DataEngineer #SeniorDataEngineer #Python #SQL #AWS #ETL #DataEngineering #CloudComputing #C2CJobs #FloridaJobs
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦