Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
Experteer Overview In this role, you will design, build, and optimize data pipelines to enable data-driven decision making. You will work within a cross-functional environment to migrate and modernize data architectures on cloud platforms, and to deliver scalable analytics solutions. You will partner with data scientists and business stakeholders to translate needs into robust data products and dashboards. This is a remote-friendly position at a leading financial services firm with a focus on governance, security, and reliability. Compensation / Benefits * Design, build and maintain ETL/ELT data pipelines for large datasets * Migrate legacy data architectures to Azure and AWS * Develop Spark-based pipelines via Databricks and Synapse * Automate data ingestion and transformation workflows with Airflow * Create interactive dashboards for stakeholders * Design and manage relational and NoSQL databases * Implement secure, compliant data pipelines with governance * Integrate data sources via REST APIs * Collaborate with data scientists to deploy ML models * Set up monitoring/alerting for data pipelines * Use Docker for deployment and ensure environment consistency * Identify and implement workflow efficiencies to reduce costs Tasks * Master’s degree in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems or related field * 3 years of experience with Python, SQL, and ETL processes * 3 years of experience with AWS and Azure * 3 years of experience with Spark, Databricks and Synapse * 2 years of experience with Apache Airflow * 3 years of experience with Power BI and Tableau * 3 years of experience with SQL and NoSQL databases * 3 years of experience with data governance, compliance and security * 3 years of experience with REST APIs and integration frameworks * 3 years of experience with ML and predictive modeling * 3 years of experience with monitoring tools (Splunk, CloudWatch) * 2 years of experience with DevOps practices and containerization Key requirements * remote work * health and dental insurance * retirement savings plans * paid time off * holidays and sick leave * employee assistance programs
Requirements
firm via REST APIs * Collaborate with data scientists to deploy ML models * Set up monitoring/alerting for data pipelines * Use Docker for deployment and ensure environment consistency * Identify and implement workflow efficiencies to reduce costs Tasks * Master’s degree in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems or related field * 3 years of experience with Python, SQL, and ETL processes * 3 years of experience with AWS and Azure * 3 years of experience with Spark, Databricks and Synapse * 2 years of experience with Apache Airflow * 3 years of experience with Power BI and Tableau * 3 years of experience with SQL and NoSQL databases * 3 years of experience with data governance, compliance and security * 3 years of experience with REST APIs and integration frameworks * 3 years of experience with ML and predictive modeling * 3 years of experience with monitoring tools (Splunk, CloudWatch) * 2 years of experience with aaaa
- practices and containerization Key requirements * remote work * health and dental insurance * retirement savings plans * paid time off * holidays and sick leave * employee assistance programs
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story