Senior Data Engineer
Symfa Inc.
United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Languages
English
Job source
Tech stack
Microsoft Azure
Big Data
Code Review
Databases
Information Engineering
Extract Transform Load (ETL)
Data Mart
Data Warehousing
Python (Programming Language)
Scrum Methodology
Power BI
SQL Stored Procedures
+6 more
SQL Databases
Azure Data Factory
Data Layers
Data Lakes
Pyspark
Data Pipelines
Job description
- Design, develop and optimize scalable ETL processes and data pipelines
- Develop and maintain BI solutions, data marts and analytical datasets
- Design and optimize complex SQL scripts, procedures, and data processing workflows
- Manage risks and dependencies by identifying technical and delivery threats such as data quality, legacy alignment and capacity, communicating them to stakeholders, and proposing pragmatic mitigations early
- Align stakeholders by defining and agreeing on approaches and trade-offs, presenting options and recommendations, and running demos to validate progress and demonstrate value
- Provide technical leadership with hands-on delivery by reviewing and enforcing architecture, designs, code and SQL/notebooks, and by implementing critical components to ensure consistent quality.
Requirements
- Minimum of 5 years of experience in data engineering, with at least 2-3 years focused on the Azure cloud ecosystem
- Expert in SQL with proven ability to write and optimize complex analytical queries, stored procedures and functions
- Deep knowledge of PySpark and Python for large-scale data processing and building ETL/ELT pipelines
- Understanding data organization principles within a Data Lake (Raw, Silver, Gold layers)
- Experience in administration and development within managed instance environments
- Knowledge of data modeling methodologies (Kimball/Inmon), understanding of Slowly Changing Dimensions (SCD), and history management
- Deep understanding of enterprise Data Warehouse architecture, including the design of dimension and fact tables, and the creation of aggregated data layers
- Financial/Insurance Data Experience, understanding of month-end close processes, data reconciliation, and financial calculation logic
- Experience in performing code reviews, designing pipeline architecture, and overseeing the technical quality of the team’s output
- Experience working in Scrum teams, with the ability to decompose high-level business goals into specific technical tasks (User Stories/Tasks) and manage the delivery plan English level B2 or higher. *
Nice to have:
- Experince orchestrating complex task chains in Azure Data Factory
- Knowledge of the insurance domain including premiums, commissions, premium taxes, and actuarial calculations
- Experience with BI tools such as Power BI and understanding how end users consume data from a DWH
- Practical experience performing lift-and-shift migrations of logic from legacy databases to a cloud-based warehouse
- Azure certification preferred, for example Microsoft Certified: Azure Data Engineer Associate (DP-203).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
about 2 years ago