Senior Data Engineer

Symfa Inc.
United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Languages
English
Job source

Tech stack

Microsoft Azure Big Data Code Review Databases Information Engineering Extract Transform Load (ETL) Data Mart Data Warehousing Python (Programming Language) Scrum Methodology Power BI SQL Stored Procedures
+6 more
SQL Databases Azure Data Factory Data Layers Data Lakes Pyspark Data Pipelines

Job description

  • Design, develop and optimize scalable ETL processes and data pipelines
  • Develop and maintain BI solutions, data marts and analytical datasets
  • Design and optimize complex SQL scripts, procedures, and data processing workflows
  • Manage risks and dependencies by identifying technical and delivery threats such as data quality, legacy alignment and capacity, communicating them to stakeholders, and proposing pragmatic mitigations early
  • Align stakeholders by defining and agreeing on approaches and trade-offs, presenting options and recommendations, and running demos to validate progress and demonstrate value
  • Provide technical leadership with hands-on delivery by reviewing and enforcing architecture, designs, code and SQL/notebooks, and by implementing critical components to ensure consistent quality.

Requirements

  • Minimum of 5 years of experience in data engineering, with at least 2-3 years focused on the Azure cloud ecosystem
  • Expert in SQL with proven ability to write and optimize complex analytical queries, stored procedures and functions
  • Deep knowledge of PySpark and Python for large-scale data processing and building ETL/ELT pipelines
  • Understanding data organization principles within a Data Lake (Raw, Silver, Gold layers)
  • Experience in administration and development within managed instance environments
  • Knowledge of data modeling methodologies (Kimball/Inmon), understanding of Slowly Changing Dimensions (SCD), and history management
  • Deep understanding of enterprise Data Warehouse architecture, including the design of dimension and fact tables, and the creation of aggregated data layers
  • Financial/Insurance Data Experience, understanding of month-end close processes, data reconciliation, and financial calculation logic
  • Experience in performing code reviews, designing pipeline architecture, and overseeing the technical quality of the team’s output
  • Experience working in Scrum teams, with the ability to decompose high-level business goals into specific technical tasks (User Stories/Tasks) and manage the delivery plan English level B2 or higher. *

Nice to have:

  • Experince orchestrating complex task chains in Azure Data Factory
  • Knowledge of the insurance domain including premiums, commissions, premium taxes, and actuarial calculations
  • Experience with BI tools such as Power BI and understanding how end users consume data from a DWH
  • Practical experience performing lift-and-shift migrations of logic from legacy databases to a cloud-based warehouse
  • Azure certification preferred, for example Microsoft Certified: Azure Data Engineer Associate (DP-203).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · WWC 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all