Data Engineer

Systems, Inc
Boston, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Boston, United States of America

Tech stack

API
Azure
Data Architecture
ETL
JSON
Python
Simple Data Format
SQL Databases
Data Processing
Data Storage Technologies
Cloud Platform System
Data Ingestion
Azure
Snowflake
PySpark
Databricks

Requirements

Fabric is strongly preferred, but happy to consider strong Databricks/Snowflake or similar engineers.

Python/Pyspark engineering.

Data processing (ETL/ELT), SQL, Data modeling.

Data architecture concepts/patterns.

Cloud platform engineering/support.

Investment compliance knowledge, financial services, and asset management.

Requirements:

  • MS Fabric experience/understanding
  • Working experience in Azure for data ingestion
  • Azure Data Factory
  • API based ingestion
  • data storage formats
  • warehouse and Lakehouse
  • handling csv, Json, parquet file formats
  • data modelling
  • medallion architecture
  • optimized transformations using PySpark

Apply for this position