Senior Data Engineer

Prosum Inc.
Oak Park, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 150K

Job location

Oak Park, United States of America

Tech stack

Build Automation
Azure
Batch Processing
Google BigQuery
Data Architecture
Data Governance
ETL
Database Queries
DevOps
Fault Tolerance
Python
Enterprise Messaging Systems
SQL Azure
Operational Databases
Performance Tuning
Powershell
RabbitMQ
Simple Object Access Protocol (SOAP)
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Systems Architecture
Systems Integration
Unstructured Data
Data Logging
Microsoft Power Automate
Azure
System Availability
Snowflake
Informatica Cloud
Software Troubleshooting
Data Lake
Information Technology
Kafka
Data Management
REST
Azure
Software Version Control
Data Pipelines
TIBCO (Software)
Databricks

Job description

  • Architect scalable, maintainable data pipelines and integrations
  • Translate business needs into technical designs and system architectures
  • Deliver robust ETL/ELT solutions using modern platforms

???? Develop & Optimize Pipelines

  • Build fault-tolerant pipelines for structured and unstructured data
  • Support both real-time and batch processing
  • Optimize performance across SQL and data platforms

???? Integration & Platform Engineering

  • Develop integrations using REST, SOAP, and messaging systems (Kafka, RabbitMQ)
  • Work with tools like Azure Data Factory, Azure SQL, SSIS, and iPaaS platforms

???? Operational Excellence

  • Support 200+ active production data processes
  • Ensure high availability, observability, and reliability
  • Troubleshoot and resolve complex data issues

???? Collaboration & Leadership

  • Partner with BI teams, analysts, and business stakeholders
  • Mentor junior engineers and guide best practices
  • Lead POCs and drive continuous improvement

???? Automation & DevOps

  • Implement CI/CD pipelines and version control
  • Build automation using Python and PowerShell
  • Ensure strong data governance, security, and compliance practices

Requirements

  • 5+ years of hands-on experience with:
  • Azure Data Factory
  • Azure SQL
  • SSIS or similar ETL tools
  • Strong SQL skills (queries, stored procedures, performance tuning)
  • Experience designing scalable data architectures and integrations
  • Proficiency in Python and/or PowerShell
  • Strong troubleshooting and problem-solving abilities
  • Experience supporting enterprise data pipelines in production environments
  • Bachelor's degree in a related field (Computer Science, Data, etc.)

Nice to Have

  • Experience with Databricks, Snowflake, Synapse, BigQuery, or similar platforms
  • Familiarity with iPaaS tools (SnapLogic, TIBCO, etc.)
  • Knowledge of Azure services (Data Lake, Functions, Logic Apps, Blob Storage)
  • Experience building frameworks for monitoring, logging, and data quality
  • Prior experience mentoring engineers or contributing to technical strategy
  • Relevant cloud certifications (Azure preferred)
  • Experience in restaurant or hospitality environments

What Makes You a Great Fit

? You take ownership and deliver high-quality work on time

? You thrive in fast-paced, evolving environments

? You're highly organized and adaptable

? You collaborate effectively across technical and business teams

? You're always learning and improving

Apply for this position