Technical Lead – Cloud Data Engineering

System One
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 187K

Job location

Remote

Tech stack

API
Agile Methodologies
Artificial Intelligence
Data analysis
Azure
Cloud Computing
Configuration Management
Information Engineering
Data Integrity
ETL
Data Mart
Data Migration
Data Stores
Data Systems
Data Warehousing
DevOps
Ganglia (Software)
Python
Log Analysis
Microsoft Data Access Components
Meta-Data Management
Microsoft SQL Server
NoSQL
Performance Tuning
Powershell
Cloud Services
Azure
SQL Databases
SQL Server Reporting Services
SQL Server Integration Services
SQL Server Analysis Services
T-SQL
Scripting (Bash/Python/Go/Ruby)
Performance Testing
Azure
Cloud Monitoring
System Availability
Spark
Data Lake
Information Technology
Data Management
Data Delivery
Azure
Data Pipelines

Job description

t

  • Lead a team of developers in designing and implementing data engineering solutions for Azure Cloud-based Data Lake, SQL, and NoSQL data stores.\t
  • Work directly with end users to translate business requirements into scalable cloud data solutions supporting enterprise analytics and reporting platforms.\t
  • Develop, deliver, and maintain ETL/ELT/data pipelines, data extracts, and API-based data delivery using Azure Data Lake Storage Gen2, Azure Data Factory, Synapse Pipelines, and other Azure services.\t
  • Ensure legacy EDW development and operations using Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies continue effectively during migration to the Azure Cloud platform.\t
  • Define and validate ETL performance testing, compare workloads against legacy baselines, and optimize throughput for scalable cloud performance.\t
  • Collaborate with IT infrastructure, DevOps, Data Engineers, Modelers, and Architects to optimize pipelines, troubleshoot issues, and tune system performance.\t
  • Design and support data models and pipelines for relational, dimensional, Lakehouse, data warehouse, data mart, SQL, and NoSQL data stores.\t
  • Prepare data for advanced analytics, visualization, reporting, and AI/ML applications.\t
  • Implement data migration, related data integrity, security, quality, and metadata management functions.\t
  • Monitor data systems, troubleshoot issues, and ensure high availability and performance of data platforms.\t
  • Support Agile DevOps practices, including program increment planning, configuration management, automation, and continuous learning.

Requirements

Security Clearance: Ability to obtain or maintain a Public Trust clearance, US Citizenship required, * Bachelor''s degree in Computer Science or related field\t

  • Minimum of 9 years of experience supporting enterprise data warehousing and cloud data solutions\t
  • At least 5 years of leading a team supporting enterprise data warehouses using Microsoft data solutions\t
  • Proven client engagement experience providing data engineering and reporting solutions\t
  • Strong experience in ETL performance testing, using tools like Azure Monitor, Log Analytics, Spark UI, and Ganglia\t
  • Extensive experience with Microsoft SQL Server, SSIS, SSRS, SSAS, and scripting languages such as SQL, T-SQL, Python, PowerShell in cloud environments\t
  • Experience designing and building ETL/data engineering solutions utilizing Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and related cloud services\t
  • Knowledge of data management best practices, including change management, QA, performance tuning, and security\t
  • Experience working in Agile projects with cross-functional teams\t
  • Strong attention to detail, multi-tasking skills, and ability to support multiple projects\t
  • Additional preferred skills include experience in law, HR, financial management, inventory, or federal projects, and Azure DevOps or Microsoft certifications in Azure fundamentals, data engineering, AI, or analytics.

Benefits & conditions

System One, and its subsidiaries including Joulé and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

Apply for this position