Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+31 more
Job description
DevOps Power BI Equities Operations Leadership Governance Data Lakes Encryption Databricks Warehousing Scalability Apache Spark Transact-SQL Azure DevOps Data Privacy Communication Data Modeling Data Pipelines Data Lakehouse Synapse Citrix Version Control Microsoft Azure Data Governance Data Processing Azure Functions Computer Science Azure Databricks Stored Procedure Azure Logic Apps Agile Methodology Unstructured Data Business Valuation Azure Data Factory Workflow Management Information Systems Metadata Management Smart Meter Systems Software Engineering Serverless Computing Cloud-Native Computing Full Stack Development Business Transformation Azure Synapse Analytics SQL (Programming Language) Git (Version Control System) Extract Transform Load (ETL) Scrum (Software Development) Scala (Programming Language) Python (Programming Language) Microsoft Certified Professional Role-Based Access Control (RBAC) Troubleshooting (Problem Solving) General Data Protection Regulation (GDPR) Microsoft Certified: Azure Data Engineer Associate Microsoft Certified: Azure Solutions Architect Expert, This role is responsible for building, optimizing, and managing large-scale data pipelines and solutions that power critical business insights and operations. The ideal candidate will have a strong command of T-SQL, hands-on experience working with Apache Spark, and the ability to develop data workflows using Python or Scala. This role is perfect for someone passionate about building robust, scalable data solutions in cloud-native environments. Architect and implement data pipelines, data lakes, and warehouse models using Azure Synapse Analytics, and Data Lake Storage. Develop and optimize complex T-SQL queries, views, stored procedures, and data transformations in both dedicated and serverless SQL pools. Leverage Apache Spark (via Synapse) to process and transform large-scale datasets using Scala and/or Python. Design and implement ELT/ETL workflows across structured, semi-structured, and unstructured data sources. Collaborate with business analysts, data scientists, and stakeholders to deliver reliable and performant data solutions. Monitor, troubleshoot, and optimize performance across Synapse pipelines, Spark pools, and Azure data services. Apply data governance, metadata management, and security practices including RBAC, encryption, and auditability. Work within Agile/Scrum teams using modern DevOps and CI/CD practices for data development and deployment. 30%: data pipeline design 20%: data modeling & warehousing 15%: spark-based data processing 15%: SQL development 10%: platform integration 10%: monitoring, governance, & documentation
Requirements
Python, Azure, azure synapse, Sql, t sql, scala, Spark, databricks, logicapps, devops, Bachelors degree in information systems, Computer Science, Engineering or equivalent years of experience in data or software engineering roles Advanced skills in T-SQL and experience tuning queries for performance in large-scale distributed environments Proficient use of Apache Spark, preferably within Synapse or Databricks, using Scala and/or Python Experience with source control (Git) and CI/CD practices using Azure DevOps Strong communication and leadership skills, with the ability to engage technical and non-technical stakeholders across the organization. Deep understanding of Azure Data Factory, Data Lake Gen2, and SQL pools (dedicated/serverless) Experience building end-to-end data pipelines that support analytics, reporting, and operational needs Microsoft certifications such as: -Azure Data Engineer Associate -Azure Solutions Architect Expert Experience with additional Azure services such as: -Azure Databricks, Azure Functions, Event Hubs, Logic Apps, Key Vault, and Power BI Exposure to data lakehouse architecture, Delta Lake, or other modern data platforms Understanding of data privacy and compliance frameworks (e.g., NERC, FERC, GDPR, CCPA, or smart meter data privacy protocols ), Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.
About the company
We’re partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That’s the power of true partnership. TEKsystems is an Allegis Group company., Were a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. Were a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. Were strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. Were building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…