Senior Software & Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+36 more
Job description
We are seeking an experienced developer and data engineer to build and evolve data warehouse, data lake, lakehouse, and analytics solutions on the Microsoft data platform. The role is hands-on: designing data models, building ELT/ETL pipelines using the Medallion Architecture (Bronze / Silver / Gold), and delivering reliable, well-modeled data products on Microsoft Fabric and Azure SQL.
As a data engineer you will build resilient data pipelines and create visibility into data quality issues, building client trust in their data and our ability to deliver dependable solutions. You will work with clients directly to understand their data sources, governance and security requirements, and the nature of their business. You will build data pipelines and position data for analytics matching our client’s current capabilities to query and leverage the data, but also design the scalable, secure architecture needed to set them up for the future and AI..
Your expertise will be critical in shaping our clients’ data strategy, driving architectural decisions, and mentoring team members to deliver scalable and reliable data solutions, * Design and build data warehouse solutions on Microsoft Fabric and Azure SQL aligned to client business needs.
- Implement and evolve the Medallion Architecture - Bronze (raw), Silver (cleansed/conformed), and Gold (business-ready) layers - on Fabric and Azure SQL.
- Develop and maintain ELT/ETL pipelines that are reliable, observable, and easy to operate.
- Model data for analytics and reporting - fact/dimension design, conformed dimensions, performant aggregates.
- Collaborate with ATG technical leads and client stakeholders to translate requirements into delivery-ready solutions.
- Own quality - testing, validation, documentation, and monitoring of pipelines and datasets.
- Research and propose solutions independently; bring options and tradeoffs, not just questions.
- AI Readyness: understanding of leveraging Fabric and Azure AI Search to tag data and make data available to Enterprise AI Orchestration platforms such as Foundry.
- Consulting: Able to explain various data and analytic approaches to non-technical stakeholders. Able to conduct Bronze to Silver analysis and mapping and present to clients. Able to interview clients to design data marts for Gold.
- Technical Leadership: Provide thought leadership on best practices for readable, maintainable, performant, and secure data pipelines.
Requirements
Do you have experience in T-SQL?, This full-time role requires a minimum of 40 hours per week, with additional hours as needed to meet deadlines. Candidates must be able to sit or stand for extended periods, travel between office locations (including those with stairs), and lift up to 30 pounds. Strong verbal and written English communication skills, along with adequate visual and auditory abilities (with or without aids), are essential. The physical demands described are representative of those needed to perform the job’s essential functions, with or without reasonable accommodation., Applicants must be authorized to work in the U.S. without company sponsorship. We appreciate your interest in ATG!, * 5+ years experience with data engineering experience with at least 2 years on the Microsoft platform
- Microsoft Fabric: OneLake, Lakehouse, Warehouse, Pipelines, Notebooks, Dataflows Gen2.
- Azure SQL: schema design, performance tuning, indexing, partitioning, and security.
- Medallion Architecture: hands-on experience designing and building Bronze / Silver / Gold layers in Microsoft Fabric and Azure SQL.
- T-SQL: advanced querying, stored procedures, window functions, performance optimization.
- ELT / ETL pipeline development: ingestion, transformation, orchestration, and monitoring across the Bronze » Silver » Gold flow leveraging tools such as Azure Data Factory, Synapse Analytics, Azure Functions, Python and PySpark for Notebook development.
- Data warehouse modeling: dimensional modeling (Kimball), slowly changing dimensions, conformed dimensions in the Gold layer.
Professional and Consulting Skills:
- Project Management:
- Document requirements, data flows, and system architecture
- Estimate effort accurately and communicate blockers or timeline risks proactively
- Team player:
- Champion best practices for readable, maintainable, performant, and secure code
- Mentor junior engineers and share knowledge across the team
- Manage your time effectively and communicate technical trade-offs clearly
- Detail oriented: ability to understand and business processes & data
Nice to haves:
- Power BI and DAX for semantic models and reporting
- Git-based source control and CI/CD for data pipelines (Azure DevOps or GitHub Actions)
- Experience with Snowflake and Databricks
- Experience with AEC data including Autodesk APS and Autodesk Forma
- Familiarity with data governance, lineage, and cataloging (Microsoft Purview)
- Experience with Microsoft Foundry and Azure AI Search
- .NET or Python Django Web Application and RESTful API development
- Azure & AWS infrastructure, Terraform
Benefits & conditions
Pulled from the full job description
- 401(k) 4% Match
- Health insurance
- 401(k) matching
- Paid time off
- Vision insurance
- Dental insurance
- Disability insurance, * Health, Dental and Vision Benefits
- Short-Term and Long-Term Disability
- Wellness Programs
- 3 weeks of PTO each year, paid holidays, and your birthday off
- 2 paid volunteer days each year
- 401k match up to 4% after 90 days of employment
- Great culture with frequent in-person events and gatherings
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
What Are The Top Skills Required For Azure Developers?
Data Engineer Salary UK
The Most Popular IT Jobs on the Market
Dev Digest 120 - Apple and peers