Data and AI Engineer (Mid-Level)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
Experteer Overview As a Data Engineer, you will manage and evolve Shannon & Wilson’s Microsoft-based data platform to provide reliable access to data for project delivery and leadership insights. You’ll work within a digital transformation context, ensuring robust pipelines and trusted analytics for engineers, staff, and decision-makers. This role blends platform operations, data engineering, and governance to enable data-driven decisions in infrastructure projects. You will partner with cross-functional teams to advance analytics and usability of data platforms. Compensation / Benefits * Administer and monitor Microsoft Fabric/Azure Synapse, Azure SQL, and Power BI workspaces * Ensure data pipelines, notebooks, and scheduled refreshes run reliably and on time * Implement monitoring, alerting, and cost optimization for the platform * Build, maintain, and optimize ingestion pipelines from internal and external data sources * Design and maintain clean, curated data models to support reporting and analytics * Collaborate with business analysts to ensure data structures meet requirements * Apply data governance standards for naming conventions, schema design, and access control * Work with IT to enforce security policies, manage permissions, and ensure regulatory compliance * Stay current with Microsoft data platform capabilities and advocate improvements * Partner with stakeholders to identify and implement new analytics use cases Tasks * 7 to 14 years of experience with Microsoft data stack (Azure SQL Database, Azure Data Factory, Synapse, Power BI, or Fabric) * Strong SQL development skills and experience with data modeling (star/snowflake schema) * Hands-on experience with ETL/ELT pipelines and automation scheduling * Familiarity with cloud-based data security and access control practices * Experience with Microsoft Fabric Lakehouse and Mirrored Databases preferred * Familiarity with engineering or construction industry data preferred * Python or Spark experience for data transformation preferred * Knowledge of DevOps/Git-based version control for data pipelines preferred * Strong collaboration skills - able to work with project managers, analysts, and IT staff * Excellent troubleshooting and problem-solving skills * Continuous improvement mindset with willingness to learn and adopt new technologies * Clear communication skills (technical and business-oriented) Key requirements * Employee stock ownership * Medical, prescription, vision, dental, long-term care and life insurance * Pre-tax health and daycare FSA * Profit sharing and 401(k) with annual safe-harbor contributions * Paid vacation days per year * 9 paid holidays + 1 personal holiday
Requirements
business and analytics * Collaborate with business analysts to ensure data structures meet requirements * Apply data governance standards for naming conventions, schema design, and access control * Work with IT to enforce security policies, manage permissions, and ensure regulatory compliance * Stay current with Microsoft data platform capabilities and advocate improvements * Partner with stakeholders to identify and implement new analytics use cases Tasks * 7 to 14 years of experience with Microsoft data stack (Azure SQL Database, Azure Data Factory, Synapse, Power BI, or Fabric) * Strong SQL development skills and experience with data modeling (star/snowflake schema) * Hands-on experience with ETL/ELT pipelines and automation scheduling * Familiarity with cloud-based data security and access control practices * Experience with Microsoft Fabric Lakehouse and Mirrored Databases preferred * Familiarity with engineering or construction industry data preferred * Python or Spark experience for data transformation preferred * Knowledge of DevOps/Git-based version control for data pipelines preferred * Strong collaboration skills - able to work with project managers, analysts, and IT staff * Excellent troubleshooting and problem-solving skills * Continuous improvement mindset with willingness to learn and adopt new technologies * Clear communication skills (technical and business-oriented) Key requirements * Employee stock ownership * Medical, prescription, vision, dental, long-term care and life insurance * Pre-tax health and daycare FSA * Profit sharing and 401(k) with annual safe-harbor contributions * Paid vacation days per year * 9 paid holidays + 1 personal holiday
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
Top-Paying Tech Jobs (with Salaries)