> Markdown version of [/jobs/ext/2153571-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2153571-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Ryan Companies - **Location:** Minneapolis, MN, United States - **Experience:** Expert - **Salary:** $144,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Automation of Tests, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Cloud Storage, Information Systems, Computer Programming, Continuous Integration, Data Validation, Information Engineering, Data Infrastructure, Data Integration, Data Integrity, Extract Transform Load (ETL), Data Systems, DevOps, Dimensional Modeling, Data Flow Control, Python (Programming Language), Machine Learning, Meta-Data Management, Standard Sql, SQL Databases, Data Processing, Data Storage Management, Google Cloud, Infrastructure Automation Frameworks, Information Technology, Data Lineage, Machine Learning Operations, Stream Processing, Domain Driven Design, Data Pipelines - **Published:** August 20, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/18007264?backUrl=%2Fcareer%2F18007264%2FSenior-Data-Engineer-Minnesota-Minneapolis ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related technical field. * 5+ years of professional experience in data engineering or a similar role. * Strong programming skills in Python, SQL, with experience using tools such as Cloud Composer. * Proven experience designing and maintaining data pipelines using platforms such as GCP, AWS, Azure or similar. You will set yourself apart if you have: * Experience building data infrastructure and services in cloud-native environments (GCP preferred, with exposure to AWS). * Familiarity with MLOps or experience supporting machine learning pipelines in production environments. * Exposure to domain-driven architecture. * Strong collaboration and communication skills with a track record of partnering across functions to deliver high-impact solutions. ## Description * Architect, build, and maintain scalable data pipelines on Google Cloud Platform (GCP), utilizing services like BigQuery, Dataflow, and Cloud Storage to handle diverse data sources (e.g., project systems, safety logs, IoT/sensor data). * Design and implement effective data models, including star schemas and dimensional modeling, to support business intelligence and analytics. * Develop and manage data warehousing solutions to ensure efficient data storage, retrieval, and cost-effectiveness. * Contribute to metadata management, data cataloging, and lineage tracking to enhance the discovery and transparency of enterprise data assets. Data Pipeline Development and Management * Design and orchestrate robust ETL/ELT processes and data integration workflows using tools like Cloud Composer or Apache Airflow. * Implement and manage both batch and real-time data streaming pipelines to ensure timely and accurate data availability for downstream applications. * Write clean, efficient, and well-documented Python and SQL code to process and transform large, complex datasets. * Monitor, troubleshoot, and optimize data pipeline performance, identifying and resolving bottlenecks to improve efficiency and scalability. Data Quality and Governance * Implement and maintain data quality frameworks to ensure the accuracy, consistency, and reliability of data across all systems. * Develop and implement data validation and testing procedures to maintain the highest standards of data integrity. * Establish and enforce data governance policies and best practices, ensuring all data handling is secure, private, and compliant with regulations. Platform Engineering and Automation * Build and maintain CI/CD pipelines for the automated testing and deployment of data engineering workflows. * Support the deployment and monitoring of machine learning models by implementing reproducible and traceable data environments. * Partner with DevOps and Technology teams to automate infrastructure provisioning, CI/CD processes, and data quality monitoring. Collaboration and Leadership * Partner with Enterprise Architects, Solution Architects, data scientists, and analysts to understand data needs, design technical solutions, and translate business requirements into architectural designs. * Lead the implementation of data solutions, from discovery and design through to deployment. * Provide mentorship and guidance to other data engineers, fostering a culture of knowledge sharing and continuous improvement. * Create and maintain clear documentation for architecture, schemas, and pipeline workflows to support team knowledge and onboarding. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)