Data Engineer Lead/Data Warehouse Architect
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+33 more
Job description
Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau.
The Data Engineer Lead serves as the primary State of Michigan technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers. This roleβs responsibilities include:
- Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
- Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
- Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices.
- Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth.
- Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals.
Requirements
Data Warehousing, Data Warehousing, DevOps, Data Modeling, NoSQL, Power BI, Tableau, Data Analysis, Operational Audit, SQL Databases, o Must have a BS in Computer Science / Data Science / Information Systems with an overall 4+ years of experience in designing and implementing data, analytics, and AI solutions for large enterprises by building data pipelines using the available data platform tools of any Cloud Service Provider (CSP) such as AWS/Microsoft/Google.
o Experience of minimum 4 years in modeling and leveraging Relational data services with demonstrated proficiency in Python/Pysparks/SQL programming and tuning SQL queries to extract data from multiple sources ( relational DB, flat files, CSV, HTML, JSON, etc) sources into Lakehouse Medallion architecture in parquet formats
o Demonstrated experience and expertise of minimum 4 years in programming/scripting languages including Python, R, Spark, etc.
o Experience in designing and delivering Star-schema based operational data store is required to enable visualization of program activities and outcomes in a visualization tool such as Power BI.
Key Programming Languages: SQL, Python, R, Spark, Terraform Scripting, DAGs Scripting, YAML scripting, Docker
Other Technologies, Concepts and Frameworks: Juniper Notebooks, NOSQL DB, Graph DB, Parquet DB, Lakehouse and Medallion Architecture concepts, Kafka, Kubernetes, Glue, Databricks, Power BI, Tableau, Redshift Spectrum, Sagemaker, DBT, Datahub, SageMaker, Machine Learning, GitHub, DevOps
About the company
PROLIM Global Corporation (www.prolim.com) is currently seeking Data Engineer Lead/Data Warehouse Architect for location Lansing, Michigan, United States for one of our Top clients., PROLIM is a leading provider of end-to-end IT, PLM and Engineering Services and Solutions for Global 1000 companies. They understand business as much as technology, and help their customers improve their profitability and efficiency by providing high value technology consulting, staffing, and project management outsourcing services.
Their IT and PLM consulting offerings include; Advisory, PLM Software/Services, Program Management, Solution Architecture Training/Staffing, Cloud Solutions, Servers/Networking, Infrastructure, ERP Practices and QA Services. Engineering services include Data Translation, CAD/CAM/CAE, Process & Product Engineering, Prototyping, and Testing/Validation within a wide range of markets and industries.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦