Data Warehouse Architect 3 / Data Engineering Lead

Shiro Technologies
Lansing, MI, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Business Intelligence Development Cloud Database Information Systems Continuous Integration Data as a Services Directed Acyclic Graph (Directed Graphs) Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation
+34 more
Data Sharing Data Warehousing Distributed Computing Environment Github Graph Database Python (Programming Language) Machine Learning NoSQL Operational Data Store Power BI Simple Data Format SQL Databases Unstructured Data Workflow Management Systems YAML Enterprise Data Management Jupyter Notebook Parquet Data Processing Google Cloud Azure Data Factory Apache Spark Pyspark Kubernetes Information Technology AWS Glue Star Schema Apache Kafka Data Lakehouse Terraform Data Pipelines Docker Jenkins Databricks

Job description

We are looking for an experienced Data Warehouse Architect / Data Engineering Lead with strong expertise in Cloud Data Engineering, Data Lakehouse, Medallion Architecture, Data Modeling, and Enterprise Data Pipelines., * Lead the architecture, development, and maintenance of enterprise data pipelines.

  • Design and optimize Cloud Data Lake and Lakehouse architectures.
  • Implement Medallion Architecture for scalable data processing.
  • Build and manage ETL/ELT pipelines from multiple enterprise data sources.
  • Ensure data quality, lineage, traceability, security, and governance.
  • Implement data-sharing policies and role-based access controls.
  • Design Star Schema-based Operational Data Stores.
  • Collaborate with data scientists, analysts, and business stakeholders.
  • Mentor and provide technical guidance to data engineering teams.
  • Establish enterprise data engineering standards and best practices.
  • Support the State of Michigan’s data engineering initiatives and provide technical guidance and training to data engineers.

Requirements

The ideal candidate should have hands-on experience building scalable ETL/ELT pipelines, transforming structured and unstructured data, implementing data governance and security policies, and delivering enterprise-level Data and ML products using AWS, Azure, or Google Cloud Platform., * 4+ years of hands-on experience in Cloud Data Engineering (AWS/Azure/Google Cloud Platform).

  • 4+ years of experience building ETL/ELT pipelines and ingesting data from relational, semi-structured, and unstructured sources.
  • 4+ years of experience in Data Lakehouse and Medallion Architecture (Bronze, Silver, Gold).
  • 4+ years of experience in Data Transformation, Data Modeling, and Data Product development.
  • 4+ years of Python, PySpark, Spark, and SQL programming.
  • 2+ years of experience implementing Data Sharing Policies, Data Governance, and access controls.
  • Strong experience with Star Schema, Data Warehousing, and Operational Data Stores.
  • Experience with Parquet file formats and large-scale distributed data processing.
  • Experience designing and delivering Power BI/Tableau dashboards.

Preferred Technical Skills

  • AWS Glue, Redshift, Redshift Spectrum, and SageMaker.
  • Azure Data Services / Google Cloud Data Services.
  • Databricks, DBT, Apache Spark, and Kafka.
  • Kubernetes, Docker, and Jupyter Notebooks.
  • Terraform, GitHub, Jenkins, YAML, and CI/CD.
  • DAGs and workflow orchestration.
  • NoSQL and Graph Databases.
  • DataHub and Data Governance/Security tools.
  • Machine Learning and Data/ML Pipeline development.
  • Power BI and Tableau., Bachelor’s Degree in Computer Science, Data Science, Information Systems, or a related field.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…