Principal Data Engineer / Data Architect - AWS & Google Cloud Platform

TekinvaderZ LLC
Charlotte, NC, United States
5 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Amazon Web Services Amazon S3 Big Data BigQuery Cloud Computing Cloud Computing Security Cloud Database Cloud Storage Code Review Computer Programming
+49 more
Continuous Integration Data as a Services Data Architecture Data Cleansing Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Transformation Data Systems Data Warehousing Distributed Computing Environment Distributed Systems Data Flow Control Identity and Access Management Python (Programming Language) Meta-Data Management Performance Tuning Cloud Services Cloudera SQL Databases Data Streaming Software Technical Review Enterprise Data Management Data Processing Google Cloud Data Ingestion Snowflake Apache Spark Multi-Cloud AWS Lambda HybridCloud Event Driven Architecture Build Management Data Lakes Pyspark Infrastructure Automation Frameworks Information Technology Data Lineage Deployment Automation AWS Glue Apache Kafka Terraform Stream Processing Data Pipelines Amazon Elastic Mapreduce (EMR) Amazon Redshift Databricks

Job description

  • Lead the architecture, design, development, and implementation of scalable enterprise data platforms.
  • Design and build robust data pipelines for batch and real-time data processing.
  • Architect cloud-native data solutions using AWS and/or Google Cloud Platform (Google Cloud Platform).
  • Develop and optimize ETL/ELT pipelines, data ingestion frameworks, and data transformation workflows.
  • Lead data platform modernization and migration initiatives from on-premises environments to cloud platforms.
  • Establish data architecture standards, data governance practices, security controls, and data quality frameworks.
  • Work with business stakeholders, data scientists, analytics teams, and engineering teams to deliver business-critical data solutions.
  • Drive technical design reviews, code reviews, performance tuning, and engineering best practices.
  • Mentor data engineers and provide technical guidance to distributed engineering teams.
  • Optimize cloud infrastructure, data processing performance, scalability, and operational costs.
  • Lead technical discussions around data modeling, data warehousing, data lakes, and lakehouse architecture., * sponsorship and I-140 processing support, subject to company policy and eligibility.
  • Long-term career growth and technical leadership opportunities.
  • Transparent communication regarding employment terms and immigration processes.

Requirements

We are seeking highly experienced Lead Data Engineers, Principal Data Engineers, and Data Architects with 15+ years of experience designing, developing, and implementing enterprise-scale data engineering solutions across AWS and Google Cloud Platform (Google Cloud Platform).

The ideal candidate will have extensive experience in cloud data architecture, large-scale data processing, distributed computing, data pipeline development, and technical leadership.

We offer H-1B transfer sponsorship for eligible candidates and sponsorship, including I-140 processing support, subject to company policy, eligibility, and applicable immigration requirements., * 15+ years of overall IT experience, with significant hands-on experience in data engineering and architecture.

  • Strong programming skills in Python, SQL, and/or Scala.
  • Extensive experience building enterprise-grade ETL/ELT pipelines and distributed data processing solutions.
  • Strong experience with AWS data services such as:
  • Amazon S3
  • AWS Glue
  • Amazon Redshift
  • Amazon EMR
  • AWS Lambda
  • Amazon Kinesis
  • Strong experience with Google Cloud Platform data services such as:
  • BigQuery
  • Dataflow
  • Dataproc
  • Cloud Storage
  • Pub/Sub
  • Cloud Composer
  • Experience with Apache Spark, PySpark, Kafka, and distributed processing frameworks.
  • Expertise in data modeling, data warehousing, data lakes, and modern data platform architecture.
  • Strong understanding of cloud security, IAM, encryption, governance, and performance optimization.
  • Experience leading technical teams, defining architecture standards, and delivering complex enterprise projects.
  • Excellent communication, analytical, and stakeholder management skills., * Experience designing and implementing multi-cloud or hybrid-cloud data architectures across AWS and Google Cloud Platform.
  • Knowledge of Databricks, Snowflake, Delta Lake, or lakehouse architecture.
  • Experience with Terraform, infrastructure as code, CI/CD, and automated deployment pipelines.
  • Experience with real-time streaming, event-driven architecture, and large-scale data processing.
  • Exposure to data governance, metadata management, data lineage, and data quality tools.
  • Experience integrating data platforms with AI/ML, advanced analytics, and GenAI solutions.
  • Prior experience as a Lead Data Engineer, Principal Data Engineer, Data Engineering Manager, or Data Architect.

Immigration and Career Support, Candidates with extensive experience in enterprise data platforms, cloud data engineering, and technical architecture are encouraged to apply.Candidates must have valid U.S. work authorization and be eligible for the proposed employment and immigration arrangements.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…