Data Engineer

We are looking for a Senior Data Engineer role resource is required at onsite location (Charlotte, NC - North Carolina-USA Onsite location)). Resource should have minimum 5+ years of hands-on experience in building production data systems. Resource will have to work from office for 3 days in a week. Resource is expected to design, build, and maintain scalable data platforms while leading technical decisions.

Python (advanced)

SQL (expert level)

Scala or Java (often preferred for big data)

1. Data Engineering skills required

ETL/ELT pipeline development

Data modelling (star schema, dimensional modelling)

Data warehousing (Snowflake, Big-Query, Redshift, Synapse)

Data lakes and lake-house architectures

1. Big Data Technologies skills required

Apache Spark (essential)

Hadoop ecosystem

Kafka (streaming)

Apache Airflow or similar workflow orchestration tools

1. Cloud Platforms skills required

AWS (S3, Glue, EMR, Lambda, Redshift)

Azure (ADF, Synapse, Databricks)

Google Cloud (Big-Query, Dataflow, Data-proc)

1. Databases skills required

PostgreSQL, MySQL

NoSQL databases (MongoDB, Cassandra, DynamoDB)

1. DevOps & Engineering Practices

Git

CI/CD pipelines

Docker

Kubernetes

Infrastructure as Code (Terraform is a plus)

1. Data Quality & Governance

Data validation and testing

Metadata management

Security and access control

Monitoring and observability

1. Leadership Skills

System design and architecture

Mentoring junior engineers

Stakeholder communication

Project estimation and technical planning

1. Nice-to-Have Skills