Data Engineer

MASH IT SOLUTIONS, LLC

Texas City, TX, United States

1 day ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

4 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Agile Methodology Airflow Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 JIRA Big Data Databases Continuous Integration Data Architecture Information Engineering Database Queries

+20 more

Distributed Systems Github Python (Programming Language) PostgreSQL Microsoft SQL Server Query Optimization Cloud Services Data Streaming Snowflake Apache Spark Electronic Medical Records Integration Frameworks Real Time Data Apache Kafka Apache Nifi Bitbucket Software Version Control Data Pipelines Jenkins Amazon Redshift

Requirements

10+ years of experience in Data Engineering, with a proven track record of designing and building data pipelines and architectures at scale.

At least 4 years of hands-on experience with Snowflake, including data modeling and query optimization, designing and implementing multi-layered data architectures
Experience with cloud services, preferably AWS (e.g., S3, EMR, EC2, Redshift, Athena, Lambda, Glue), for designing, deploying, and managing scalable data solutions.
Strong experience in Big Data technologies like Spark (Python/Scala) for large-scale data processing.
Proficiency in Data Orchestration and Integration tools, such as Apache Airflow, Apache NiFi, DBT, or equivalent.
Expertise in working with relational (e.g., SQL Server, PostgreSQL) and columnar databases (e.g., AWS Redshift, Snowflake), with advanced SQL query writing skills.
Hands-on experience with Kafka or equivalent streaming data systems to process real-time data.
Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems.
Proven ability to collaborate with offshore teams and coordinate across time zones to deliver successful projects.
Experience with version control systems like Bitbucket or GitHub, and project management tools such as Jira, with familiarity in working within an Agile/Sprint model.
Good to have experience with Jenkins for continuous integration and deployment (CI/CD) pipelines and Terraform for infrastructure as code (IaC) automation.