Data Engineer

Rysun Labs INC

Houston, TX, United States

2 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

4 years minimum

Working hours

Regular working hours

Job source

www.wayup.com

Tech stack

Agile Methodology Amazon Web Services Data Analysis Microsoft Azure Big Data BigQuery Cloud Computing Continuous Integration Data Validation Information Engineering Data Governance Data Integration

+27 more

Extract Transform Load (ETL) Data Systems Data Warehousing Database Design Apache Hadoop Python (Programming Language) Machine Learning Meta-Data Management SQL Databases Unstructured Data Data Processing Cloud Platform System Snowflake Apache Spark Database Performance Git Data Lakes Pyspark Apache Kafka Data Management Video Streaming Stream Processing Azure Synapse Analytics Software Version Control Data Pipelines Amazon Redshift Databricks

Job description

Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data. Build and optimize data integration workflows from multiple data sources. Develop and manage data warehouses, data lakes, and cloud-based data platforms. Collaborate with Data Analysts, Data Scientists, Product Managers, and business stakeholders to understand data requirements. Ensure data quality, integrity, governance, and security across enterprise systems. Optimize SQL queries, database performance, and data processing workflows. Monitor and troubleshoot data pipeline issues and implement performance improvements. Support reporting, analytics, and machine learning initiatives by providing reliable datasets. Implement data validation, monitoring, and automation processes. Participate in Agile development processes and technical design discussions.

Requirements

We are seeking a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and data platforms that support business intelligence, analytics, and data-driven decision-making. The ideal candidate will have strong experience in data engineering, cloud technologies, ETL/ELT development, and data warehousing, along with a passion for delivering high-quality data solutions., 4-7 years of experience in Data Engineering or related roles. Strong expertise in SQL and database design concepts. Hands-on experience with ETL/ELT tools and data integration frameworks. Experience with cloud platforms such as AWS, Azure, or GCP. Strong knowledge of Data Warehousing, Data Modeling, and Data Lake architectures. Proficiency in Python, PySpark, or Scala for data processing. Experience with Big Data technologies such as Spark, Databricks, Hadoop, or Kafka. Knowledge of CI/CD, version control (Git), and automation best practices. Strong analytical, problem-solving, and communication skills. Preferred Qualifications Experience with Databricks, Snowflake, Redshift, Synapse, or BigQuery. Familiarity with data governance, metadata management, and data quality frameworks. Exposure to real-time data processing and streaming technologies. Experience working in Agile/Scrum environments.