Data Engineer(Snowflake, Matillion)

Diverse Lynx LLC
Secaucus, NJ, United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$104,000
Working hours
Regular working hours

Tech stack

Batch Processing Big Data BigQuery Computer Programming Databases Data Architecture Data Control Data Files Data Governance Data Integration Data Integrity Extract Transform Load (ETL)
+21 more
Data Security Data Systems Data Warehousing Relational Databases Apache Hadoop Python (Programming Language) PostgreSQL MySQL Performance Tuning Unstructured Data Data Processing System Availability Snowflake Apache Spark Data Lakes Information Technology Star Schema Integration Frameworks Data Management Data Delivery Data Pipelines

Job description

We are looking for a skilled Data Engineer to join our team. The ideal candidate will have experience in building and Eligible to workimizing data pipelines, architectures, and data sets. You will be responsible for creating and maintaining scalable data architectures, ensuring data availability, and enabling data-driven decision-making processes. This role requires a deep understanding of data management practices, data warehousing, and ETL processes., Data Pipeline Development: Design, construct, test, and maintain highly scalable data management systems. Develop and implement architectures that support the extraction, transformation, and loading ETL of data from various sources.

  • Data Integration: Integrate structured and unstructured data from multiple data sources into a unified data system, ensuring data quality and consistency.
  • Data Warehousing: Build and maintain data warehouses and data lakes to store and retrieve vast amounts of data efficiently. Eligible to workimize the performance of databases and queries to meet business needs.
  • Data Processing: Implement data processing frameworks e.g., Hadoop, Spark to process large datasets in real-time or batch processing.
  • Automation and Monitoring: Automate manual processes, Eligible to workimize data delivery, and develop data monitoring systems to ensure data integrity and accuracy.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and provide technical solutions that meet business requirements.
  • Data Governance: Ensure data governance policies are followed, including data security, data privacy, and compliance with regulations.
  • Performance Tuning: Eligible to workimize the performance of ETL processes, databases, and data pipelines to handle large volumes of data and reduce processing times.

Requirements

Snowflake Schema, Data Sets, Data Management, Database Extract Transform and Load (ETL), Testing, Systems Scalability, Data Quality, Unstructured Data, Structured Data, Data Warehousing, Bachelor’s degree in computer science, Engineering, Information Technology, or a related field.

  • 5+ years of experience as a Data Engineer or in a similar role.
  • Proficiency in Snowflake SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
  • Knowledge of data warehousing solutions- BigQuery.
  • Good to have hands on programming languages like Python.
  • Strong understanding of Matillion ETL tool and processes.
  • Experience with data modeling and data architecture design.

About the company

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…