Data Engineer

THE LINKS AT DARDENNE, INC.
Bedminster, United States of America
2 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Bedminster, United States of America

Tech stack

Java
API
Airflow
Amazon Web Services (AWS)
Azure
Databases
Continuous Integration
Data Architecture
Data Governance
ETL
Data Vault Modeling
Data Warehousing
Database Design
Document Management Systems
Python
Message Broker
MongoDB
Online Analytical Processing
NoSQL
Online Transaction Processing
Oracle Applications
RabbitMQ
Red Hat Enterprise Linux - RHEL
Ansible
DataOps
Scala
Simple Object Access Protocol (SOAP)
Software Engineering
Systems Architecture
Rust
Spark
Kubernetes
Information Technology
Kafka
GraphQL
Puppet
Data Pipelines
Docker
Jenkins
Databricks
Programming Languages

Job description

  • Build high performance data systems including databases, APIs, and data integration pipelines.
  • Implement a metadata-driven architecture and infrastructure as code approach to automate and simplify the design, deployment, and management of data systems.
  • Facilitate the adoption of data and software engineering best practices, including code review, testing, and continuous integration and delivery (CI/CD).
  • Develop and establish a data governance framework.
  • Continuous monitoring of process performance and implement improvements for efficiency including fine-tuning existing ETL processes, optimizing queries, or refactoring code.
  • Assess and make optimal use of cloud platforms and technologies, especially Azure and Databricks to enhance system architecture.
  • Implement data quality checks and build processes to identify and resolve data issues.
  • Create and maintain documentation for data architecture, standards, and best practices.
  • Contribute designs, code, tooling, testing, and operational support.
  • Identify opportunities for process optimization and automation to enhance data operations efficiency.

Requirements

  • 7 plus years of experience working as a Data Engineer, Data Architect, Database Developer or similar roles.
  • Bachelor's Degree in Computer Science, Data Science, Engineering or related field.
  • 7+ years of experience in programming languages such as Python, Scala, Java, Rust or similar.
  • 7+ years of experience in Oracle OLTP database design and development.
  • 7+ years of experience in building ETL / ELT data pipelines using Apache Spark, Airflow, dbt or similar.
  • 7 years of experience in developing APIs that include REST, SOAP, RPC, GraphQL or similar.
  • 7 years of experience in OLAP / data warehouse design and development using dimensional (Kimball star-schema), data vault or Inmon methodologies.
  • 5 years of experience in NoSQL database design and development preferably on MongoDB or similar.
  • 5 years of experience working with message broker platforms like RabbitMQ, Apache Kafka, Red Hat AMQ or similar.
  • 5 years of experience working with Azure or AWS cloud-native technologies / services.
  • Working knowledge of CI/CD automation tools or services like Jenkins, Ansible, Chef, Puppet or similar.
  • Working knowledge of containerized platform or services like Docker, Kubernetes or similar.

#RecruitPS, Over 20 years' of recruiting experience with hands-on recruiting and placement of I.T. professionals (Full Time, Temp 2 Perm, & Contingent) in the NJ/NY/CT/PA marketplace for a wide variety of today's demanding IT skill sets. Focused on delivering exceptional service by understanding client's objectives and goals.

Apply for this position