Data Engineer
THE LINKS AT DARDENNE, INC.
Bedminster, United States of America
2 months ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Bedminster, United States of America
Tech stack
Java
API
Airflow
Amazon Web Services (AWS)
Azure
Databases
Continuous Integration
Data Architecture
Data Governance
ETL
Data Vault Modeling
Data Warehousing
Database Design
Document Management Systems
Python
Message Broker
MongoDB
Online Analytical Processing
NoSQL
Online Transaction Processing
Oracle Applications
RabbitMQ
Red Hat Enterprise Linux - RHEL
Ansible
DataOps
Scala
Simple Object Access Protocol (SOAP)
Software Engineering
Systems Architecture
Rust
Spark
Kubernetes
Information Technology
Kafka
GraphQL
Puppet
Data Pipelines
Docker
Jenkins
Databricks
Programming Languages
Job description
- Build high performance data systems including databases, APIs, and data integration pipelines.
- Implement a metadata-driven architecture and infrastructure as code approach to automate and simplify the design, deployment, and management of data systems.
- Facilitate the adoption of data and software engineering best practices, including code review, testing, and continuous integration and delivery (CI/CD).
- Develop and establish a data governance framework.
- Continuous monitoring of process performance and implement improvements for efficiency including fine-tuning existing ETL processes, optimizing queries, or refactoring code.
- Assess and make optimal use of cloud platforms and technologies, especially Azure and Databricks to enhance system architecture.
- Implement data quality checks and build processes to identify and resolve data issues.
- Create and maintain documentation for data architecture, standards, and best practices.
- Contribute designs, code, tooling, testing, and operational support.
- Identify opportunities for process optimization and automation to enhance data operations efficiency.
Requirements
- 7 plus years of experience working as a Data Engineer, Data Architect, Database Developer or similar roles.
- Bachelor's Degree in Computer Science, Data Science, Engineering or related field.
- 7+ years of experience in programming languages such as Python, Scala, Java, Rust or similar.
- 7+ years of experience in Oracle OLTP database design and development.
- 7+ years of experience in building ETL / ELT data pipelines using Apache Spark, Airflow, dbt or similar.
- 7 years of experience in developing APIs that include REST, SOAP, RPC, GraphQL or similar.
- 7 years of experience in OLAP / data warehouse design and development using dimensional (Kimball star-schema), data vault or Inmon methodologies.
- 5 years of experience in NoSQL database design and development preferably on MongoDB or similar.
- 5 years of experience working with message broker platforms like RabbitMQ, Apache Kafka, Red Hat AMQ or similar.
- 5 years of experience working with Azure or AWS cloud-native technologies / services.
- Working knowledge of CI/CD automation tools or services like Jenkins, Ansible, Chef, Puppet or similar.
- Working knowledge of containerized platform or services like Docker, Kubernetes or similar.
#RecruitPS, Over 20 years' of recruiting experience with hands-on recruiting and placement of I.T. professionals (Full Time, Temp 2 Perm, & Contingent) in the NJ/NY/CT/PA marketplace for a wide variety of today's demanding IT skill sets. Focused on delivering exceptional service by understanding client's objectives and goals.