Data Engineer

VDart, Inc.
Princeton, NJ, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Data Analysis Business Logic Microsoft Azure Databases Data Conversion Data Files Data Infrastructure Extract Transform Load (ETL) Data Transformation
+29 more
Data Warehousing Relational Databases Software Design Patterns Document-Oriented Databases Amazon DynamoDB Elasticsearch Python (Programming Language) Microsoft SQL Server MongoDB NoSQL Oracle (Applications) Standard Sql Requirements Management Amazon Simple Notification Service (SNS) SQL Databases SQL Server Integration Services Data Streaming Talend Cloud Platform System Snowflake Apache Spark Amazon Relational Database Service Information Technology Cassandra AWS Data Analytics Vertica Data Delivery Cloudwatch Sql Tuning

Job description

We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects in a dynamic environment.

Responsibilities

Analyze and interpret complex data sets. Ability to identify data anomalies and resolve data issues

Understand specific business processes and domain concepts and relate them to data subject domains

Collaborate with Data Leads, Data Analysts and QA analysts to validate requirements, participate in user requirement sessions

Perform tests and validate data flows and prepare ETL processes according to business requirements

Perform ETL tuning and SQL tuning

Ability to document data flows representing business logic in ETL routines

Design and implement data conversion strategy from legacy to new platforms

Perform design validation, reconciliation, and error handling in data load processes

Design and prepare technical specifications and guidelines including ER diagrams and related documents Qualifications

Requirements

Data Analysis, Database Architecture, Analysis Skills, Data Sets, Problem Solving Skills, Business Processes, Quality Assurance, Requirements Validation/Verification, Requirements Management, Database Extract Transform and Load (ETL), Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms

Knowledge of AWS Infrastructure including S3, SNS, Ec2, CloudWatch and RDS

8-9 years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS

8+ years working in business intelligence, data warehousing initiatives

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or Ms Sql Server or Vertica.

Good to have at least 1+ years working with Matillion ELT tool and Snowflake Database

Good to have experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).

Good to have - Experience with any of the NoSQL datastores such as ElasticSearch, MongoDB, DynamoDB, Cassandra, Bachelor’s in mathematics, Computer Science or related technical field. Post graduate degree preferred. Minimum 7+ years of relevant experience.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…