Senior Data Engineer

Vision Service Plan
Beverly Hills, CA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$84,000 - $141,750
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Cloud Storage Continuous Integration Data Cleansing Data Integration Extract Transform Load (ETL) Data Virtualization Data Warehousing IBM InfoSphere DataStage Fault Tolerance Meta-Data Management
+27 more
Oracle Data Service Integrator Scrum Methodology Standard Sql DataOps Application Data Requirements Management SQL Databases SQL Server Integration Services Teradata SQL Informatica Powercenter Netezza Snowflake Event Driven Architecture Information Technology AWS Glue Integration Frameworks Real Time Data Apache Kafka Event Store Operational Systems Data Management Api Design Stream Processing Data Pipelines Mulesoft Confluent Amazon Redshift

Job description

The Senior Data Engineer designs, builds and optimizes data pipelines for key data and analytics capabilities in the enterprise. This position works in collaboration with analytics and data warehousing staff, DBAs and subject matter experts to create reliable processes that load targeted data with integrity and quality, enabling it for strategic use by the business.

Collaborate within an agile, multi-disciplinary team to deliver optimal data integration and transformation solutions

Analyze data requirements (functional and non-functional) to develop and design robust scalable automated, fault-tolerant data pipeline solutions for business and technology initiatives

Profile data to assess the accuracy and completeness of data sources and provide feedback in data gathering sessions

Design, build, maintain and operationalize data pipelines for high volume and complex data using appropriate tools and practices in development, test and production environments

Design with modularity to leverage reuse of code wherever possible

Develop and design data mappings, programs, routines and SQL to acquire data from legacy, web, cloud and purchased package environments into the analytics environment

Understand and apply the appropriate use of ELT, ETL, data virtualization and other methods to optimize the balance of minimal data movement against performance, and mentor others on their appropriate use

Drive automation of data pipeline preparation and integration tasks to minimize manual and error-prone processes and improve productivity using modern data preparation, integration and AI-enabled metadata management tools and techniques

Leverage auditing facilities that will enable monitoring of data quality to detect emerging issues

Deploy transformation rules to cleanse against defined rules and standards

Participate in architecture, governance and design reviews, identifying opportunities and making recommendations

Participate in health check assessments of the existing environment and evaluations of emerging technologies

Collaborate with architects to design and model application data structures, storage and integration in accordance with enterprise-wide architecture standards across legacy, web, cloud and purchased package environments

Job Specifications

Requirements

Technical/Engineering Design, Data Warehousing, Data Management, Process Development, Data Analysis, Cross-Functional, Requirements Management, Data Collection, Data Quality, Production Systems, Bachelor’s degree in computer science, data science, statistics, economics or related functional area; or equivalent experience

Excellent written and verbal communication skills with the ability to gather requirements and effectively communicate technical concepts and ideas to all levels of employees and management

6+ years’ experience working in development team providing analytical capabilities

6+ years of hands-on experience in the data space spanning data preparation, SQL, integration tools, ETL/ELT / data pipeline design

SQL coding experience

Experience working in an agile development environment (Scrum, Kanban) with a focus on Continuous Integration and Delivery

Knowledge about various data architectures, patterns and capabilities such as event-driven architecture, real-time data flows, non-relational repositories, data virtualization, cloud storage, etc.

Knowledge of and experience with multiple data integration platforms (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo), and data warehouse MPP platforms such Snowflake, Netezza, Teradata, Redshift, etc.

Familiarity with DataOps practices and their application within analytics environments as well as their ability to extend data and analytics capabilities to other operational systems and consumers

Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent) and with API development and management platforms (MuleSoft, Axway) is beneficial

Capable of focusing on a specific set of tasks while also ensuring alignment to a broader strategic design

For roles that are remote (i.e., Work From Home (WFH)) or hybrid (i.e., partial onsite at a VSP location and WFH), must demonstrate a high level of engagement in virtual environments, including maintaining camera presence during meetings to support effective communication and team alignment

Benefits & conditions

Compensation range for the role is listed below. Applicable salary ranges may differ across markets. Actual pay will be determined based on experience and other job-related factors permitted by law. As a part of the compensation package, this role may include eligible bonuses and commissions. For more information regarding VSP Vision benefits, please click here.

Salary Ranges: $84,000.00 - $141,750.00

VSP Vision is an equal opportunity employer and gives consideration for employment to qualified applicants without regard to age, gender, race, color, religion, sex, national origin, disability or protected veteran status. We maintain a drug-free workplace and perform pre-employment substance abuse testing.

Unincorporated LA County Residents: Qualified Applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act, and any other similar laws.

About the company

As a regular part of doing business, VSP Vision (β€œVSP”) collects many different types of personal information, including protected health information, about our audiences, including members, doctors, clients, brokers, business partners, and employees. VSP Vision employees will have access to this sensitive personal information and are subject to follow Information Security and Privacy Policies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…