Senior Data Engineer

EOS Inc.
Burlingame, CA, United States
24 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$135,000 - $150,000
Working hours
Regular working hours
Job source

Tech stack

Query Performance Application Programming Interfaces (APIs) Artificial Intelligence Airflow Software Bug Management Computer Programming Continuous Integration Data as a Services Directed Acyclic Graph (Directed Graphs) Data Architecture Information Engineering Data Files
+18 more
Extract Transform Load (ETL) Data Recovery Data Structures Data Systems Data Warehousing Python (Programming Language) PostgreSQL Oracle (Applications) Performance Tuning Runbook SQL Databases Systems Integration User Provisioning Software Data Ingestion Sql Optimization Information Technology Software Version Control Amazon Redshift

Job description

  • Design, implement and operate large-scale, centralized high-volume, high-performance data structures for analytics and data science.
  • Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes.
  • Work with Project Manager to understand business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture.
  • Assist SWE team with identifying in code key events and data to be logged to populate the data structures used for dashboarding.
  • Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
  • Onboard new datasets end to end: requirements, access provisioning, packaging and CI/CD configuration, partition/snapshot validation, go-live checks.
  • Own recurring batch jobs - monitoring, triage, test plans, and partition recovery - including backfills via notebooks and SQL.
  • Build and maintain flow/funnel, quality-check, and operations-health dashboards in the team’s BI platform; maintain internal web tools (bug fixes, duplicate-record cleanup, prod/test tagging).
  • Author and maintain runbooks, end-to-end documentation, release notes, and user guides; keep them current with a scheduled audit cadence.

Requirements

As a Senior Data Engineer, you will lead data engineering initiatives and build end-to-end scalable, stable, and secure analytical solutions. You are passionate about working with huge datasets and have experience with the organization and curation of data for analytics. You have a strategic and long term view on architecting advanced data eco systems. You are experienced in building efficient and scalable data services and have the ability to integrate data systems. In this assignment you will support the RL Data Engineering team (Burlingame, CA + vendor office as applicable), backfilling production ownership of demo, yield/funnel, and asset-tracking pipelines - onboarding new datasets, keeping recurring batch jobs and dashboards healthy, and making onboarding repeatable through documentation and automation., * Degree in Computer Science, Engineering, Mathematics, or a related field or 7+ years industry experience.

  • Demonstrated strength in data modelling, ETL development, and data warehousing experience with Oracle, Redshift, PostgreSQL, etc.
  • Advanced SQL and query performance tuning skills.
  • Experience building data products incrementally and integrating and managing data sets from multiple sources.
  • Coding proficiency in Python programming language.
  • Experience with scheduled batch orchestration (e.g. Airflow or equivalent) and partitioned lake/warehouse tables.
  • Experience with CI/CD, version control, and task tracking; ability to own production issues and write clear runbooks.
  • Experience building operational dashboards and reporting on delivery KPIs (freshness, completeness, on-time delivery, accuracy).
  • Exceptional communication and stakeholder management skills; self-motivated in an autonomous, fast-paced environment.
  • Ability to work on-site in Burlingame, CA per assignment, * Hardware / field data collection, demographic data, or yield/funnel analytics.
  • Flow/funnel visualizations, asset-tracking DAGs, or lineage tooling.
  • Internal tooling, form builders, or AI-assistant guides for onboarding automation.
  • Capture-management systems, search APIs, or permission models.

About the company

EOS IT Solutions is a Global Technology and Logistics company, providing Collaboration and Business IT Support services to some of the world’s largest industry leaders, delivering forward-thinking solutions based on multi-domain architecture. Customer satisfaction and commitment to superior quality of service are our top business priorities, along with investing in and supporting our partners and employees.

We are a true International IT provider and are proud to deliver our services through global simplicity with trusted transparency.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…