Sr. Data Engineer

Insight Global
Santa Monica, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Big Data Software Quality Computer Engineering Data Architecture Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Security Data Warehousing Relational Databases
+15 more
Python (Programming Language) PostgreSQL Microsoft SQL Server MySQL SQL Databases Unstructured Data Delivery Pipeline Snowflake Apache Spark Reliability of Systems Pyspark Information Technology Integration Frameworks Terraform Data Pipelines

Job description

A client is seeking a Senior Data Engineer to join their growing Data Engineering team! This person will will play a key role in shaping both

customer-facing and business-facing data products that align with their mission. Your

technical expertise and analytical acumen will contribute to designing and building

extensive data sets that impact thousands of internal users and millions of members.

Join a world-class data engineering team dedicated to advancing your skills and career

in data engineering and beyond.

Essential Functions:

-Collaborate with engineers, product managers, and data scientists to

understand data needs and develop end-to-end data pipelines, solutions, and

foundational data sets

-Design and own the data architecture for large-scale projects, making informed

decisions about design and operational trade-offs

-Build, launch, and optimize sophisticated data pipelines, data models, and

visualizations that support diverse use cases across multiple products or

domains

-Define and manage Service Level Agreements (SLAs) for all data sets within

areas of ownership

-Implement data security models based on privacy requirements, ensure

compliance with safeguards, address data quality issues, and evolve data

governance processes

-Solve complex data integration challenges using optimal ETL/ELT patterns,

frameworks, and query techniques for both structured and unstructured data

sources

-Maintain and enhance existing production processes by optimizing complex

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, or a relevant

technical field; a master’s degree is preferred

  • 5+ years of experience in data engineering, database engineering, business

intelligence, data warehousing, and ETL tools, working with large data sets in

the cloud

  • 5+ years of experience with Python, and experience building scalable Big Data

solutions and ETL ecosystems

  • Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in

Snowflake and dbt

  • Hands-on experience with RDBMS such as MySQL, MS SQL Server, and

Postgres

  • Familiarity with integration tools like Airflow and Automic, along with a working

knowledge of CI/CD pipelines

  • Ability to deliver high standards of code quality, system reliability, and

performance

  • Experience with Spark and PySpark to handle large-scale data processing and

enhance data pipeline efficiency

  • Strong proficiency in Terraform is a must-have - Masters degree

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all