Sr Full Stack Data Engineer

Insight Global
Los Angeles, CA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Warehousing Software Debugging Python (Programming Language) Machine Learning Performance Tuning Standard Sql SQL Databases Large Language Models
+7 more
Snowflake Apache Spark Pyspark Apache Flink Video Streaming Data Pipelines Databricks

Job description

Insight Global is seeking a Senior Data Engineer (Full Stack Data Engineer) for a top media and entertainment client. This individual will join a highly visible data engineering team supporting critical analytics and AI initiatives used at the SVP and President level. The role is heavily hands-on, focused on building and scaling batch ETL pipelines using Databricks, Spark, SQL, and Python. The ideal candidate is technically deep, thrives in complex data environments, and enjoys mentoring junior engineers while working closely with data science teams to enable advanced analytics and machine learning use cases.

Day-to-Day:

Build and maintain batch ETL pipelines in Databricks

Develop new data pipelines (net-new development, not just maintenance)

Write complex, high-performance SQL queries

Perform data modeling to support analytics and data science use cases

Ensure data quality, governance, and observability

Integrate and manage complex datasets from multiple sources (TV, digital, ad sales)

Partner closely with Data Science and AI teams

Mentor and support early-career and junior engineers

Collaborate with stakeholders across multiple time zones

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

Senior-level data engineering experience (6-7 YOE)

Strong SQL and data warehousing expertise

Hands-on ETL pipeline design and development

Solid data modeling skills (normalized, denormalized, OBT schemas)

Spark theoretical knowledge (PySpark hands-on is a plus)

Experience working with Databricks

Strong problem-solving and debugging skills

Ability to collaborate across time zones (LA, NY, Bangalore)

Mentorship mindset; comfortable supporting junior engineers Spark performance tuning experience

Snowflake experience

Exposure to AI/ML data pipelines (e.g., LLMs, LangChain, LangGraph)

Streaming technologies (e.g., Apache Flink - future phase)

Media & entertainment industry experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:46 min

Transforming data architecture from on-premise to cloud

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all