Senior Data Engineer

TalTeam Inc

Santa Monica, CA, United States

3 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

4 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Unity 3d Airflow Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Code Review Continuous Integration Data Validation Data Governance Data Integrity Extract Transform Load (ETL) Software Design Patterns

+16 more

DevOps Distributed Computing Environment Github Apache Hive Identity and Access Management JSON Performance Tuning SQL Databases Parquet Data Logging Data Ingestion Snowflake Data Lakes Pyspark Data Pipelines Databricks

Job description

Assist in building and maintaining ETL/ELT pipelines for acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog under the guidance of senior engineers.
Support the migration of existing Snowflake SQL scripts and transformations into Databricks UC by updating queries, validating outputs, and helping implement governance best practices.
Contribute to developing ingestion processes for marketing vendor data, including data parsing, normalization, and basic quality validations.
Implement and maintain foundational data quality checks, monitoring alerts, and issue triage workflows using Databricks, Snowflake, Airflow, and internal tooling.
Partner with the Data Reliability Engineering team to assist with SLA monitoring, simple incident troubleshooting, and logging improvements.
Collaborate with analytics and marketing partners to understand data requirements and ensure accuracy of datasets used in dashboards and reporting.
Support performance tuning, logging improvements, and general pipeline reliability work.
Participate in engineering best practices, including code reviews, documentation, and contributing to shared frameworks and tools.

Requirements

4+ years of experience as a Data Engineer or similar role.
Strong proficiency in SQL (analytical SQL, complex joins, window functions).
Hands-on experience with PySpark and/or Spark SQL in production.
Good understanding of data modeling, ETL/ELT design patterns, and distributed data processing.
Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and Lakehouse patterns.
Experience in AWS (S3, IAM, EC2, Glue, Lambda, or related services).
Experience with Airflow or similar orchestration tools.
Experience building robust ingestion pipelines and working with semistructured formats (JSON, Parquet, CSV).
Experience with Git/GitHub, CI/CD, and modern DevOps practices.
Excellent communication skills and ability to work with crossfunctional partners.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Prepare application

Good distractions

Loading talks and stories from around this role…