Big Data Engineer

TP-Link Systems Inc.
Irvine, CA, United States
9 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$100,000.0 - $160,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Amazon Web Services Amazon S3 Big Data Information Systems Extract Transform Load (ETL) Data Warehousing Database Development Software Debugging Linux Dimensional Modeling
+25 more
Apache Hadoop Apache Hive Identity and Access Management Python (Programming Language) Online Analytical Processing Online Transaction Processing Query Optimization SQL Databases Sqoop Data Streaming Parquet Data Logging Data Ingestion Apache Spark Boto3 Git Build Management Pyspark Debezium Information Technology Data Lineage Apache Flink Apache Kafka Spark Streaming Vertica

Job description

  • Own a component of the data platform end to end - its pipelines, tables, quality checks, monitoring, and recovery.
  • Design and build ETL on EMR (Spark) and Airflow, and data ingestion from OLTP sources via DataX / CDC, including incremental sync and upstream schema changes.
  • Model the data for your area: dimensional models and layering (ODS / DWD / DWS / ADS) that serve real analytical use cases.
  • Own data quality for your component - write the checks and freshness monitoring, and resolve issues before they reach downstream users.
  • Tune runtime and infrastructure cost for the jobs you own, and choose the right engine for a workload (StarRocks serving vs. batch on EMR).
  • Build components other engineers can reuse, and automate work that would otherwise repeat.
  • Work directly with analysts and business stakeholders to turn requirements into models and datasets that actually get used.

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.
  • 2+ years of hands-on data development in a production environment - scheduled pipelines with real downstream consumers.
  • Experience owning a pipeline or component in production: you were the person accountable for it, including when it broke.
  • Strong SQL: window functions, complex multi-table joins, incremental and idempotent writes; able to read an execution plan and diagnose data skew or slow queries.
  • Production-grade Python: maintainable, testable ETL and tooling code (PySpark / pandas / boto3) with proper error handling and logging.
  • Hands-on with Spark on EMR, or equivalent Hadoop / Hive experience, including partitioning, shuffle, and memory tuning.
  • Production experience with Airflow: DAG design, dependencies, retries, idempotent reruns, backfills, and SLA alerting.
  • Experience with a data ingestion or CDC tool in production (DataX, Sqoop, Debezium, or similar): extracting from OLTP sources, incremental sync, and handling upstream schema changes.
  • Experience with an OLAP engine - StarRocks, Doris, or ClickHouse: table models, partitioning and bucketing, materialized views, and query tuning.
  • Solid grasp of data warehouse modeling: dimensional modeling, slowly changing dimensions, and layering conventions.
  • Comfortable on AWS (S3 with Parquet / ORC and sensible partitioning, IAM basics, day-to-day EMR operations), Linux, and Git.
  • Comfortable picking up new tools as the platform evolves - we’d rather hire someone who learns a new engine quickly than someone who has only ever used ours.
  • Effective use of AI to solve data problems - using it to move faster on SQL, debugging, and unfamiliar schemas, with the judgment to catch output that looks right but isn’t., * AWS cost optimization: EMR instance sizing and Spot strategy, S3 lifecycle policies, StarRocks vs. Athena trade-offs.
  • Lakehouse table formats: Iceberg, Hudi, or Delta.
  • Streaming: Kafka with Flink or Spark Structured Streaming.
  • dbt, Glue Data Catalog, data lineage, or a data quality framework.
  • QuickSight dataset, SPICE, and row-level permission design.

Benefits & conditions

Salary range: TBD

  • Free snacks and drinks
  • Fully paid medical, dental, and vision insurance (partial coverage for dependents)
  • Contributions to 401K funds
  • Bi-annual reviews, and annual pay increases
  • Health and wellness benefits, including free gym membership
  • Quarterly team-building events

At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc.

Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.

About the company

Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.

We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.

Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:12 min

Validating risky service requests safely via dry runs

Modood Alvi · World Congress 2025

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

7:27 min

How Git architecture fundamentally exposes historical code secrets

Dwayne Mcdaniel · LIVE

Videos

See all

Related articles

See all