> Markdown version of [/jobs/ext/2717501-senior-data-engineer-in-torrance](https://www.wearedevelopers.com/jobs/ext/2717501-senior-data-engineer-in-torrance). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer in Torrance - **Company:** Energy Jobline - **Location:** Torrance, CA, United States - **Experience:** Expert - **Salary:** $128,000.0 - $169,000.0 - **Contract:** Permanent contract - **Skills:** Query Performance, Java (Programming Language), Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Apache HTTP Server, Audit Trail, Automation of Tests, Microsoft Azure, Big Data, Business Systems, Cloud Computing, Cloud Computing Security, Cloud Database, Code Review, Information Systems, Databases, Continuous Integration, Data as a Services, Data Architecture, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Retention, Data Warehousing, Relational Databases, DevOps, Distributed Computing Environment, Amazon DynamoDB, Identity and Access Management, Python (Programming Language), Key Management, PostgreSQL, Machine Learning, Metadata, Meta-Data Management, MySQL, NoSQL, Operational Data Store, Operational Databases, Query Optimization, Azure Data Lake, Simple Data Format, Software Deployment, Software Engineering, SQL Databases, Data Streaming, Unstructured Data, Privacy Controls, Azure Service Bus, AWS Cdk, Data Logging, Azure Data Factory, Apache Spark, Multi-Cloud, AWS Lambda, Indexer, Git, Cloudformation, Event Driven Architecture, Microsoft Fabric, Amazon Relational Database Service, Data Lakes, Kubernetes, Infrastructure Automation Frameworks, Storage Technologies, Information Technology, Low Latency, AWS Glue, Real Time Data, Apache Kafka, Data Management, Physical Data Models, Api Design, Cloudwatch, Terraform, Azure Synapse Analytics, Software Version Control, Data Pipelines, Amazon Elastic Mapreduce (EMR), Docker, Amazon Redshift, Databricks, Microservices - **Published:** September 4, 2026 - **Apply:** https://www.energyjobline.com/job/senior-data-engineer-torrance-31476257 ## About the Role Required * Bachelor's degree in Computer Science, Software Engineering, Data Engineering, Information Systems, or a related technical field; Master's degree . * 7+ years of professional experience in data engineering, backend engineering, or large-scale data platform development, including ownership of production systems. * Deep hands-on experience designing, building, and operating data platforms on AWS. * Strong proficiency in Python, Java, and SQL, including development of production-quality, testable code. * Proven experience building and supporting ETL/ELT pipelines for large-scale structured, semi-structured, and unstructured datasets. * Strong experience with distributed data processing technologies such as Apache Spark and with orchestration frameworks such as Apache Airflow, AWS Step Functions, or AWS Managed Workflows for Apache Airflow. * Experience with relational databases and cloud data warehouses such as PostgreSQL, MySQL, Amazon Aurora, Amazon Redshift, or equivalent platforms. * Experience with NoSQL and event-oriented technologies such as DynamoDB, document databases, time-series databases, Kafka, Amazon MSK, or Amazon Kinesis. * Strong understanding of data modeling, schema evolution, partitioning, columnar file formats, data lake design, metadata management, and query optimization. * Experience implementing data quality, monitoring, logging, alerting, lineage, and operational support for production data pipelines. * Experience with Git, automated testing, CI/CD, containers, and infrastructure as code. * Strong understanding of cloud security, IAM, encryption, network controls, data privacy, and secure handling of sensitive information. * Demonstrated ability to solve complex technical problems, communicate clearly with technical and business stakeholders, and deliver in a fast-paced, collaborative environment. * Legal authorization to work in the U.S. without sponsorship. * Experience with Microsoft Azure data services, such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Event Hubs, or Microsoft Fabric. * Experience designing multi-cloud or cloud-portable data architectures. * Experience with Databricks, Delta Lake, Apache Iceberg, Apache Hudi, or other lakehouse technologies. * Experience with geospatial, telematics, IoT, connected vehicle, camera, or high-frequency sensor data. * Experience supporting machine learning platforms, feature stores, model training pipelines, or real-time model scoring. * Familiarity with API design, microservices, event-driven architecture, and data contracts. * Experience with Kubernetes, Docker, and cloud- application deployment. * Knowledge of data governance, cataloging, master data management, and regulatory or insurance data environments. * AWS professional or specialty certification, or equivalent cloud/data engineering certification. * Experience mentoring engineers and leading technical design or architecture reviews. ## Description The Senior Data Engineer reports to the VP of Engineering and is responsible for designing, building, and operating the scalable data foundation that powers MOTER's connected vehicle, insurance, risk analytics, and customer-facing products. The Senior Data Engineer will lead the development of cloud- data platforms and pipelines that ingest, process, store, govern, and serve high-volume structured, semi-structured, and unstructured data from vehicles, telematics devices, cameras, APIs, business systems, and external data providers. The Senior Data Engineer will bring deep expertise in Amazon Web Services (AWS), large-scale distributed data processing, data lake and warehouse architecture, and production software engineering using Python, Java, and SQL. The Senior Data Engineer will collaborate closely with data science, application engineering, edge systems, product, security, and business teams to deliver reliable, secure, observable, and cost-efficient data products. The Senior Data Engineer will provide strong technical ownership and architectural judgment across data engineering initiatives and will help establish scalable, maintainable engineering practices. The role will also mentor other engineers and translate complex business, product, and analytical requirements into well-designed, maintainable production solutions. Essential Functions * Data Platform Architecture: Design and evolve scalable, cloud- data architectures on AWS, including data lakes, lakehouses, data warehouses, operational data stores, and analytical serving layers. * Data Pipeline Engineering: Build and maintain reliable batch, micro-batch, and real-time data ingestion and transformation pipelines for high-volume vehicles, telematics, sensor, image/video metadata, insurance, and business data. * AWS Engineering: Implement and optimize solutions using services such as Amazon S3, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, AWS Lambda, Amazon Kinesis, Amazon MSK, Amazon RDS/Aurora, DynamoDB, Step Functions, ECS/EKS, Lake Formation, IAM, and CloudWatch, selecting services based on scalability, latency, security, reliability, and cost requirements. * Large-Scale Processing: Develop and optimize distributed processing workloads using Apache Spark and related big-data technologies; improve partitioning, file formats, query performance, cluster utilization, and compute cost. * Structured and Unstructured Data: Design storage and access patterns for relational, NoSQL, time-series, geospatial, document, event-stream, and unstructured data, including schemas, metadata, indexing, cataloging, and lifecycle policies. * Data Modeling: Create and maintain conceptual, logical, and physical data models for analytical and operational use cases, including dimensional, normalized, denormalized, and event-driven models. * Software Engineering: Develop reusable, testable, and production-quality data services, libraries, APIs, and automation using Python, Java, and SQL, while applying standards for code review, version control, testing, and documentation and maintainability. * Data Quality and Observability: Implement automated data validation, reconciliation, lineage, monitoring, alerting, and incident-response practices to ensure data completeness, accuracy, timeliness, and reliability. * Security and Governance: Partner with security and compliance teams to implement least-privilege access, encryption, secrets management, auditability, data retention, privacy controls, and appropriate handling of sensitive and regulated data. * DevOps and Infrastructure as Code: Build and support CI/CD pipelines and infrastructure automation using tools such as Terraform, AWS CloudFormation, or AWS CDK, enabling repeatable and reliable deployments across development, test, and production environments. * Performance and Cost Optimization: Evaluate and optimize pipeline performance, storage design, cloud consumption, and service utilization, implementing improvements that increase throughput, reliability, and efficiency while controlling AWS cost. * Data Science Enablement: Develop and provide curated, trusted, and well-documented datasets and feature-ready pipelines that support machine learning, model development, experimentation, production scoring, and post-deployment monitoring. * Cross-Functional Collaboration: Collaborate with product managers, software engineers, data scientists, analysts, and business stakeholders to define data contracts, service-level expectations, technical roadmaps, and delivery plans. * Technical Leadership: Lead technical and design reviews, establish data engineering standards and best practices, mentor engineers, and provide technical guidance for complex implementation and production-support issues. * Improvement: Evaluate emerging cloud, database, streaming, and data platform technologies and recommend practical improvements to MOTER's architecture and engineering practices. * Perform other duties and responsibilities as assigned. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Branch your database like your code: How schema changes and pull requests go hand in hand](https://www.wearedevelopers.com/videos/350-branch-your-database-like-your-code-how-schema-changes-and-pull-requests-go-hand-in-hand) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)