> Markdown version of [/jobs/ext/4789407-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/4789407-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Tech3pillars Technologies - **Location:** Los Angeles, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Big Data, Databases, Data Validation, Information Engineering, Data Files, Extract Transform Load (ETL), Data Security, Data Warehousing, Apache Hive, Python (Programming Language), Systems Development Life Cycle, SQL Databases, Data Processing, Scripting, Cloud Platform System, Data Ingestion, Apache Spark, Data Lakes, Pyspark, Data Management, Data Pipelines, Databricks - **Published:** November 19, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-data-engineer-ca--7f1f5abb-6156-4891-9d75-e336f85d0ba8 ## About the Role Apache Spark, Data Management, Scalable System Development, Data Sets, Data Processing, Database Extract Transform and Load (ETL), Production Management, Python Programming/Scripting Language, SQL (Structured Query Language), Identify Issues ## Description We are seeking a highly skilled Senior Databricks Data Engineer with 8+ years of experience in data engineering and strong hands-on expertise in Databricks. The ideal candidate must have proven production experience designing, developing, and maintaining scalable data pipelines using Databricks, Apache Spark, PySpark, and Delta Lake. The candidate should have extensive experience building end-to-end ETL/ELT pipelines, working with large-scale datasets, optimizing data processing workflows, and managing production-grade Databricks Jobs and Workflows. Note: Hands-on production experience with Databricks is mandatory. General Apache Spark experience without actual Databricks implementation experience will not be considered., * Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. * Build and optimize ETL/ELT workflows using Python, PySpark, and Spark SQL. * Develop, manage, and optimize Delta Lake tables and Delta architectures. * Create, schedule, monitor, and troubleshoot Databricks Jobs and Workflows. * Implement data ingestion, transformation, and processing solutions for large-scale datasets. * Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency. * Work with data lakes, data warehouses, and cloud-based data platforms. * Implement data quality checks, validation, and error-handling mechanisms. * Collaborate with data architects, analysts, and cross-functional teams to understand business requirements. * Troubleshoot production issues and ensure reliability and performance of data pipelines. * Follow best practices for data security, governance, and pipeline optimization.