> Markdown version of [/jobs/ext/4669945-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/4669945-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Tech3pillars Technologies - **Location:** Irvine, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Code Generation, Software Quality, Databases, Information Engineering, Extract Transform Load (ETL), Data Systems, Distributed Computing Environment, Github, Systems Development Life Cycle, Data Processing, Data Ingestion, GitHub Copilot, Claude Code, Apache Spark, AI Coding Agents, Agentic-AI, Data Lakes, Pyspark, Data Management, Data Pipelines, Databricks - **Published:** November 11, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-data-engineer-irvine-ca--9fa56b10-5676-43e4-959a-89aea297c96b ## About the Role Billing, Apache Spark, Data Processing, Data Management, Database Extract Transform and Load (ETL), Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Productivity Management, GitHub, Scalable System Development, Candidates must demonstrate practical experience using AI coding agents and measurable productivity improvements. * Experience with Claude Code, GitHub Copilot, or similar AI coding tools. * Writing context files, specifications, and instructions for AI agents. * Setting up repositories with agent-friendly documentation and coding conventions. * Reviewing AI-generated code for correctness, security, and performance. * Building or reusing AI prompts, skills, and development workflows. * Demonstrating measurable productivity improvements through AI-assisted development. ## Description Work Mode: Day 1 Onsite 3 Days per Week at Client Office Important: Billing starts once the candidate joins at the client office. Must-Have Technical Skills * Databricks: Strong hands-on production experience with Databricks. * Apache Spark: Spark, PySpark, distributed data processing. * Delta Lake: Delta Tables, Data Management, Data Optimization. * Data Pipelines: Design, develop, and maintain production-grade data pipelines. * Databricks Workflows: Jobs, Workflows, Scheduling, Monitoring, and Troubleshooting. * Data Engineering: Data Ingestion, Transformation, ETL/ELT, and Pipeline Optimization., * Build and maintain production-grade data pipelines using Databricks. * Develop scalable data processing solutions using Spark and PySpark. * Work with Delta Tables, Databricks Jobs, and Workflows. * Optimize pipeline performance and troubleshoot production issues. * Leverage AI coding agents to improve development productivity and code quality. * Collaborate with engineering teams to deliver reliable data solutions.