Senior Data Engineer
Tech3pillars Technologies
Irvine, CA, United States
8 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Code Generation
Software Quality
Databases
Information Engineering
Extract Transform Load (ETL)
Data Systems
Distributed Computing Environment
Github
Systems Development Life Cycle
Data Processing
Data Ingestion
+10 more
GitHub Copilot
Claude Code
Apache Spark
AI Coding Agents
Agentic-AI
Data Lakes
Pyspark
Data Management
Data Pipelines
Databricks
Job description
Work Mode: Day 1 Onsite 3 Days per Week at Client Office Important: Billing starts once the candidate joins at the client office. Must-Have Technical Skills
- Databricks: Strong hands-on production experience with Databricks.
- Apache Spark: Spark, PySpark, distributed data processing.
- Delta Lake: Delta Tables, Data Management, Data Optimization.
- Data Pipelines: Design, develop, and maintain production-grade data pipelines.
- Databricks Workflows: Jobs, Workflows, Scheduling, Monitoring, and Troubleshooting.
- Data Engineering: Data Ingestion, Transformation, ETL/ELT, and Pipeline Optimization., * Build and maintain production-grade data pipelines using Databricks.
- Develop scalable data processing solutions using Spark and PySpark.
- Work with Delta Tables, Databricks Jobs, and Workflows.
- Optimize pipeline performance and troubleshoot production issues.
- Leverage AI coding agents to improve development productivity and code quality.
- Collaborate with engineering teams to deliver reliable data solutions.
Requirements
Billing, Apache Spark, Data Processing, Data Management, Database Extract Transform and Load (ETL), Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Productivity Management, GitHub, Scalable System Development, Candidates must demonstrate practical experience using AI coding agents and measurable productivity improvements.
- Experience with Claude Code, GitHub Copilot, or similar AI coding tools.
- Writing context files, specifications, and instructions for AI agents.
- Setting up repositories with agent-friendly documentation and coding conventions.
- Reviewing AI-generated code for correctness, security, and performance.
- Building or reusing AI prompts, skills, and development workflows.
- Demonstrating measurable productivity improvements through AI-assisted development.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦