Senior Data Engineer

Tech3pillars Technologies
Irvine, CA, United States
8 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Code Generation Software Quality Databases Information Engineering Extract Transform Load (ETL) Data Systems Distributed Computing Environment Github Systems Development Life Cycle Data Processing Data Ingestion
+10 more
GitHub Copilot Claude Code Apache Spark AI Coding Agents Agentic-AI Data Lakes Pyspark Data Management Data Pipelines Databricks

Job description

Work Mode: Day 1 Onsite 3 Days per Week at Client Office Important: Billing starts once the candidate joins at the client office. Must-Have Technical Skills

  • Databricks: Strong hands-on production experience with Databricks.
  • Apache Spark: Spark, PySpark, distributed data processing.
  • Delta Lake: Delta Tables, Data Management, Data Optimization.
  • Data Pipelines: Design, develop, and maintain production-grade data pipelines.
  • Databricks Workflows: Jobs, Workflows, Scheduling, Monitoring, and Troubleshooting.
  • Data Engineering: Data Ingestion, Transformation, ETL/ELT, and Pipeline Optimization., * Build and maintain production-grade data pipelines using Databricks.
  • Develop scalable data processing solutions using Spark and PySpark.
  • Work with Delta Tables, Databricks Jobs, and Workflows.
  • Optimize pipeline performance and troubleshoot production issues.
  • Leverage AI coding agents to improve development productivity and code quality.
  • Collaborate with engineering teams to deliver reliable data solutions.

Requirements

Billing, Apache Spark, Data Processing, Data Management, Database Extract Transform and Load (ETL), Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Productivity Management, GitHub, Scalable System Development, Candidates must demonstrate practical experience using AI coding agents and measurable productivity improvements.

  • Experience with Claude Code, GitHub Copilot, or similar AI coding tools.
  • Writing context files, specifications, and instructions for AI agents.
  • Setting up repositories with agent-friendly documentation and coding conventions.
  • Reviewing AI-generated code for correctness, security, and performance.
  • Building or reusing AI prompts, skills, and development workflows.
  • Demonstrating measurable productivity improvements through AI-assisted development.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…