Data Engineer with AI background

Techgene Solutions LLC
Pasadena, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Pasadena, United States of America

Tech stack

API
Artificial Intelligence
Cloud Database
Code Review
Computer Programming
Data Cleansing
Information Engineering
Data Integration
ETL
Data Systems
Data Warehousing
Dimensional Modeling
Distributed Computing Environment
Hive
Python
Machine Learning
Performance Tuning
Scrum
Power BI
Software Engineering
Tableau
Enterprise Software Applications
Feature Engineering
Spark
Data Lake
Information Technology
Data Analytics
Data Management
Looker Analytics
Data Pipelines
Databricks

Job description

Client is seeking a Senior Data Engineer with a strong AI/ML background to design, develop, and optimize scalable data pipelines and AI-enabled data solutions. The ideal candidate will have deep expertise in Python, Databricks, cloud-based data engineering, and BI reporting tools, along with experience supporting analytics and machine learning initiatives in an enterprise environment.

This role requires a hands-on engineer who can work closely with data scientists, analysts, and business stakeholders to build robust data platforms and enable advanced analytics and AI use cases., * Design, build, and maintain scalable ETL/ELT pipelines using Python and Databricks.

  • Develop and optimize data workflows within the Databricks architecture (Delta Lake, Spark, notebooks, jobs, clusters, and workspace management).
  • Support AI/ML initiatives by preparing high-quality datasets for model training, validation, and deployment.
  • Collaborate with data scientists and analytics teams to operationalize machine learning solutions.
  • Create and maintain BI dashboards and reports using Power BI, Tableau, and Looker.
  • Implement data quality, governance, and performance optimization best practices.
  • Work in an Agile/Scrum environment and participate in sprint planning, code reviews, and release activities.
  • Troubleshoot production issues and provide ongoing support for data and analytics platforms.

Requirements

  • 9+ years of relevant industry experience in Data Engineering / Software Development (excluding training period).
  • Minimum 2 years of onsite experience working in a similar technology and domain environment.
  • Bachelor's degree in Technology, Computer Science, Engineering, or a related field.
  • Strong programming experience with Python.
  • Hands-on experience as a Data Engineer building enterprise-scale data pipelines.
  • Deep understanding of Databricks architecture and Apache Spark.
  • Experience with Delta Lake, Spark SQL, and distributed data processing.
  • Strong knowledge of data warehousing and dimensional modeling.
  • Experience integrating data from multiple enterprise systems and APIs.

Must-Have Skills

  • Python Programming
  • Databricks (Architecture, Spark, Delta Lake)
  • AI/ML background (data preparation, feature engineering, model support)
  • Power BI
  • Tableau
  • Looker

Apply for this position