Staff AI Data Engineer
CR FITNESS CAPE CORAL, LLC
Cleveland, United States of America
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 145KJob location
Cleveland, United States of America
Tech stack
Artificial Intelligence
Big Data
Cloud Database
Computer Programming
Databases
Continuous Delivery
Continuous Integration
Data Validation
Information Engineering
ETL
Data Warehousing
Hadoop
Python
Machine Learning
NoSQL
Object-Oriented Software Development
Software Engineering
SQL Databases
Data Streaming
Azure
Spark
Containerization
Kubernetes
Amazon Web Services (AWS)
Integration Frameworks
Kafka
Apache Nifi
Data Management
Machine Learning Operations
Data Pipelines
Apache Beam
Docker
Job description
Mid-level engineer who designs and maintains scalable data pipelines, ETL processes and data platforms to support AI/ML workloads, integrating vector stores and ensuring data quality and compliance., * Implement and maintain scalable batch and streaming data pipelines to ingest, transform and serve data for AI/ML workloads; work with senior engineers and architects on designing pipelines and processes.
- Develop ETL/ELT processes using Python and SQL to prepare training, test, and production datasets and feature stores. Experience with big data technologies (Spark, Hadoop) and flow tools (Kafka, NiFi) is a plus but not required.
- Build and maintain data warehouses and lakes; integrate with vector stores to support retrieval-augmented generation (RAG) systems. aPartner with more senior engineers to collaborate with AI Data Engineering, IT Data Engineering, Infrastructure, AI Engineering, Security and Business Leaders to deliver features for model training and inference
- Implement data validation and quality checks with validation from more senior engineers; maintain documentation of data flows and schemas.
- Work with more senior engineers to ensure pipelines meet data quality, observability, security and regulatory compliance standards.
- Work with Model Context Protocol (MCP) to integrate into data pipelines and make modifications to existing MCP connections with guidance from more senior engineers.
Requirements
- At least two (2) years' experience working in a Data Engineering, Data Science, Software Development or other relevant role.
- Professional experience with programming in either Python or an object-oriented programming language.
- Strong knowledge of relational and NoSQL-based databases, with significant proficiency in SQL.
- Understanding of ETL processes and data modeling concepts.
- Exposure to data processing frameworks and tools (examples are but not all required as Apache Spark, Kafka, dlt, dbt), and cloud data services (AWS Glue, Azure Data Factory, GCP Dataflow). Experience with one or more of these tools or services is a plus but not required.
- Knowledge of data warehousing, lakehouse architectures, and data modeling concepts. Experience with ML tools such as pytorch is a plus.
- Understanding of machine-learning workflows and ability to build feature stores for AI models.
- Exposure to containerization (Docker), Kubernetes and continuous integration/continuous deployment (CI/CD). Experience is a plus but not required.
- General understanding of AI/ML concepts with the ability and willingness to learn more.
- Ability to collaborate with team leadership and Data Engineering, Infrastructure, AI Engineering, Security and Business peers.
- Strong problem-solving, communication and teamwork skills.