AI Data Engineer

• Design, develop, and optimize advanced Python applications fordata and AI use cases.
• Build and integrate OpenAI-based solutions (LLMs, promptengineering, APIs, embeddings).
• Develop and maintain ETL/datapipelines for large-scale data processing.
• Implement workflow orchestration using Apache Airflow.
• Work with AWS services, including Helix (internal platforms if applicable),data services, and cloud infrastructure.
• Manage CI/CD pipelines using Harness.
• Collaborate withdata scientists, analysts, and business teams to deliver high-quality data solutions.
• Ensure best practices for performance, security, scalability, and reliability.

Client is seeking a highly skilled Senior Python / AI Data Engineer with strong expertise in advanced Python development, OpenAI integrations, and cloud-native data engineering on AWS. The ideal candidate will have deep experience building scalable data pipelines, AI-driven solutions, and production-grade ETL systems., * Strong and advanced Python development experience.

• Hands-on experience with OpenAI / GenerativeAI APIs.
• Solid experience with AWS cloud services.
• Proven expertise in Airflow for orchestration.
• Experience with Harness for CI/CD.
• Strong ETL anddata engineering skills (data modeling, transformations, pipelines).
• Strong SQL anddata analysis capabilities.
• Experience working in Agile/DevOps environments.

Preferred Qualifications:

• Prior experience in financial services or investment management domains.
• Exposure to large-scale, enterprisedata platforms.