Big Data/Machine Learning Engineer - Sr

Capital One is looking for an experienced Senior Data Engineer with strong expertise in Big Data technologies, distributed data processing, and cloud-based data engineering solutions. The ideal candidate will have hands-on experience developing scalable data pipelines, working with AWS services, building REST APIs, and implementing real-time streaming solutions.

Big Data, Machine Learning, Data Processing, Software Engineering, Big Data, REST (Representational State Transfer), Application Programming Interface (API), Cloud Computing, Data Management, Amazon Web Services (AWS), * Strong hands-on experience with Python and Scala programming.

• Extensive experience with AWS cloud services, particularly AWS EMR and AWS Glue.
• Strong knowledge of Big Data technologies and distributed data processing.
• Experience developing and integrating REST APIs.
• Hands-on experience with Apache Kafka and real-time data streaming.
• Strong SQL skills, including complex queries and database optimization.
• Experience designing, developing, and maintaining scalable ETL/ELT data pipelines.
• Ability to troubleshoot, optimize, and maintain high-performance data engineering solutions.

Preferred Skills

• Exposure to Artificial Intelligence (AI) and Machine Learning (ML) technologies.
• Experience integrating AI/ML capabilities into data engineering workflows.
• Familiarity with modern cloud-based data platforms and scalable data architectures.