Data Scientist
Bbva. S.a.
Municipality of Madrid, Spain
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Municipality of Madrid, Spain
Tech stack
A/B testing
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Information Lifecycle Management
Python
Machine Learning
SQL Databases
Google Cloud Platform
Cloud Platform System
Large Language Models
Prompt Engineering
Generative AI
PySpark
Information Technology
Machine Learning Operations
Job description
- Ability to assess and select appropriate LLM models for each need.
- Construction of knowledge bases for the models, e.g. domain documents, unstructured information, etc.
- Iterative construction of partial or complete analytical solutions, possibly integrating inferences from different models.
- Integration of the product and evaluation of its performance according to methodology.
- Execution of sprint-by-sprint analytical experimentation cycles.
- Methodology approach for A/B testing and definition of requirements for experiments.
- Execution of test plans, including the definition, construction and obtaining of analytical metrics (performance, cognitive, technical, and business) capable of evaluating LLMs in both discriminative and generative modes.
Requirements
- Bachelor's or Master's degree in Computer Science, Statistics, Mathematics, or a related field., * Data lifecycle management, including identification, prior exploration (EDA), transformation and adaptation to the model/problem, definition of training datasets, validation, testing, dataset tracing, etc.
- Experience in the life cycle of ML models, including research, selection, adaptation, testing, training and monitoring / retraining.
- Advanced technical knowledge of LLMs: discriminative / generative models, prompt engineering, fine-tuning, model optimisation.
- Knowledge of the risks inherent in LLM models, especially in their generative component (hallucination of facts, omissions, inherent biases, unpredictability, etc.).
- Solid programming background (Python, Pyspark, SQL).
- (Desirable) LangChain, LangGraph, LLM Agents.
- Experience in ML projects on cloud environments, preferably AWS.
- (Desirable): Experience in other cloud environments: Azure, Google Cloud Platform / Vertex AI.
- (Desirable): Experience in other on-premise environments (Datio / Datio Evo).
Soft skills
- Team spirit: Teamwork, sharing ideas, giving and receiving feedback, empathy.
- Dissemination: Ability to communicate and explain technical matters to a general audience.
- Adaptability: Ability to adapt to changing, demanding and uncertain technical environments., * A/B Testing, Algorithms, Large Language Models (LLMs), Model Building.
About the company
BBVA is a general company with more than 160 years of history that operates in more than 25 countries where we serve more than 80 million customers. We are more than 121,000 professionals working in multidisciplinary teams with profiles as diverse as financiers, legal experts, data scientists, developers, engineers and designers.