ML Engineer
idfc first bank
United Kingdom
23 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
Β£47,451
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Big Data
Cloud Computing
Extract Transform Load (ETL)
Distributed Computing Environment
Distributed Systems
Memory Management
Apache Hadoop
Machine Learning
Tensorflow
Graphics Processing Unit (GPU)
+11 more
Google Cloud
Pytorch
Large Language Models
Apache Spark
Deep Learning
Keras
Containerization
Information Technology
Machine Learning Operations
GPT
Docker
Job description
In this role, you will be responsible for managing the training infrastructure for our Large Language Models (LLMs). Leveraging your deep understanding of GPUs and machine learning principles, you will oversee the training of large-scale machine learning models, optimizing resources and improving efficiency.
Requirements
- Understanding of machine learning principles and algorithms, specifically LLMs such as GPT-4, BERT, etc.
- Extensive knowledge of deep learning frameworks like TensorFlow, PyTorch, or Keras, which are used to train LLMs.
- Deep knowledge of computer architecture, particularly about GPUs. Understanding how to maximize GPU utilization and efficiency.
- Familiarity with cloud platforms (AWS, Azure, GCP) and experience in managing and optimizing resources for training deep learning models.
- Experience with containerization and orchestration tools like Docker and Kubernetes.
- Understanding of parallel and distributed computing principles. Experience with distributed training of deep learning models can be beneficial.
- Familiarity with distributed computing and big data technologies like Hadoop and Spark.
- Familiarity with machine learning operations (MLOps) principles and tools for managing the ML lifecycle.
Secondary Responsibilities
- Should have worked on the infrastructure side of multiple machines learning projects, ideally involving deep learning models such as BERT and Transformers.
- Experience in managing resources and optimizing performance for large-scale machine learning tasks. Experience in managing and optimizing GPU resources, both on-premises and in the cloud, for machine learning tasks.
- Experience in handling the challenges associated with training large models, such as managing memory usage, optimizing data loading, and troubleshooting hardware issues.
- Ideally, should have worked closely with data scientists and machine learning engineers to understand their infrastructure needs and provide efficient solutions.
Key Success Metrics
- Ensure timely deliverables.
- Spot Training Infrastructure fixes.
- Lead technical aspects of the projects.
- Error free deliverables., B.Tech, B.E., MBA, Masterβs or Bachelorβs degree, in fields like Economics, Statistics, Computer Science, or any other relevant stream. ]]>
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦