Data Engineer -ML

Tata Consultancy Services Limited
Irving, TX, United States
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$125,000.0 - $140,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Big Data Cloud Computing Data Infrastructure Software Design Patterns Distributed Systems Design of User Interfaces Apache Hadoop Human-Computer Interaction Python (Programming Language) Machine Learning
+11 more
Language Modeling OpenShift Performance Tuning Cloudera Software Engineering Scripting Google Cloud Cloud Platform System Large Language Models Pyspark Machine Learning Operations

Job description

We are looking for a highly skilled and passionate Data Engineer with strong Python/PySpark experience and

understanding of AL/ML models to implement AL/ML models in OnPrem and Cloud environment.

In this role, you will be responsible for implementing AL/ML Models in different environments leveraging

Openshift/Kubernetics.

Responsibilities:

Work with data scientists/data engineers to translate prototypes and theoretical models into functional,

production ready code.

Collaborate with product and engineering team to implement AI/ML models using PySpark.

Understanding of AI/ML and large language models (LLMs).

Work on productionalize the AL/ML model in Hadoop environment.

Troubleshoot AI/ML Models post implementation to resolve issue raised by users.

Monitor model performance and continuously improve efficiency, accuracy, and user experience.

Requirements

Strong experience in PySpark and Python to integrate with AI/ML Models.

Understanding of AI/ML Models and how they interface with OnPrem and Cloud environments.

Familiarity with ML Ops/LLM Ops and distributed systems.

Experience with Big Data platform like Cloudera Hadoop and Could platforms like AWS, GCP.

Solid understanding of system design patterns, scalability, observability, and performance tuning.

Strong analytical and problem-solving skills.

Passion for exploring and building with emerging technologies.

Salary Range: $125,000 to $140,000 per year

Skills: Amazon Web Services (AWS), Analysis Skills, Apache Hadoop, Artificial Intelligence (AI), Big Data, Cloud Computing, Cloudera, Continuous Improvement, Data Science, Design Patterns Programming Methodologies, Distributed Computing, GCP (Good Clinical Practices), Identify Issues, Modeling Languages, Performance Analysis, Performance Modeling, Performance Tuning/Optimization, Problem Solving Skills, Product Engineering, Prototyping, Python Programming/Scripting Language, Resolve Customer Issues, Software Engineering, User Interface/Experience (UI/UX)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:04 min

Pre-built algorithms and further learning resources

Ayon Roy · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

Videos

See all

Related articles

See all