Data Engineer (all genders)
Role details
Job location
Tech stack
Job description
We are looking for a talented Data/AI Engineer with expertise on AWS to join our dynamic team and help us shape the future of corporate travel. The candidate will be supporting our teams from our Chandigarh/ Mohali office and reporting to HRS HQ and also be responsible for coordinating with stakeholders, business teams, and data teams, converting business requirements into pipeline- & data model designs, and implement AI/Data engineering solutions supporting different areas of the business. In doing so, the candidate knows and loves working with large language models, AWS resources and -capabilities, can model multidimensional datasets, and can implement and maintain data pipelines sponsoring "lakehouse" architectures., Develop an innovative data landscape for driving the business with analytics solutions up to real-time with state-of-the- art Data, AI & Analytics technologies on AWS and RDBMS. Develop and implement AI large language models(LLMs) using concepts like deep learning techniques, natural language processing, computer vision, machine learning etc. Analyze and preprocess large datasets to ensure high-quality input for LLM models thereby optimizing the AI solution for performance and scalability. Design & Build pipelines with Continuous Delivery practices, to collect, normalize, index, integrate and publish data coming from multiple sources to our AWS-based data platform and in-memory data warehouse Exasol / Oracle. Orchestrate our cloud (AWS) resources, automatic scheduling (Airflow), pipelining (Spark, DBT), monitoring and performance reporting. Build data platform tooling and capabilities that enable data analysts, scientists and engineers build and operate analytic workloads through self-service. Stay up-to-date with the latest advancements in AI and machine learning technologies.
Requirements
Hands-on experience in data extraction and integration along with environment & deployment automation. Experience in cloud engineering services using private and public cloud resources. Expertise in hosting large language models in AWS and training with data for answering business related questions. Expertise in Data Warehousing, ETL, Analytics, and reporting. Skill preferred SQL, Python, AWS, Spark, Microstrategy, Oracle/Exasol and Superset. Excellent communication skills to collaborate with business stakeholders, technical engineers and management. Fluency in English is a must