Senior Technical Lead

HCL America Inc.

Jersey City, NJ, United States

15 days ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

2 years minimum

Compensation

$151,000.0

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Artificial Intelligence Amazon Web Services Confluence JIRA Microsoft Azure Cloud Computing Information Engineering Data Infrastructure Extract Transform Load (ETL) Monitoring of Systems Information Technology Operations Python (Programming Language)

+13 more

Nagios Standard Sql Shell Script SQL Databases System Availability Apache Spark Information Technology Data Analytics Data Management Data Pipelines Dynatrace Servicenow Databricks

Job description

As a Databricks Support Specialist for the Pharma industry, you will be responsible for ensuring the operational stability and performance of Databricks-based data platforms. Your expertise in ITSM processes and monitoring tools will drive efficient incident resolution and proactive problem management, supporting critical data analytics operations for life sciences clients., * Provide L2/L3 support for Databricks environments, ensuring high availability and performance of data pipelines.

Manage incidents, service requests, and changes using ServiceNow, adhering to ITIL frameworks.
Monitor Databricks clusters and jobs using Dynatrace and BigPanda, identifying and resolving performance bottlenecks.
Troubleshoot ETL workflow failures, data quality issues, and integration problems with clinical and operational datasets.
Collaborate with data engineering teams to escalate complex issues and coordinate minor enhancements.
Document known issues, troubleshooting guides, and runbooks in Confluence.
Track support activities in JIRA, ensuring SLA adherence and quality reporting.
Perform routine maintenance and automation tasks using shell scripts and basic Python/SQL.
Coordinate with cloud infrastructure teams for AWS/Azure-related issues affecting Databricks environments.
Participate in on-call support rotations and incident bridges.

Requirements

Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, or a related field.
2+ years of experience in data platform support or IT operations, preferably with Databricks or Spark.
Strong understanding of ITSM processes and experience with ServiceNow for incident and change management.
Proficiency with Dynatrace, BigPanda, or similar monitoring and alerting tools.
Experience with JIRA for ticket management and Confluence for knowledge documentation.
Basic shell scripting and Python/SQL skills for troubleshooting and automation.
Foundational knowledge of AWS and Azure cloud platforms.
Basic understanding of ETL processes and data engineering concepts is a plus.
Excellent analytical, problem-solving, and communication skills.
Exposure to GenAI technologies and Gemini for AI-assisted operations and automation is a plus.