Platform Engineer - Starburst Enterprise
Role details
Job location
Tech stack
Job description
- Platform Support:
o Provide technical support and troubleshoot issues related to the Starburst Enterprise Platform.
o Ensure platform performance, availability, and reliability using Helm charts for resource management.
- Deployment and Configuration:
o Manage deployment and configuration of the Starburst Enterprise Platform on Kubernetes using Helm charts and YAML-based values files.
o Build and maintain Docker images as needed to support efficient, scalable deployments and integrations.
o Employ GitHub Actions for streamlined CI/CD processes.
- User Onboarding and Support:
o Assist in onboarding users by setting up connections, catalogs, and data consumption client tools.
o Address user queries and incidents, ensuring timely resolution and issue triage.
- Maintenance and Optimization:
o Perform regular updates, patching, and maintenance tasks to ensure optimal platform performance.
o Conduct application housekeeping, user query logs, and access audits.
- Scripting and Automation:
o Develop automation scripts using Python and GitHub pipelines to enhance operational efficiency.
o Document workflows and ensure alignment with business objectives.
- Broader Knowledge and Integration:
o Maintain expertise in technologies like Immuta, Apache Ranger, Collibra, Snowflake, PostgreSQL, Redshift, Hive, Iceberg, dbt, AWS Lambda, AWS Glue, and Power BI.
o Provide insights and recommendations for platform improvements and integrations.
- New Feature Development and Integration:
o Collaborate with feature and product development teams to design and implement new features and integrations with other data product value chain systems and tools.
o Assist in defining specifications and requirements for feature enhancements and new integrations.
- Automation and Innovation:
o Identify opportunities for process automation and implement solutions to enhance operational efficiency.
o Innovate and contribute to the development of new automation tools and technologies.
- Incident Management:
o Support incident management processes, including triaging and resolving technical challenges efficiently.
Requirements
-
Bachelor's degree in Computer Science, Information Technology, or a related field.
-
Experience supporting and maintaining applications deployed on Kubernetes using Helm charts and Docker images.
-
Understanding of RDS, GitHub Actions, and CI/CD pipelines.
-
Proficiency in Python and YAML scripting for automation and configuration.
-
Excellent problem-solving skills and the ability to support users effectively.
-
Strong verbal and written communication skills.
Preferred Qualifications
-
Experience working with Kubernetes (k8s).
-
Knowledge of data and analytical products like Immuta, Apache Ranger, Collibra, Snowflake, PostgreSQL, Redshift, Hive, Iceberg, dbt, AWS Lambda, AWS Glue, and Power BI.
-
Familiarity with cloud environments such as AWS.
-
Knowledge of additional scripting languages or tools is a plus.
Beneficial Experience
- Exposure to Starburst or other data virtualization technologies like Dremio, Trino, Presto, and Athena.