Platform Engineer
Role details
Job location
Tech stack
Job description
-
Provide technical support and troubleshoot issues related to the Starburst Enterprise Platform.
-
Ensure platform performance, availability, and reliability using Helm charts for resource management.
Deployment and Configuration:
-
Manage deployment and configuration of the Starburst Enterprise Platform on Kubernetes using Helm charts and YAML-based values files.
-
Build and maintain Docker images as needed to support efficient, scalable deployments and integrations.
-
Employ GitHub Actions for streamlined CI/CD processes.
User Onboarding and Support:
-
Assist in onboarding users by setting up connections, catalogs, and data consumption client tools.
-
Address user queries and incidents, ensuring timely resolution and issue triage.
Maintenance and Optimization:
-
Perform regular updates, patching, and maintenance tasks to ensure optimal platform performance.
-
Conduct application housekeeping, user query logs, and access audits.
Scripting and Automation:
-
Develop automation scripts using Python and GitHub pipelines to enhance operational efficiency.
-
Document workflows and ensure alignment with business objectives.
Broader Knowledge and Integration:
-
Maintain expertise in technologies like Immuta, Apache Ranger, Collibra, Snowflake, PostgreSQL, Redshift, Hive, Iceberg, dbt, AWS Lambda, AWS Glue, and Power BI.
-
Provide insights and recommendations for platform improvements and integrations.
New Feature Development and Integration:
-
Collaborate with feature and product development teams to design and implement new features and integrations with other data product value chain systems and tools.
-
Assist in defining specifications and requirements for feature enhancements and new integrations.
Automation and Innovation:
-
Identify opportunities for process automation and implement solutions to enhance operational efficiency.
-
Innovate and contribute to the development of new automation tools and technologies.
Incident Management:
- Support incident management processes, including triaging and resolving technical challenges efficiently.
Requirements
-
Bachelors degree in Computer Science, Information Technology, or a related field.
-
Experience supporting and maintaining applications deployed on Kubernetes using Helm charts and Docker images.
-
Understanding of RDS, GitHub Actions, and CI/CD pipelines.
-
Proficiency in Python and YAML scripting for automation and configuration.
-
Experience working with Kubernetes (k8s).
-
Knowledge of data and analytical products like Immuta, Apache Ranger, Collibra, Snowflake, PostgreSQL, Redshift, Hive, Iceberg, dbt, AWS Lambda, AWS Glue, and Power BI.
-
Familiarity with cloud environments such as AWS.
-
Knowledge of additional scripting languages or tools is a plus.