Cloud Data DevOps Engineer
Role details
Job location
Tech stack
Job description
If you are passionate about making an impact, utilizing cutting-edge data technology, and eager to learn and grow with talented data & analytics teams, we believe you would be a great fit and help in innovation and solving challenges.
What You'll Do
-
Design, deploy, and maintain scalable and reliable cloud infrastructure on AWS and GCP.
-
Build scalability, fault-tolerance, security, and performance into our data platforms to meet our growing data & analytics needs.
-
Develop cloud data ingestion and processing frameworks.
-
Automate routine tasks to improve efficiency and reduce manual intervention.
-
Implement and maintain CI/CD pipelines for data applications.
-
Optimize data pipelines and processes for performance and scalability.
-
Troubleshoot and resolve issues related to data pipelines and data processing.
-
Work with our data engineering teams, data science teams, and analytical business users to review and ensure best practices are followed and high-quality code gets implemented.
-
Partner with our Information Security, Application Security, and Cloud Infrastructure Services teams to ensure data is secure both at-rest and in-flight.
-
Ensure data platforms remain current to take advantage of the latest features and support.
-
Mentor, teach, champion, and encourage an Automation mindset amongst the IT department and other business units.
-
Communicate the status of assigned work to management and follow agile practices, standard procedures, and policies.
-
Seek guidance when direction is needed and speak up about technology risks identified.
Requirements
-
Extensive hands-on expertise in Automation, troubleshooting logs, and optimizing system performance.
-
Deep understanding of Cloud and data security in AWS or Google Cloud.
-
Good experience with networking, Linux and Unix OS, and shell scripting.
-
Demonstrated aptitude for identifying the underlying issues in Cloud services such as Glue, Lambda, Big Query, and Cloud Functions.
-
Good experience with Cloud platforms AWS and/or Google Cloud in supporting Data pipelines and integrations.
-
Experience with Cloud Automations using CloudFormation or Terraform.
-
Good understanding of network infrastructures and protocols such as TCP/IP, TLS.
-
Familiarity with data integration from different sources into Big Data systems is preferable.
-
Familiarity with SQL and programming languages such as Python, Spark, YAML, and Bash.
-
Cloud Certification in DevOps in AWS or Google Cloud is a plus.
Benefits & conditions
-
Health coverage for medical, dental, vision
-
401(K) saving plans with company match AND Pension
-
Tuition assistance
-
Floating holidays and PTO for community volunteer programs
-
Paid parental leave
-
Wellness programs
-
Employee discounts (membership, insurance,
travel, entertainment, services and more!)