Sr. AWS DevOps Engineer
Spectraforce
Plano, TX, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
0 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Bash Shell
Cloud Computing
Cloud Computing Security
Databases
Continuous Integration
Data Infrastructure
Extract Transform Load (ETL)
Data Security
Digital Architecture
Apache Hive
+10 more
Identity and Access Management
Python (Programming Language)
SQL Databases
Enterprise Data Management
Cloud Platform System
System Availability
Apache Spark
Data Management
Terraform
Databricks
Job description
We’re seeking a hands-on Senior Cloud Data Platform Engineer to build, operate, and support secure, reliable data platforms across AWS and Databricks. This role spans infrastructure as code, cloud and data platform operations, access management, automation, migrations, and production support. You’ll partner with engineering, data, security, and operations teams to deliver platform capabilities across development, QA, and production environments., * Design, deploy, and operate AWS infrastructure supporting enterprise data platforms, including S3, IAM, networking, databases, and cross-account access.
- Build and maintain infrastructure using Terraform and related automation tools, with consistent, repeatable deployments across environments.
- Administer Databricks workspaces and Unity Catalog, including catalogs, schemas, tables, compute, jobs, and service principals.
- Implement and troubleshoot data access using groups and least-privilege grants; investigate permission inheritance, workspace access, and identity synchronization.
- Support data platform migrations, including Hive Metastore to Unity Catalog, and validate data access and workloads after migration.
- Develop and maintain CI/CD pipelines for infrastructure and data platform deployments; troubleshoot failed runs and support safe releases.
- Support data movement and integration between cloud accounts and platforms, including testing and validating representative data-copy workflows.
- Monitor platform reliability, security, performance, and cost; troubleshoot incidents and recommend lasting improvements.
- Support operational requests such as user onboarding, access changes, audit activities, and production changes in accordance with approval and change-management processes.
- Document architecture, operational procedures, access patterns, and incident resolutions; collaborate with distributed teams across time zones., * Infrastructure and platform changes are repeatable, reviewed, and deployed consistently across environments.
- Users receive the right data access with minimal delay and no unnecessary privilege.
- Data platform migrations and cross-account workflows are validated and supported with clear operational procedures.
- Production issues are resolved effectively, with root causes documented and recurring problems reduced.
- Platform reliability, security, and cost are continuously improved.
Requirements
- AWS / AWS DevOps (includes CI/CD pipelines)
- DataBricks / Terraform
- Unity Catalog / Python / Spark, * Experience operating cloud infrastructure in AWS, including IAM, S3, networking, and cross-account access. * Hands-on experience with Terraform or a comparable infrastructure-as-code tool. * Experience supporting Databricks, Apache Spark, or a comparable cloud data platform. * Understanding of data access controls, identity and group-based permissions, and least-privilege security. * Experience with CI/CD, scripting, and production troubleshooting. * Strong communication skills and the ability to work with platform users, application teams, security, and operations. * Careful approach to production changes, including validation, rollback planning, and change documentation., * Experience with Unity Catalog, including catalog/schema/table grants and migration from Hive Metastore. * Experience with Databricks workspaces, clusters or compute, jobs, service principals, and workspace identity configuration. * Experience with AWS cross-account data access, encryption, KMS, and cloud security controls. * Familiarity with data-copy and ingestion patterns, SQL, Spark, Python, or Bash. * Experience supporting enterprise data lakes, lakehouses, or regulated production environments. * Familiarity with incident management, audit requirements, and service-management workflows.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…