Senior Technical Lead
Role details
Job location
Tech stack
Job description
Designing scalable data lakes, Lakehouse, DWH, streaming & analytics platforms. Design, build and manage Glue catalogs, Glue jobs Architect & optimize AWS-based ETL/ELT, ML, and real-time data pipelines. Implement data governance, security, quality, metadata & lineage frameworks. Automate monitoring, scaling and governance using CloudWatch, Event Bridge and lambda. Own end-to-end environment Automation Establishing development tools and infrastructure for automation Understanding the needs of stakeholders and conveying this to developers Testing and examining code written by others and analyzing results Ensuring that systems are safe and secure against cybersecurity threats Identifying technical problems, performing root cause analysis, and developing software updates and 'fixes' Working with software developers and software engineers to ensure that development follows established processes and works as intended Support enterprise Cloud applications or infrastructure through infrastructure as code including any activities around automated server or network configurations, large-scale software deployments, and monitoring and testing, such as CI/CD Document as-is state of the environment, perform a gap analysis, and produce artifacts that articulate options and recommendations Leverage virtualization and containerization to optimize and modernize software systems Act as an individual contributor and mentor team members Engineer and implement solutions and provide recommendations for continuous improvement for the services provided Present regular status updates and provide cross training to other team members. Skill Requirements
Mandatory skills : AWS DevOps (Security) , Terraform , IAC, GitLab CI/CD, Docker, Kubernetes
Optional skills : AWS cloudwatch, AWS Service Mesh, API Gateway , Kong
Knowledge of data lakes, Lakehouse, DWH, streaming & analytics platforms, Glue catalogs, Glue jobs is an added advantage
Technical Skills:
- Data Ingestion Layer
Informatica AWS Glue
Requirements
Citizen: GC \ or a US citizen and can be remote, however Seattle, WA preferred
Mandatory skills : AWS DevOps (Security) , Terraform , IAC, GitLab CI/CD, Docker, Kubernetes
Optional skills : AWS cloudwatch, AWS Service Mesh, API Gateway , Kong
Knowledge of data lakes, Lakehouse, DWH, streaming & analytics platforms, Glue catalogs, Glue jobs is an added advantage