hands-on Data Engineer for Cloud Data Lake design
Role details
Job location
Tech stack
Job description
End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.
Build data integrations, hand-offs between on-prem/cloud-based systems.
Design and develop high volume data ingestion components and solutions to collect data from various sources.
Manage and use appropriate tools in the cloud data lake development and deployment.
Responsible for developing/implementing cloud infrastructure to support current and future business needs.
Participating in technical design, application build, configuration, unit testing, and production deployment.
Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability
Requirements
Development experience in designing, developing and deploying complex applications.
Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .
Hands on experience with Cloud platforms, preferably using Databricks.
Experience in building systems using modern, scalable, resilient, cloud native architectures.
Experience in Data Modeling and database design with strong skills in performance tuning.
Hands on experience in setting up data pipelines for ELT jobs across multiple data sources.
Hands on experience in big-data processing, troubleshooting and resolving database performance issues.
Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys.
Experience with optimizing database performance, scalability, ensuring data security and compliance.
Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.
Proficiency with CICD and DevOps., * Bachelor's/Master's Degree in a Computer Science, Engineering or Math or equivalent experience
- 10+ years' experience in professional software design and development.
- Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently
- Proven ability to develop and work with cross functional processes and project timelines
- Excellent follow-through, attention to detail and time management skills
Benefits & conditions
$110,000 - $207,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans., We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
