> Markdown version of [/jobs/ext/2654639-cloud-data-engineer-avp](https://www.wearedevelopers.com/jobs/ext/2654639-cloud-data-engineer-avp). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Cloud Data Engineer, AVP - **Company:** State Street - **Location:** Boston, MA, United States - **Experience:** Expert - **Salary:** $90,000.0 - $157,500.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Big Data, Cloud Computing, Cloud Database, Information Systems, Computer Programming, Databases, Information Engineering, Data Infrastructure, Relational Databases, Elasticsearch, Systems Analysis, Python (Programming Language), Machine Learning, Cloud Services, Software Deployment, SQL Databases, Web Services, Workflow Management Systems, Delivery Pipeline, Amazon Relational Database Service, Information Technology, Deployment Automation, Apache Kafka, Data Management, Machine Learning Operations, Cloud Migration, Virtual Agents, Functional Programming, Docker, Databricks - **Published:** August 3, 2026 - **Apply:** https://www.jofdav.com/jobs/59109856-cloud-data-engineer-avp ## About the Role * Bachelor's degree in computer science, information systems, or a related field, or equivalent practical experience. * Five or more years of experience in data engineering, including hands-on work with cloud technologies. * AWS and/or Databricks certification is preferred but not required., * Demonstrated decision-making, analytical, and problem-solving skills, with the ability to evaluate trade-offs and recommend practical solutions. * Strong understanding of Databricks architecture and hands-on experience with Databricks Data Engineering, Machine Learning, and SQL warehouses. * Strong programming experience in Scala, Python, and/or Java for data engineering workloads. * Strong knowledge of Medallion architecture, Delta Live Tables, and Unity Catalog within Databricks. * Knowledge of GenAI and Agentic AI is a plus. * Understanding of core AWS services, their use cases, and AWS architecture best practices. * Hands-on experience across relevant domains such as database architecture, business intelligence, machine learning, advanced analytics, and big data. * Strong knowledge of Apache Airflow for workflow orchestration. * Strong knowledge of CI/CD pipelines and deployment automation for AWS-based solutions. * Experience migrating relational databases, Java and Python applications, machine learning model code, and Elasticsearch-based solutions. * Experience with Docker and Kubernetes is preferred. * Curiosity and enthusiasm for learning new technologies, combined with a strong commitment to hands-on engineering. * Effective written and verbal communication skills, with the ability to explain technical concepts and collaborate with stakeholders and senior management. * Ability to perform data and system analysis, identify root causes, and translate findings into actionable recommendations. * Ability to adapt to changing priorities and work effectively in a collaborative, fast-paced environment. ## Description As a Cloud Data Engineer, AVP, you will design, develop and deliver scalable cloud data solutions using Databricks and AWS. You will collaborate with technology and business partners to modernize data platforms, develop reliable data, AI and machine learning pipelines, and help teams adopt secure, efficient, and cost-effective engineering practices., * Assess existing application and data infrastructure, identify improvement opportunities, and recommend cloud-based solutions that enhance performance, scalability, and reliability. * Define and document best practices for application deployment, cloud infrastructure, and production support. * Build reusable, efficient, and scalable data solutions, and develop cost-effective cloud migration strategies. * Design, develop, and optimize data engineering and machine learning pipelines in Databricks using AWS services such as Amazon S3, EC2, API services, RDS, Kinesis, Kafka, and Lambda. * Partner with IT teams and business stakeholders to migrate data engineering and machine learning applications to Databricks and AWS. * Manage competing priorities and deliver high-quality solutions within time-sensitive project schedules when needed. * Evaluate, learn, and support vendor products that contribute to the organization's data and cloud capabilities. * Quickly learn emerging technologies and develop proofs of concept to evaluate their value, feasibility, and potential for broader adoption. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)