Data Engineer, Specialist

Provides expert level data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes the deepest dive analytical skillset on a variety of internal and external data. Leads, instructs, and mentors newer Data Engineering crew., The Data Engineer, Senior Specialist is responsible for designing, developing and optimizing data pipelines and architectures to support scalable and efficient data processing. This role involves working with complex datasets, integrating multiple data sources and ensuring high data quality and reliability.

Responsibilites

1. Develop and maintain efficient ETL (Extract, Transform, Load) pipelines that ingest, process and transform large datasets from diverse sources.
2. Build and manage data storage solutions using relational and non-relational databases, ensuring high availability, performance and scalability.
3. Work with APIs, third-party data sources and internal databases to create unified datasets that provide actionable insights for business stakeholders.
4. Partner with business intelligence analysts, data scientists and software engineers to design and implement data-driven solutions that meet business requirements.
5. Design optimized data schemas and structures that support analytical workloads and improve query performance.
6. Leverage orchestration tools like Apache Airflow or Prefect to automate ETL workflows and improve operational efficiency.
7. Provide technical guidance, review code and promote best practices within the data engineering team.

• Minimum of eight years data analytics, programming, database administration, or data management experience.
• Undergraduate degree or equivalent combination of training and experience. Graduate degree preferred.
• Data modeling experience is required.
• Proficiency in SQL and database technologies such as PostgreSQL, MySQL, Oracle, or SQL Server.
• Hands-on experience with big data frameworks like Apache Spark, Hadoop, or Databricks.
• Strong programming skills in Python, Scala, or Java for data processing and automation.
• Experience with cloud platforms such as AWS, Azure, or GCP, particularly in data services like AWS Glue, Redshift, Big Query, or Snowflake.

About Vanguard At Vanguard, we don't just have a mission-we're on a mission. To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best. How We Work Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.