Data Engineer (PySpark)

We are seeking a Data Engineer to design, build, and operate reliable, scalable data solutions in a production environment. This role will focus on developing high-quality data pipelines, extending reusable platform capabilities, and enabling federated teams to onboard and manage data consistently., * Design, build, and harden production-grade data pipelines supporting Data ingestion and curation, Reconciliation and auditability, Data quality monitoring, Metadata and lineage, Notifications and operational alerting

• Contribute to and extend the organization’s generic pipeline framework, enabling federated teams to onboard and manage data consistently and efficiently.
• Build scalable data transformations primarily using PySpark on GCP Dataproc/Spark, with BigQuery as the primary query engine.
• Implement best practices for Schema management and evolution, Performance optimization, Reliability and recoverability, Resource utilization and cost efficiency
• Work with large-scale datasets and modern data formats, including Parquet and Apache Iceberg.
• Integrate data pipelines with centralized data cataloging and governance platforms, such as Dataplex, Knowledge Catalog, or equivalent technologies.
• Support automated metadata and lineage harvesting to improve data discovery, governance, and reuse.
• Collaborate with platform, security, and central cloud teams to deliver secure, maintainable, and scalable data solutions.
• Support hybrid data access and federated query patterns using technologies such as Starburst/Trino, where appropriate.
• Develop resilient, observable, and recoverable data flows that meet production service-level agreements.
• Participate in production support, incident response, root-cause analysis, and continuous improvement activities.
• Apply sound software engineering practices, including code reviews, automated testing, CI/CD, documentation, and version control.

• Hands-on experience building and supporting data engineering solutions in production environments.
• Strong SQL skills and experience developing data transformations at scale.
• Practical experience with Apache Spark, preferably using PySpark.
• Experience working with big data file formats, particularly Parquet; familiarity with Iceberg concepts is preferred.
• Experience delivering reliable, scheduled data pipelines with monitoring, alerting, and incident response.
• Understanding of data cataloging, metadata management, and data lineage concepts, including their importance for governance, discoverability, and reuse.
• Exposure to GCP data services such as Dataproc/Spark and Big Query
• Understanding of production data operations, reliability, and recoverability.
• Solid software engineering practices, including Version control, CI/CD, Automated testing, Code reviews, technical documentation
• Ability to collaborate effectively with central cloud, platform, security, and governance teams.
• Strong written and verbal communication skills.

Preferred, but not required:

• Experience building reusable data pipeline frameworks, platform components, or shared engineering capabilities adopted by multiple teams.
• Familiarity with Starburst or Trino for federated querying across hybrid environments.
• Knowledge of data quality frameworks, reconciliation processes, auditability, and data controls in regulated or enterprise environments.

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $90k - $95k/year & benefits (see below)., * A highly competitive compensation and benefits package.

• A multinational organization with 58 offices in 22 countries and the possibility to work abroad.
• 10 days of paid annual leave (plus sick leave and national holidays).
• Maternity & paternity leave plans.
• A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
• Retirement savings plans.
• A higher education certification policy.
• Commuter benefits (varies by region).
• Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
• On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
• Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
• Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
• A flat and approachable organization.
• A truly diverse, fun-loving, and global work culture.

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 17000+, and has 58 offices in 22 countries within key global markets., Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture - promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.