Data Engineer - Big Data Platform
Role details
Job location
Tech stack
Job description
At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer within PNC's Technology organization, you will be based in Pittsburgh, PA, Dallas, TX, Cleveland OH or Birmingham, AL., We are seeking a Data Engineer to help support large-scale enterprise big data platforms. This team is responsible for building and evolving modern data solutions that enable analytics across the organization while partnering closely with business stakeholders., * Monitor, maintain, and improve the health and performance of the data platform
- Ensure stability, reliability, and scalability of data systems
- Implement best practices for platform operations and data engineering standards. Ensure understanding and adherence across technical and business customers
- Perform frequent reviews of the data platform architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment
- Contribute to large-scale transformation initiatives, including:
? Driving user migration to a unified data platform
? Modernizing legacy Hadoop-based systems to cloud-native architectures
- Design and build scalable, modern data platforms leveraging:
? Open-source technologies such as Apache Iceberg, Airflow, and Trino
? Data lakehouse architecture for structured, transactional data availability
- Partner with business stakeholders to translate analytical needs into technical solutions
? Apply modern principles, methodologies and tools to advance business initiatives and capabilities
- Act as an internal consultant to internal customers on big data tools and capabilities
? Enhance and optimize query performance and data structures to support analytical
? Guide stakeholders in understanding how to leverage data for business insights
- Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metrics, * Develops, supports and implements data services for multiple applications to meet business objectives and user requirements. Uses technical knowledge and industry experience to design, build and maintain technology solutions.
- Works closely with users, developers, operations and business partners to define data service requirements and the data preparation process development.
- Designs and builds data service infrastructure on multiple data platforms, according to key business processes and the overall workflow.
- Develops and implements data solutions for multiple applications to ensure its scalability, availability and maintainability.
- Implements data migration and transformation activities/processes to ensure the accuracy and security of data solutions.
PNC Employees take pride in our reputation and to continue building upon that we expect our employees to be:
- Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
- Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC's Enterprise Risk Management Framework.
Requirements
Ideal candidates thrive in problem-solving environments, help shape analytical solutions, and contribute to the design of a next-generation, cloud-native data platform., * Strong proficiency in relevant programming languages such as Python, Spark, Scala
- Strong background and practical experience in SQL development and enterprise database systems (Oracle, Teradata, etc.)
- Experience with modern, cloud-native and open-source tools is highly valued:
? Apache Iceberg
? Apache Airflow
? Trino
- Strong experience in modern data engineering and big data ecosystems / frameworks
- Hands-on experience building scalable data platforms and analytical solutions using data lakehouse architectures
- Familiarity with cloud platforms (e.g Azure , AWS ) and their data related services
- Proven ability to go beyond data movement and contribute to solution design
- Strong communication and presence - able to translate between technical and non-technical audiences
- Proven ability to bridge the gap between business and engineering teams
- Collaborative mindset with experience working across cross-functional teams
- Strong problem-solving and critical thinking skills, Successful candidates must demonstrate appropriate knowledge, skills, and abilities for a role. Listed below are skills, competencies, work experience, education, and required certifications/licensures needed to be successful in this position.
Preferred Skills
Analytical Thinking, Big Data, Competitive Advantages, Data Analytics, Data Lakehouse Architecture, Data Mining, Data Science, Machine Learning (ML), Python (Programming Language), Structured Query Language (SQL)
Competencies
Application Delivery Process, Big Data Management and Analytics, Business Intelligence, Data Analysis - Software, Data Architecture, Database Structures, Effective Communications, Problem Solving, Software Development Life Cycle
Work Experience
Roles at this level typically require a university / college degree, with 3+ years of relevant / direct industry experience. Certifications are often desired. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered.
Education
Bachelors
Benefits & conditions
PNC offers a comprehensive range of benefits to help meet your needs now and in the future. Depending on your eligibility, options for full-time employees include: medical/prescription drug coverage (with a Health Savings Account feature), dental and vision options; employee and spouse/child life insurance; short and long-term disability protection; 401(k) with PNC match, pension and stock purchase plans; dependent care reimbursement account; back-up child/elder care; adoption, surrogacy, and doula reimbursement; educational assistance, including select programs fully paid; a robust wellness program with financial incentives.
In addition, PNC generally provides the following paid time off, depending on your eligibility: maternity and/or parental leave; up to 11 paid holidays each year; 9 occasional absence days each year, unless otherwise required by law; between 15 to 25 vacation days each year, depending on career level; and years of service.
To learn more about these and other programs, including benefits for full time and part-time employees, visit pncthrive.com .