Data Engineer

The PNC Financial Services Group, Inc.
Dallas, TX, United States
4 days ago
Apply on www.dallasjobsite.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$86,250 - $158,125
Working hours
Regular working hours

Tech stack

Query Performance Artificial Intelligence Airflow Amazon Web Services Data Analysis Apache HTTP Server Server Applications Automation of Tests Microsoft Azure Big Data Cloud Computing Cloud Engineering
+40 more
Code Generation Profiling Databases Data as a Services Data Architecture Data Cleansing Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Migration Data Structures Data Systems Data Warehousing Database Development Database Storage Structures Apache Hadoop Python (Programming Language) Machine Learning Open Source Technology Oracle (Applications) Query Optimization Reliability Engineering Cloud Services Prometheus Scala (Programming Language) Software Engineering SQL Databases Teradata SQL Datadog Data Processing Retrieval-Augmented Generation Grafana Apache Spark Build Management Kubernetes Data Management Data Pipelines Docker Programming Languages

Job description

At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company’s success. As a Data Engineer within PNC’s Data and Automation organization, you will be based in Pittsburgh, PA, Strongsville, OH, Dallas, TX, Denver, CO, Phoenix, AZ or Birmingham, AL., We are seeking a Data Engineer to help support large-scale enterprise big data platforms. This team is responsible for building and evolving modern data solutions that enable analytics across the organization while partnering closely with business stakeholders., * Monitor, maintain, and improve the health and performance of the data platform

  • Ensure stability, reliability, and scalability of data systems
  • Implement best practices for platform operations and data engineering standards. Ensure understanding and adherence across technical and business customers
  • Perform frequent reviews of the data platform architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment
  • Contribute to large-scale transformation initiatives, including:

? Driving user migration to a unified data platform

? Modernizing legacy Hadoop-based systems to cloud-native architectures

  • Design and build scalable, modern data observability analytics to support site reliability

? Develop ETL/ELT pipeline monitoring solutions to identify bottlenecks, failures or abnormal data processing metrics

? Establish intelligent alerts to identify high utilization Spark and Trino jobs to ensure service ability for all users

? Capture and report on compute usage across containers in Kubernetes, Docker, etc. to give visibility to job/query optimization needs

? Develop dashboards and visualizations that provide real-time visibility into enterprise data platform health, performance and availability

  • Partner with business stakeholders to translate analytical needs into technical solutions

? Apply modern principles, methodologies and tools to advance business initiatives into actions through data and BI tools

  • Act as an internal consultant to internal customers on big data tools and capabilities

? Enhance and optimize query performance and data structures to support analytical

? Guide stakeholders in understanding how to leverage data for business insights

  • Design, implement and standardize the use of AI and Generative AI tools for automation of tasks, accelerate development and streamline platform efficiency and governance

? Code generation for query and cost optimization to maximize platform resources

? Use vector databases, embedding pipelines, feature stores Retrieval-Augmented Generation workflows to engineer solutions

? Maintain integrity of engineering code and data through automated code generation, profiling and data cleansing tools.

  • Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metrics, * Develops, supports and implements data services for multiple applications to meet business objectives and user requirements. Uses technical knowledge and industry experience to design, build and maintain technology solutions.
  • Works closely with users, developers, operations and business partners to define data service requirements and the data preparation process development.
  • Designs and builds data service infrastructure on multiple data platforms, according to key business processes and the overall workflow.
  • Develops and implements data solutions for multiple applications to ensure its scalability, availability and maintainability.
  • Implements data migration and transformation activities/processes to ensure the accuracy and security of data solutions.

PNC Employees take pride in our reputation and to continue building upon that we expect our employees to be:

  • Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
  • Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC’s Enterprise Risk Management Framework.

Requirements

Ideal candidates thrive in problem-solving environments, help shape analytical solutions, and contribute to the design of a next-generation, cloud-native data platform., * Strong proficiency in relevant programming languages such as Python, Spark, Scala

  • Strong background and practical experience in SQL development and enterprise database systems (Oracle, Teradata, etc.)
  • Experience with modern, cloud-native and open-source tools is highly valued:

? Apache Iceberg

? Apache Airflow

? Trino

  • Strong experience in modern data engineering and big data ecosystems / frameworks
  • Hands-on experience working in scalable data platforms and analytical solutions using data Lakehouse architecture
  • Knowledge and experience with machine learning concepts for automation development
  • Familiarity with cloud platforms (e.g. Azure , AWS ) and their data related services
  • Experience with dedicated data observability tools(Monte Carlo, Acceldata) or broad monitoring stacks (Datadog, Grafana, Prometheus) a plus
  • Proven ability to go beyond data movement and contribute to solution design
  • Strong communication and presence - able to translate between technical and non-technical audiences
  • Proven ability to bridge the gap between business and engineering teams
  • Collaborative mindset with experience working across cross-functional teams
  • Strong problem-solving and critical thinking skills, Successful candidates must demonstrate appropriate knowledge, skills, and abilities for a role. Listed below are skills, competencies, work experience, education, and required certifications/licensures needed to be successful in this position.

Preferred Skills

Big Data, Data Architecture Development, Database Management, Data Governance, Data Migrations, Data Modeling, Data Pipelines, Data Warehousing (DW), Python (Programming Language), Structured Query Language (SQL)

Competencies

Application Delivery Process, Big Data Management and Analytics, Business Intelligence, Data Analysis - Software, Data Architecture, Database Structures, Effective Communications, Problem Solving, Software Development Life Cycle

Work Experience

Roles at this level typically require a university / college degree, with 3+ years of relevant / direct industry experience. Certifications are often desired. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered.

Education

Bachelors

Benefits & conditions

PNC offers a comprehensive range of benefits to help meet your needs now and in the future. Depending on your eligibility, options for full-time employees include: medical/prescription drug coverage (with a Health Savings Account feature), dental and vision options; employee and spouse/child life insurance; short and long-term disability protection; 401(k) with PNC match, pension and stock purchase plans; dependent care reimbursement account; back-up child/elder care; adoption, surrogacy, and doula reimbursement; educational assistance, including select programs fully paid; a robust wellness program with financial incentives.

In addition, PNC generally provides the following paid time off, depending on your eligibility: maternity and/or parental leave; up to 11 paid holidays each year; 9 occasional absence days each year, unless otherwise required by law; between 15 to 25 vacation days each year, depending on career level; and years of service.

To learn more about these and other programs, including benefits for full time and part-time employees, visit pncthrive.com .

About the company

For nearly 160 years, PNC has strived to make a meaningful impact for our employees, customers, communities, and shareholders. We believe our success and positive reputation are built on open and honest dialogue, an unwavering focus on smart risk management, relationship-based customer service and community investments. Our inclusive workplace allows our employees to be heard, valued, and developed to do their best work.

Being a great place to work means we are making a lasting difference for everyone we serve. Check out the top reasons to join PNC.

PNC’s total rewards package includes things like time off, benefits, learning and career development, wellness programs, recognition and much more. The benefits and programs highlighted below are just a sampling of what PNC offers its employees. To learn more, visit our Total Rewards page (https://careers.pnc.com/global/en/total-rewards) .

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dallasjobsite.com
Prepare application

Good distractions

Loading talks and stories from around this role…