Principal IT Data Engineer - Data & Analytics

Palo Alto Networks
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 271K

Job location

Tech stack

Artificial Intelligence
Airflow
Business Analytics Applications
Business Intelligence
Big Data
Google BigQuery
Cloud Computing
Cloud Engineering
Computer Security
Databases
Information Engineering
ETL
Data Systems
Data Warehousing
Data Flow Control
Python
Object-Oriented Software Development
Cloudera
Salesforce
Software Engineering
SQL Databases
Systems Integration
Tableau
Freeform SQL
Google Cloud Platform
Cloud Platform System
Spark
Generative AI
Data Lake
Information Technology
Palo Alto Networks
Data Analytics
Kafka
Data Management
Data Objects
Data Pipelines

Job description

Our Data & Analytics group is responsible for working with various business owners/stakeholders from Sales, Marketing, People, GCS, Infosec, Operations, and Finance to solve complex business problems which will have a direct impact on the metrics defined to showcase the progress of Palo Alto Networks. We leverage the latest technologies from the Cloud & Big Data ecosystem to improve business outcomes and create through prototyping, Proof-of-Concept projects and application development. We are looking for a Principal IT Data Engineer with extensive experience in Data engineering, SQL, Cloud engineering and business intelligence (BI) tools. The ideal candidate will be responsible for architecting, designing, implementing, and maintaining scalable data transformations and analytical solutions that support our business objectives. This role requires a strong understanding of data engineering principles, as well as the ability to collaborate with cross-functional teams to deliver high-quality data solutions., * Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.

  • Aptitude for proactively identifying and implementing GenAI-driven solutions to achieve measurable improvements in the reliability and performance of data pipelines or to optimize key processes like data quality validation and root cause analysis for data issues, is a nice-to-have.
  • Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
  • Optimize and tune existing data pipelines and transformations for performance, reliability, and scalability.
  • Implement data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.
  • Work closely with the BI team to design and develop dashboards, reports, and analytical tools that provide actionable insights to stakeholders.
  • Mentor junior members of the team and provide guidance on best practices for data engineering and BI development.
  • Drive new and improved processes to increase engineer productivity.
  • Good to have a trusted technical advisor / thought leader, identifying and integrating emerging technologies (e.g., AI/ML, agentic frameworks, AI-first architectures, cloud-native platforms) and guiding teams to adopt innovative best practices that ensure systems remain adaptable and future-ready.

Requirements

  • Minimum of 12 years of related experience with a Bachelor's degree in Computer Science, Engineering, or a related field or 8 years and a Master's degree; or a PhD with 5 years experience.
  • 5+ years of experience in data engineering, with a focus on building and maintaining data pipelines and analytical solutions.
  • Expertise in SQL programming and database management systems.
  • Hands-on experience with ETL tools and technologies such as Apache Spark and Apache Airflow.
  • Experience with cloud platforms (preferably Google Cloud Platform) and services like Dataflow, DataProc, BigQuery, and Cloud Composer.
  • Experience in AI Tools and good understanding of implementing AI in development lifecycle is mandatory
  • Demonstrated readiness to leverage GenAI tools to enhance efficiency within the typical stages of the data engineering lifecycle, for example by generating complex SQL queries, creating initial Python/Spark script structures, or auto-generating pipeline documentation, is a nice-to-have.

Preferred Qualifications

  • Experience with Big Data tools like Kafka.
  • Proficiency in object-oriented or object-functional scripting languages such as Python or Scala.
  • Experience with BI visualization platforms like Tableau.
  • Familiarity with SFDC Data Objects (e.g., Opportunity, Quote, Accounts).
  • Aptitude for leveraging GenAI tools to enhance efficiency in the data engineering lifecycle.

Benefits & conditions

The compensation offered for this position will depend on qualifications, experience, and work location. For candidates who receive an offer at the posted level, the starting base salary (for non-sales roles) or base salary + commission target (for sales/com-missioned roles) is expected to be the annual range listed below. The offered compensation may also include restricted stock units and a bonus. A description of our employee benefits may be found here.

$167,000.00 - $270,500.00/yr

Our Commitment

We're trailblazers that dream big, take risks, and challenge cybersecurity's status quo. It's simple: we can't accomplish our mission without diverse teams innovating, together.

Apply for this position