Principal Engineer - Network Tools and Observability

Wells Fargo
Chandler, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 305K

Job location

Remote
Chandler, United States of America

Tech stack

Amazon Web Services (AWS)
Business Analytics Applications
Azure
Border Gateway Protocol
Software as a Service
Cloud Computing
Configuration Management Databases
Computer Security
Computer Networks
Continuous Integration
Dynamic Host Configuration Protocol
DNS
Python
Network Security
Log Analysis
Netconf
NetFlow
Network Architecture
Packet Analyzer
Reliability Engineering
Ansible
Prometheus
Simple Network Management Protocols
Data Streaming
Syslog
Traffic Analysis
Wide Area Networks
Computer Networking Systems
Grafana
Firewalls (Computer Science)
Amazon Web Services (AWS)
NetScout
Data Analytics
Enterprise Integration
Npm(Software)
Virtual Agents
REST
Terraform
Splunk
Appdynamics
Webhooks
ServiceNow

Job description

  • Strategy & Roadmap: Advise leadership on multi-year strategy for network tools and observability (NPMD, telemetry pipelines, topology, synthetic monitoring), aligned with SRE, Security, and Cloud initiatives.
  • Architecture: Design and evolve the observability stack, selecting tools and technologies (e.g., SNMP, flow/IPFIX, syslog, streaming telemetry/gNMI, OpenTelemetry, APM/NPM, log analytics, time-series DB) for scalability across on-prem, cloud, and branch environments.
  • Delivery Leadership: Oversee implementation and integration with ITSM/CMDB, CI/CD, configuration compliance, and ITIL-based incident/problem/change workflows.
  • Cross-Functional Collaboration: Partner with NetOps, SRE, SecOps, Cloud, and Lines of Business to translate requirements into architecture and measurable outcomes.
  • Blueprints & Standards
  • Define baselines for telemetry and data collection:
  • SNMP polling and SNMP traps
  • Syslog ingestion and correlation
  • Flow data (NetFlow, sFlow, IPFIX, etc.)
  • Packet capture tools for deep traffic analysis
  • Integration with vendor-based controllers and SaaS platforms
  • Define tooling standards across platforms such as:
  • Spectrum, DX NetOps, NFA
  • Big Switch / DMF, CVP / CVaaS / DCNM
  • DNAC / CatC, NetScout / GigaMon
  • Prime / Airwave / CV-Cue
  • Enterprise Impact:
  • Lead resolution of complex challenges requiring deep evaluation across multiple domains.
  • Translate strategic business objectives and enterprise technology landscape into engineering solutions.
  • Provide vision and technical direction to leadership for innovative, large-scale solutions.
  • Operational Excellence:
  • Optimize processes and drive robust automation.
  • Identify inefficiencies and promote continuous improvement.
  • Leadership & Mentorship:
  • Align stakeholders through clear technical communication.
  • Mentor teams and deliver knowledge transfers to upskill SMEs.
  • Present technical concepts to senior leaders.

Requirements

  • 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 7+ years in large-scale network engineering/operations, with 5+ years focused on tooling and observability., * Expert knowledge of enterprise networks (L2/L3, BGP/EVPN, DC fabrics, SD-WAN, SASE, firewalls, LB, DNS/DHCP/IPAM) and cloud networking (Azure/AWS/GCP: VNet/VPC, Transit, Direct Connect/ExpressRoute).
  • Deep experience with telemetry & tooling: SNMP, NetFlow/IPFIX/sFlow, syslog, streaming telemetry (gNMI/NETCONF/RESTCONF), synthetic monitoring, path analytics, and topology.
  • Hands-on experience with tools such as ThousandEyes, AppDynamics, Splunk/Elastic, Prometheus/Grafana, ServiceNow.
  • Automation and integration skills: Python, Ansible, Terraform, CI/CD, REST APIs, webhooks, event pipelines.
  • Strong grasp of SRE principles (SLIs/SLOs/error budgets), reliability and resilience (RTO/RPO, DR, chaos engineering).
  • 5+ years of technical design experience.
  • 5+ years of network or network security design experience.
  • Strong knowledge of end-to-end network architecture and protocols.
  • Excellent communication and technical writing skills.
  • Ability to define business requirements and align them with tooling strategy.
  • Ability to translate complex technical needs into clear, actionable collaboration.
  • Proven leadership and mentoring capabilities.

Job Expectations:

  • Ability to travel up to 20% of the time
  • This role is not eligible for Visa Sponsorship
  • This is a hybrid position with 3 days in office and 2 days remote

Pay Range

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to demonstrated examples of prior performance, skills, experience, or work location. Employees may also be eligible for incentive opportunities.

Benefits & conditions

Wells Fargo provides eligible employees with a comprehensive set of benefits, many of which are listed below. Visit Benefits - Wells Fargo Jobs (https://www.wellsfargojobs.com/en/life-at-wells-fargo/benefits) for an overview of the following benefit plans and programs offered to employees.

  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Scholarships for dependent children
  • Adoption reimbursement

Posting End Date:

6 Jul 2026

***** Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.

About the company

Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy (https://www.wellsfargojobs.com/en/wells-fargo-drug-and-alcohol-policy) to learn more. Wells Fargo Recruitment and Hiring Requirements: a. Third-Party recordings are prohibited unless authorized by Wells Fargo. b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.

Apply for this position