Principal ETL Developer

Leidos, Inc.
Bethesda, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 237K

Job location

Bethesda, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Cluster Analysis
Code Review
Collaborative Learning
Computer Programming
Databases
Data as a Services
ETL
Data Security
Database Queries
DevOps
Memory Management
Amazon DynamoDB
Elasticsearch
Industry Standard Architecture
PostgreSQL
Network Connections
NoSQL
Performance Tuning
Software Engineering
Data Streaming
Systems Integration
Scripting (Bash/Python/Go/Ruby)
Load Balancing
Real Time Systems
System Availability
Kafka
Apache Nifi
Data Management
Amazon Web Services (AWS)
Oracle Cloud Infrastructure
Data Pipelines

Job description

We have an IMMEDIATE NEED for a Principal ETL developer to play a pivotal role in shaping, leading, and implementing cutting-edge data flow solutions centered around Apache NiFi. The candidate will provide technical expertise and support in the design, development, implementation and testing of customer tools and applications in support of Extracting, Transforming and Loading (ETL) of data into an enterprise Data Lake. The candidate will be responsible for defining architectural best practices, optimizing performance in large-scale environments, and mentoring junior developers, ensuring the delivery of robust, scalable, and secure data flow solutions that drive critical customer needs. Based in a DevOps framework, the ETL Developer participates in and directs major deliverables of projects through all aspects of the software development lifecycle.

This is a hybrid position. You must be able and willing to periodically commute into Bethesda, MD for meetings with the team.

**A TS/SCI w/ Poly is required, for consideration.

Primary Responsibilities:

  • Architecting complex NiFi data pipeline design: Design and develop enterprise-level ETL architectures and implement NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
  • Performance optimization and tuning: Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.
  • Advanced troubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.
  • Integrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating expertise in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS).
  • Defining best practices and standards: Establish best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.
  • Documentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations.
  • Collaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions and effectively communicate complex technical concepts to both technical and non-technical audiences.
  • Mentorship and team leadership: Mentor junior developers, provide technical guidance, conduct code reviews, and foster a collaborative learning environment.

Requirements

  • In-depth experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.
  • In-depth knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability.
  • Proficiency in programming languages like Java and Python for custom NiFi processor development and scripting for automation.
  • Proficiency writing and optimizing complex queries, along with experience in managing relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
  • Direct experience with real-time streaming, and API integration (REST) for seamless data connectivity.
  • Direct experience with cloud platforms like AWS, Azure, or OCI and related data services
  • Strong ability to analyze complex data challenges, identify root causes, and implement effective solutions.
  • Strong ability to collaborate effectively with cross-functional teams, articulate technical concepts clearly, and provide effective mentorship.
  • Bachelor's degree with 12+ years of prior relevant experience or Master's with 10+ years of relevant experience., * In-depth experience deploying ETL solutions in an AWS environment.

Benefits & conditions

Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at www.leidos.com/careers/pay-benefits .

About the company

Leidos has an exciting opportunity for a Principal ETL Developer in our National Security Sector's (NSS) Cyber & Analytics Business Area (CABA) . Our talented team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, Analytical Methods and Modeling, Signals Intelligence (SIGINT), and Cryptographic Key Management. At Leidos , we offer competitive benefits , including Paid Time Off, 11 paid Holidays, 401K with a 6% company match and immediate vesting, Flexible Schedules, Discounted Stock Purchase Plans, Technical Upskilling, Education and Training Support, Parental Paid Leave, and much more. Join us and make a difference in National Security!, If you're looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo - because the mission demands it. We're not hiring followers. We're recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We're already at step 30 - and moving faster than anyone else dares., Leidos is an industry and technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. Headquartered in Reston, Virginia, with 47,000 global employees, Leidos reported annual revenues of approximately $16.7 billion for the fiscal year ended January 3, 2025. For more information, visit www.Leidos.com .

Apply for this position