Principal Data/Software Engineer
Role details
Job location
Tech stack
Job description
-
Serves as a Principal Data Engineer: to design, develop and implement end-to-end data pipelines for ingestion, transformation, and distribution, supporting both batch and streaming workloads in accordance with FedNow and Fed Standards.
-
Develops software solutions that are reusable, well-documented, and optimized for Analytics, BI, and AI/ML consumers. Implements and manages modern data lake and Lakehouse architectures, including Apache Iceberg table formats.
-
Optimizes data platforms for performance, scalability, cost efficiency, and reliability. Collaborates closely with architects, product managers, analytics teams, and platform engineers to align data solutions with business needs.
-
Defines and enforces data quality standards, implementing automated validation and monitoring.
-
In addition to being able to engineer across numerous areas of technology, you'll serve as subject matter expert in one or more areas
-
Trains and consults cross functionally within the organization on troubleshooting/resolving highly complex and/or highly time critical problems
-
Collaborates with analysts as part of an integrated Agile team to define user requirements and conduct design review for the development of complex and innovative cloud applications using modern internet-scale technologies and Serverless architecture in Cloud
-
Demonstrates skill dexterity; seeking to continuously adapt and employ new technical skills alongside proven staples
-
Ensures that the quality of software developed, maintained and enhanced in-house and installed into production is sufficient to prevent the occurrence of catastrophic defects that cause the customer significant problems, missed deadlines, or interruption to the production environment
-
Ensure compliance with Fed policies, procedures and standards
-
Provides primary or backup production support for applications and components, including but not limited to timely resolution to production problems and processing issues
Requirements
Top level technical expert in one or more highly specialized areas of applications systems analysis and programming. Responsible for software design, coding, testing, debugging, and documentation. Has full technical knowledge of all phases of applications systems analysis and development. Provides technical leadership on complex projects. Interacts with internal project teams and work groups regularly. Level of work required is considered highly advanced and staff must be able to work under minimal supervision. This job does not have any direct reports. You have an appetite to learn, and a passion for technology, innovation, and developing new skills on evolving technologies., + 8+ years of implementing data-intensive solutions using agile methodologies (Scrum, Kanban, Lean etc).
- 4+ years working with AWS cloud-based platforms in an enterprise environment.
- Experience designing and building performant, resilient big data solutions.
- Deep expertise in programming languages used in data engineering such as Python and Java.
- Experience developing high performance, high volume, highly available
- (24/7/365) environments
- Experience with Agile software engineering (Scrum, Kanban, Lean etc)
- Bachelor's degree in Computer Science, Information Systems,
Logistics& Requirements-
- Deep expertise in Python and Java and proficient knowledge of programming languages (JavaScript, XML, JSON, HTML, CSS etc.)
- Proficient knowledge of operating systems (Linux, Unix, Windows)
- Proficient knowledge of database development (SQL, Oracle, DB2)
- Ideally, you'll have experience with AWS services, and integrating them into an application
- Ideally you'll have experience with leading edge Cloud technologies, such as Kafka, in-memory and NoSQL databases, messaging platforms, memcache etc).
- Demonstrates independent thinking and decision-making abilities
- Demonstrates excellent written and oral communication abilities
- Proficient knowledge of cloud security for application development and delivery
- Advanced knowledge of object-oriented programming
- Ideally, Infrastructure as Code (IAC); Terraform
Nice to Have-
- Experience with API Development and consumption and microservices architecture
- Experience with agile development methodology
- Knowledge of technology project and secure coding standards
- Strong interpersonal, teamwork and negotiation skills
- Strong customer service skills
- Strong problem solving and critical thinking skills
- Familiarity with usability techniques and best practices
- Infrastructure as Code (IAC); Terraform
Benefits & conditions
The salary range for this position is $173,400.00 - $216,700.00 - $260,000.00. The Boston Fed believes in salary transparency. The final salary and offer will be determined by the applicant's background, skills, internal equity, and alignment with market data. Whether you're developing into the job or are a more seasoned candidate, we aim to pay competitively. The position and job description posted is for a Principal Software Engineer however, candidates will be placed in an appropriate level within the Software Engineer job family based on the extent of their experience. If you reside outside of the 1st District, you may be hired by your local Federal Reserve District and compensation will follow hiring District's range and policy.