Data Engineer II

At LPL Financial we consider it our mission to take care of our advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the sustainable, scalable capabilities that support delivery of the highest standards of software products, processes for our Advisors and End Clients., * Design, develop, and maintain Python-based applications and services.

• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform skills for infrastructure as code.
• Ensure application security, scalability, and performance.
• Communicate effectively with stakeholders and team members, providing clear documentation and status updates.

What are we looking for?

We want strong collaborators who can deliver a world-class client experience. We are looking for people who thrive in a fast-paced environment, are client-focused, team oriented, and are able to execute in a way that encourages creativity and continuous improvement.

• Minimum of 3 years of Proficiency in Python and related frameworks (e.g., Flask, FastAPI, Django).
• Minimum of 2 Strong experience with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.

Core Competencies:

• Excellent knowledge of OOP concepts, data modeling design patterns/frameworks using Search, Index, and Distribute Caching tools such as Coherence, Apache Solr, etc.
• Experience with Agile development process
• Excellent knowledge in designing and developing micro services
• Ability to lead design discussions with Architecture Team
• Good analytical, problem solving skills, communication, and documentation skills
• Ability to handle multiple projects and with strong interpersonal skills and ability to work in a collaborative team environment
• Great track record of implementing the distributed systems with legacy and modern technical tools
• Problem-solving mindset with attention to detail.
• Ability to adapt to changing priorities and technologies.
• Strong collaboration and proactive communication.
• Eagerness to learn new technologies and continuously improve skills.

Preferences:

• AWS Associate-level certifications (e.g., AWS Certified Developer - Associate, AWS Certified Solutions Architect - Associate).
• Additional AWS or cloud-related certifications are a plus.
• Experience with Kong API Gateway.
• Familiarity with GitHub Copilot and other AI-assisted development tools.
• Basic knowledge of Terraform for infrastructure automation.
• Experience with Agile Scrum methodology and tools like JIRA.
• Familiarity with Kafka for event-driven architectures.
• Strong understanding of TDD and unit testing frameworks (pytest, unittest).

Pulled from the full job description

• Health insurance
• 401(k) matching
• Paid time off
• Stock options
• Volunteer time off, Actual base salary varies based on factors, including but not limited to, relevant skill, prior experience, education, base salary of internal peers, demonstrated performance, and geographic location. Additionally, LPL Total Rewards package is highly competitive, designed to support your success at work, at home, and at play - such as 401K matching, health benefits, employee stock options, paid time off, volunteer time off, and more. Your recruiter will be happy to discuss all that LPL has to offer!

LPL Financial Holdings Inc. (Nasdaq: LPLA) is among the fastest growing wealth management firms in the U.S. As a leader in the financial advisor-mediated marketplace(6) , LPL supports over 32,000 financial advisors and the wealth management practices of approximately 1,100 financial institutions, servicing and custodying approximately $2.3 trillion in brokerage and advisory assets on behalf of approximately 8 million Americans. The firm provides a wide range of advisor affiliation models, investment solutions, fintech tools and practice management services, ensuring that advisors and institutions have the flexibility to choose the business model, services, and technology resources they need to run thriving businesses. For further information about LPL, please visit www.lpl.com. At LPL, independence means that advisors and institution leaders have the freedom they deserve to choose the business model, services, and technology resources that allow them to run a thriving business. They have the flexibility to do business their way. And they have the freedom to manage their client relationships, because they know their clients best. Simply put, we take care of our advisors and institutions, so they can take care of their clients.