Senior Java PySpark Developer-3

Realign Llc

Irving, TX, United States

11 days ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$160,000.0

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Java (Programming Language) Unit Testing Big Data Code Review Continuous Integration Data Structures Software Debugging Software Design Patterns DevOps Distributed Systems Django Web Framework Python (Programming Language)

+10 more

SQL Databases Web Application Frameworks Data Processing Snowflake Git Fastapi Pyspark Restful APIs Software Version Control Microservices

Job description

Design, develop, and maintain robust, scalable, and high-performance applications using Java, PySpark/Python.
Lead the architecture and design of complex software systems and ensure adherence to best practices.
Collaborate with product managers, designers, and other developers to define project requirements and deliverables.
Optimize and refactor existing codebases for performance, scalability, and maintainability.
Mentor junior developers and provide technical guidance to the team.
Integrate third-party APIs, libraries, and tools into applications.
Write unit tests, perform code reviews, and ensure high code quality.
Work with DevOps teams to deploy and monitor applications in production environments.
Stay updated with the latest trends and advancements in Java and Python and related technologies.

Requirements

We are seeking a seasoned Senior Lead Data Engineer with a dual-threat background in robust backend development and large-scale data processing. You ae a self-starter who thrives in high-complexity environments and processes the architecture maturity to take a project from a blank page to a production-ready ecosystem without hand-holding., * 8+ years of professional experience in Java, PySpark/Python development.

Strong understanding of Python frameworks such as Django, Flask, or FastAPI.
Expertise in building Java RESTful APIs and microservices architecture.
Solid understanding of software design patterns, algorithms, and data structures.
Hands-on experience with Big Data Environment.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Strong debugging and problem-solving skills.
Excellent communication and collaboration skills.

Good to Have Skills:

Experience with Java and PySpark/Python development creating data processing pipeline and frameworks.
Knowledge on CICD process to code versioning and deployments in various environment.
Resource should have good knowledge on Big Data environments and distributed architecture.
Knowledge on Snowflake is an added advantage.