Lead Software Engineer

RapidIT, Inc
New York, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

New York, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Data analysis
Big Data
Computer Programming
Data Validation
Data Governance
Data Security
Data Systems
Python
Cloud Services
Enterprise Data Management
Data Processing
Freeform SQL
Snowflake
Spark
Backend
PySpark
Kafka
Data Pipelines
Redshift
Microservices

Requirements

Hands On programming experience and build scalable pipelines using Java, Python, Spark, PySpark.

Design and optimize enterprise data warehouses within AWS and Snowflake.

Good hands-on design and programming skills building reusable tools and products

Expertise in Data Governance and Data Security Implementation.

Deploy, manage, and monitor cloud-native data architectures on AWS.

Write clean, maintainable backend code for high-throughput data processing.

Optimize slow-running Spark jobs and complex SQL queries for performance.

Create robust data models, schemas, and automated orchestration workflows.

Implement strict data quality checks, governance, and security controls.

Translate business needs into efficient and cost-effective data solutions.

Experience developing in AWS or similar cloud platforms.

Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).

Experience and build scalable pipelines using Java, Python, Spark, PySpark. Experience in programming in AWS and Python.

Should have expertise in performing data analysis (NOT DATA SCIENCE) on AWS platforms Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

Apply for this position