Data Engineer
The Judge Group
Union City, NJ, United States
13 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Agile Methodology
Airflow
Amazon Web Services
Amazon S3
JIRA
Continuous Integration
Information Engineering
Data Migration
Data Systems
Data Warehousing
Identity and Access Management
+17 more
JSON
Python (Programming Language)
Cloud Services
Shell Script
Parquet
Test-Driven Development (TDD)
Apache Spark
HybridCloud
Git
Pyspark
Solid Principles
Kubernetes
Avro
Data Management
Restful APIs
Data Pipelines
Jenkins
Job description
We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud-native data platforms and pipelines. You will lead the development of robust data solutions, drive architectural decisions, and mentor engineers while ensuring reliability, security, and operational excellence., * Design and develop large-scale data pipelines and data platforms.
- Build cloud-native solutions using AWS services and Spark.
- Lead data modeling, warehousing, migration, and analytics initiatives.
- Improve system performance, resilience, monitoring, and automation.
- Collaborate with cross-functional teams and mentor junior engineers.
Requirements
- Strong proficiency in Python and/or Java with Spark/PySpark.
- Experience with Data Pipelines, Data Modeling, Data Warehousing, and Data Migration.
- Hands-on experience with AWS (Glue, EMR, S3, Athena, Kinesis/MSK, Airflow, Lambda, Step Functions, Lake Formation).
- Knowledge of Kubernetes, CI/CD, Agile methodologies, and software design principles.
- Experience with data formats such as Parquet, Iceberg, Avro, or JSON.
- Understanding of AWS security concepts including IAM, KMS, Encryption, and Secrets Manager.
Preferred Qualifications
- Experience building REST APIs using Java.
- Knowledge of Hybrid Cloud architectures.
- Exposure to Jenkins, Git, Linux Scripting, JIRA, and TDD.
- Strong leadership, problem-solving, and communication skills.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦