Data Engineer

HANSTON INSURANCE AGENCY, INC.
Woodbridge Township, NJ, United States
22 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$92,300.0 - $166,850.0
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Batch Processing Big Data Cloud Computing Security Cloud Engineering Cloud Storage Computer Programming Data Architecture Information Engineering Extract Transform Load (ETL)
+18 more
Data Systems Identity and Access Management Python (Programming Language) Performance Tuning Query Optimization SQL Databases Data Streaming Sql Optimization Pyspark Gitlab-ci AWS Glue AWS Data Analytics Apache Kafka Spark Streaming Data Management Data Pipelines Jenkins Databricks

Job description

Data Pipelines - Build and maintain scalable ingestion and ETL pipelines on AWS. AWS Data Services - Work with S3, Redshift, Glue, Lambda, and Databricks for batch processing. SQL Engineering - Write optimized SQL for large datasets and analytical workloads. Cloud Architecture - Design secure, high-performance data solutions using IAM best practices. Data Quality - Ensure accuracy, consistency, and governance across data platforms. Collaboration - Work with cross-functional teams in Agile environments.

Requirements

Seeking an AWS Data Engineer with strong hands-on experience in SQL, AWS S3/Redshift, Glue, and Databricks to build scalable data pipelines, optimize data flows, and support cloud-native analytics workloads., Advanced SQL - Query tuning, performance optimization AWS S3/Redshift - Strong experience with cloud storage + warehouse AWS Glue - ETL development, job orchestration Databricks - Spark-based transformations and pipelines Python/PySpark - Hands-on programming for large-scale data processing IAM & Security - Strong understanding of roles, policies, and cloud security DevOps - Jenkins/GitLab CI/CD pipelines Agile - Experience with Agile delivery frameworks Nice to Have Kafka/Spark Streaming - Real-time ingestion DBT - Data modeling & transformations, Required Skills & Qualifications * Strong experience in data engineering, ETL (preferably Informatica), and data architecture * Experience working with Salesforce platforms and…

  • 1 month ago

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:02 min

Applying an ETL methodology to infrastructure configuration management

Axel Barbier · World Congress 2023

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all