Data Bricks Engineer with AWS - Local to MA

Binary Computer Int'l Corp.
Boston, MA, United States
8 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Cloud Database System Configuration Information Engineering Extract Transform Load (ETL) Data Transformation Database Queries Distributed Computing Environment Job Scheduling Query Optimization Data Processing Data Ingestion
+3 more
Apache Spark Data Pipelines Databricks

Requirements

  • 12 years of overall experience in Scala/Spark data engineering and data pipeline design.
  • Strong hands-on experience with Scala and Apache Spark programming.
  • Strong SQL skills, including complex queries, joins, aggregations, and query optimization.
  • Hands-on experience designing and developing data ingestion pipelines, ETL pipelines, and data processing jobs.
  • Experience with AWS services and cloud-based data engineering solutions.
  • Strong understanding of distributed data processing, data transformations, and pipeline architecture.
  • Experience troubleshooting and optimizing Spark applications and data workflows.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to participate in technical coding assessments and explain implementation decisions.

Preferred Skills

  • Hands-on experience with Databricks.
  • Experience configuring and managing Databricks workspaces and clusters.
  • Experience with Databricks job scheduling and workflow management.
  • Experience developing and maintaining production-grade ETL and ingestion pipelines in Databricks.
  • Familiarity with data quality, pipeline monitoring, and production support practices.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…