Need Sr. Hadoop Developer with AB Initio, Spark, Python & Health Insurance experience:: Jacksonville, FL (Hybrid)

Synergy Technologies, LLC
Jacksonville, FL, United States
17 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Integration Architecture Batch Processing Big Data Computer Programming Data Validation Data Integration Extract Transform Load (ETL) Data Transformation Data Migration Data Systems Data Warehousing Software Debugging
+16 more
Distributed Computing Environment Apache Hadoop Python (Programming Language) Performance Tuning Query Optimization SQL Stored Procedures SQL Databases Data Processing Scripting Freeform SQL Cloud Platform System Sql Optimization Snowflake Apache Spark Ab Initio Data Pipelines

Job description

We are seeking an experienced Senior Hadoop Developer with strong expertise in AB Initio, Hadoop, Spark, Python, SQL, and Stored Procedures. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions, building ETL/ELT pipelines, and managing complex data integration workflows. Experience with Snowflake is a plus., * Design, develop, and maintain scalable data processing solutions using Hadoop and Apache Spark.

  • Develop and enhance ETL workflows using AB Initio for data integration and transformation.
  • Write efficient Python scripts for data processing, automation, and application integration.
  • Develop, optimize, and maintain complex SQL queries, Stored Procedures, and database operations.
  • Build and support large-scale data pipelines for batch processing and data transformation.
  • Perform data validation, reconciliation, troubleshooting, and performance tuning.
  • Optimize Spark jobs and Hadoop workloads to improve processing efficiency and scalability.
  • Collaborate with data engineers, architects, business analysts, and other technical teams to deliver data solutions.
  • Ensure data quality, consistency, reliability, and adherence to established development standards.
  • Preferred: Work with Snowflake for cloud data warehousing, data loading, and query optimization.

Requirements

  • Strong hands-on experience with AB Initio.
  • Proficiency in Hadoop ecosystem and distributed data processing.
  • Strong experience with Apache Spark.
  • Programming expertise in Python.
  • Advanced SQL and Stored Procedures development and optimization.
  • Experience developing and maintaining ETL/ELT data pipelines.
  • Strong analytical, debugging, and performance-tuning skills.

Preferred Skills:

  • Hands-on experience with Snowflake.
  • Experience with cloud-based data platforms and data warehousing.
  • Knowledge of data migration, data quality, and large-scale data integration.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…