Senior Data Engineer

Intersources Inc.
United States
5 days ago
Apply on www2.jobdiva.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$25,000.0
Working hours
Regular working hours

Tech stack

Agile Methodology Computer Networks Data Integrity DevOps Data Flow Control Systems Development Life Cycle Computer Network Technologies Apache Nifi Data Pipelines

Job description

  • Lead the migration of dataflow projects, ensuring seamless transition and minimal disruption to operations.
  • Design, deploy, and manage large-scale data pipelines using Apache NiFi, optimizing for performance and reliability.
  • Develop and validate field extraction processes to ensure data integrity and accuracy.
  • Collaborate with cross-functional teams to implement Agile methodologies, particularly Kanban, to enhance project delivery.
  • Troubleshoot and resolve issues related to dataflows, leveraging strong OS and networking knowledge to identify root causes.

Requirements

  • Proven experience in deploying and managing large dataflow projects and data pipelines.
  • Strong understanding of cloud platforms and on-premises systems, with hands-on experience in migration projects.
  • Proficiency in developing and validating field extraction processes.
  • Solid knowledge of OS and networking concepts, with demonstrated troubleshooting skills.
  • Familiarity with DevOps practices and SDLC methodologies, particularly in Agile environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www2.jobdiva.com
Prepare application

Good distractions

Loading talks and stories from around this role…