Senior Data Engineer
Intersources Inc.
United States
5 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$25,000.0
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Computer Networks
Data Integrity
DevOps
Data Flow Control
Systems Development Life Cycle
Computer Network Technologies
Apache Nifi
Data Pipelines
Job description
- Lead the migration of dataflow projects, ensuring seamless transition and minimal disruption to operations.
- Design, deploy, and manage large-scale data pipelines using Apache NiFi, optimizing for performance and reliability.
- Develop and validate field extraction processes to ensure data integrity and accuracy.
- Collaborate with cross-functional teams to implement Agile methodologies, particularly Kanban, to enhance project delivery.
- Troubleshoot and resolve issues related to dataflows, leveraging strong OS and networking knowledge to identify root causes.
Requirements
- Proven experience in deploying and managing large dataflow projects and data pipelines.
- Strong understanding of cloud platforms and on-premises systems, with hands-on experience in migration projects.
- Proficiency in developing and validating field extraction processes.
- Solid knowledge of OS and networking concepts, with demonstrated troubleshooting skills.
- Familiarity with DevOps practices and SDLC methodologies, particularly in Agile environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦