Big Data Engineer / Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+10 more
Job description
- Build and maintain large-scale data platforms in the financial domain.
- Contribute to data engineering, platform stability, and deployment automation.
- Partner with business, risk, compliance, and architecture teams to deliver data solutions.
- Develop on Big Data platforms using Hadoop ecosystem components including HDFS, Hive, Spark, and YARN.
- Design and operate streaming pipelines using Kafka or similar technologies.
- Translate business requirements into scalable data solutions and technical implementations.
- Troubleshoot and optimize data processing jobs across batch and streaming workloads.
- Ensure data quality, performance, and reliability across systems.
- Implement and maintain CI/CD pipelines with tools such as Jenkins and GitHub Actions.
- Support automated deployments and release processes using infrastructure as code.
- Monitor and troubleshoot platforms using tools like Splunk to improve reliability and efficiency.
Requirements
We are seeking a Big Data Engineer / Data Platform Engineer to join our dynamic team. The ideal candidate will have strong experience in Big Data technologies, data engineering, and distributed systems and a proven ability to deliver scalable data platforms, optimize pipelines, and improve operational reliability., * Hands-on experience with Big Data technologies and distributed systems.
- Proficiency with Hadoop ecosystem: HDFS, Hive, Spark, and YARN.
- Experience building and optimizing batch and streaming data pipelines, preferably with Kafka.
- Experience implementing CI/CD and automated deployments using tools such as Jenkins and GitHub Actions.
- Exposure to infrastructure as code and platform monitoring with Splunk or similar tools.
- Demonstrated leadership and client relationship skills with a strong professional work ethic.
- Ability to work under pressure and deliver on time, individually and within a team.
Preferred Skills:
- Experience with Git-based workflows and release management in regulated environments.
- Background in financial services data platforms.
Schedule & Start Details:
- Hybrid schedule with a minimum of 3 days per week onsite.
- Start date targeted within 2 to 4 weeks after offer to meet business needs.
- Glider candidate ID verification required.
Benefits & conditions
- Competitive compensation and benefits.
- Opportunities for growth with global clients.
- A supportive, inclusive culture that values innovation and people.
- Exposure to cutting-edge technologies and projects.
About the company
BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦