Big Data Engineer / Data Platform Engineer

BC Forward
Charlotte, NC, United States
10 days ago
Apply on www.disabledperson.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Big Data Continuous Delivery Information Engineering Data Infrastructure Data Systems Distributed Systems Github Apache Hadoop Hadoop Distributed File System Apache Hive Release Management Data Streaming
+10 more
Data Processing Apache Yarn Apache Spark Git Flow Deployment Automation Apache Kafka Data Management Splunk Data Pipelines Jenkins

Job description

  • Build and maintain large-scale data platforms in the financial domain.
  • Contribute to data engineering, platform stability, and deployment automation.
  • Partner with business, risk, compliance, and architecture teams to deliver data solutions.
  • Develop on Big Data platforms using Hadoop ecosystem components including HDFS, Hive, Spark, and YARN.
  • Design and operate streaming pipelines using Kafka or similar technologies.
  • Translate business requirements into scalable data solutions and technical implementations.
  • Troubleshoot and optimize data processing jobs across batch and streaming workloads.
  • Ensure data quality, performance, and reliability across systems.
  • Implement and maintain CI/CD pipelines with tools such as Jenkins and GitHub Actions.
  • Support automated deployments and release processes using infrastructure as code.
  • Monitor and troubleshoot platforms using tools like Splunk to improve reliability and efficiency.

Requirements

We are seeking a Big Data Engineer / Data Platform Engineer to join our dynamic team. The ideal candidate will have strong experience in Big Data technologies, data engineering, and distributed systems and a proven ability to deliver scalable data platforms, optimize pipelines, and improve operational reliability., * Hands-on experience with Big Data technologies and distributed systems.

  • Proficiency with Hadoop ecosystem: HDFS, Hive, Spark, and YARN.
  • Experience building and optimizing batch and streaming data pipelines, preferably with Kafka.
  • Experience implementing CI/CD and automated deployments using tools such as Jenkins and GitHub Actions.
  • Exposure to infrastructure as code and platform monitoring with Splunk or similar tools.
  • Demonstrated leadership and client relationship skills with a strong professional work ethic.
  • Ability to work under pressure and deliver on time, individually and within a team.

Preferred Skills:

  • Experience with Git-based workflows and release management in regulated environments.
  • Background in financial services data platforms.

Schedule & Start Details:

  • Hybrid schedule with a minimum of 3 days per week onsite.
  • Start date targeted within 2 to 4 weeks after offer to meet business needs.
  • Glider candidate ID verification required.

Benefits & conditions

  • Competitive compensation and benefits.
  • Opportunities for growth with global clients.
  • A supportive, inclusive culture that values innovation and people.
  • Exposure to cutting-edge technologies and projects.

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.disabledperson.com
Prepare application

Good distractions

Loading talks and stories from around this role…