Big Data Engineer

BCforward

Addison, TX, United States

7 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$104,000.0

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Agile Methodology Amazon Web Services CA Workload Automation Ae Microsoft Azure Big Data Cloud Database Continuous Integration Data Warehousing Relational Databases Distributed Systems Apache Hadoop Apache Hive

+9 more

Python (Programming Language) Unix Shell Performance Tuning Query Optimization Cloudera Scala (Programming Language) SQL Databases Data Processing Apache Spark

Job description

Design, build, and maintain data pipelines using Hadoop, Hive, and Spark.
Develop and optimize complex SQL and Spark queries for performance and scalability.
Implement production-grade big data solutions on Cloudera platforms.
Automate workflows with Autosys and Unix shell scripting.
Collaborate in Agile teams to deliver reliable, customer-oriented services.
Troubleshoot, benchmark, and resolve performance issues across distributed systems.

Requirements

We are seeking a Big Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Hadoop and Spark within the Cloudera ecosystem, data warehousing, and distributed systems and a proven ability to build and optimize scalable big data pipelines in production., * Bachelor’s degree in a technical or business-related field or equivalent experience.

5+ years in data warehousing architectural approaches.
5+ years in big data with the Hadoop ecosystem on Cloudera.
Proficiency with Hadoop, Hive, Spark, Python, Scala, and Unix shell scripting.
Experience operating big data solutions in production environments.
Hands-on experience with Autosys or similar scheduling tools.
Sound knowledge of relational databases and large SQL-based systems.
Strong understanding of distributed systems and data processing patterns.
Experience with query optimization and performance tuning.
Ability to evaluate and adopt evolving Hadoop ecosystem tools.
Effective collaboration and customer-oriented service delivery.

Preferred Skills:

Experience with Agile methodologies and CI/CD practices.
Exposure to cloud data services on AWS or Azure.

Benefits & conditions

Competitive compensation and benefits.
Opportunities for growth with global clients.
A supportive, inclusive culture that values innovation and people.
Exposure to cutting-edge technologies and projects.

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.