Data Engineer / Data Architect

BCforward

Plano, TX, United States

19 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

$161,366.0 - $171,766.0

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Java (Programming Language) Agile Methodology Airflow Amazon Web Services Automation of Tests Behavior-Driven Development Big Data Continuous Integration Information Engineering Data Infrastructure Data Integrity Serialization

+18 more

Data Structures Distributed Computing Environment Protocol Buffers Apache Hadoop JSON Python (Programming Language) NoSQL Workflow Management Systems Parquet Data Processing Test-Driven Development (TDD) Apache Spark Avro Data Analytics AWS Data Analytics Data Pipelines Databricks Programming Languages

Job description

Design, develop and maintain scalable and large-scale data processing pipelines and infrastructure on the cloud following engineering standards, governance standards and technology best practices

Develop and optimize data models for large-scale datasets, ensuring efficient storage, retrieval, and analytics while maintaining data integrity and quality.
Collaborate with cross-functional teams to translate business requirements into scalable and effective data engineering solutions.
Demonstrate a passion for innovation and continuous improvement in data engineering, proactively identifying opportunities to enhance data infrastructure, data processing and analytics capabilities.

Requirements

We are seeking a Big Data Engineer to join our team. The ideal candidate will have strong experience in Java/J2EE development, Agile delivery, and CI/CD practices and a proven ability to design, build, test, deploy, and maintain secure, resilient applications., Strong analytical problem solving and critical thinking skills

Proficiency in at least one programming language ( Python, if not Java or Scala)
Proficiency in at least one distributed data processing framework ( Spark or similar)
Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop),
Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar)

-Proficiency with relational and NoSQL databases.

Proficiency in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar),

-Experience working in teams following Agile methodology

Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.

Preferred Skills:

Experience with cloud platforms and related services.
Exposure to test automation and performance engineering.

Benefits & conditions

Competitive compensation and benefits
Opportunities for growth with global clients
A supportive, inclusive culture that values innovation and people
Exposure to cutting-edge technologies and projects

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.