Data Engineer / Data Architect

BCforward
Plano, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 172K

Job location

Plano, United States of America

Tech stack

Java
Agile Methodologies
Airflow
Amazon Web Services (AWS)
Automation of Tests
Behavior-Driven Development
Big Data
Continuous Integration
Information Engineering
Data Infrastructure
Data Integrity
Serialization
Data Structures
Distributed Computing Environment
Protocol Buffers
Hadoop
JSON
Python
NoSQL
Workflow Management Systems
Parquet
Data Processing
Test Driven Development
Spark
Avro
Data Analytics
Amazon Web Services (AWS)
Data Pipelines
Databricks
Programming Languages

Job description

Design, develop and maintain scalable and large-scale data processing pipelines and infrastructure on the cloud following engineering standards, governance standards and technology best practices

  • Develop and optimize data models for large-scale datasets, ensuring efficient storage, retrieval, and analytics while maintaining data integrity and quality.

  • Collaborate with cross-functional teams to translate business requirements into scalable and effective data engineering solutions.

  • Demonstrate a passion for innovation and continuous improvement in data engineering, proactively identifying opportunities to enhance data infrastructure, data processing and analytics capabilities.

Requirements

We are seeking a Big Data Engineer to join our team. The ideal candidate will have strong experience in Java/J2EE development, Agile delivery, and CI/CD practices and a proven ability to design, build, test, deploy, and maintain secure, resilient applications., Strong analytical problem solving and critical thinking skills

  • Proficiency in at least one programming language ( Python, if not Java or Scala)

  • Proficiency in at least one distributed data processing framework ( Spark or similar)

  • Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop),

  • Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar)

-Proficiency with relational and NoSQL databases.

  • Proficiency in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar),

-Experience working in teams following Agile methodology

  • Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.

Preferred Skills:

  • Experience with cloud platforms and related services.
  • Exposure to test automation and performance engineering.

Benefits & conditions

  • Competitive compensation and benefits
  • Opportunities for growth with global clients
  • A supportive, inclusive culture that values innovation and people
  • Exposure to cutting-edge technologies and projects

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Apply for this position