Sr Data Engineer

Intellibee, Inc.

Malvern, AR, United States

11 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

7 years minimum

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Artificial Intelligence Airflow Amazon Web Services Amazon S3 Apache HTTP Server Information Systems Computer Programming Continuous Integration Data as a Services Extract Transform Load (ETL) Data Mining Data Warehousing

+20 more

Distributed Computing Environment Github Python (Programming Language) Scrum Methodology Cloud Services Data Streaming Enterprise Data Management Snowflake Apache Spark Reliability of Systems AWS Lambda Cloudformation Data Lakes Pyspark Information Technology AWS Glue Apache Kafka Terraform Data Pipelines Databricks

Job description

(Medallion Architecture). Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions. Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability., * We are seeking high-caliber Data Engineers to drive the B2B Service Experience and Financials initiatives.

In this pivotal role, you will architect, implement, and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems.

Requirements

Qualifications: Bachelor’s degree in Computer Science or related field.

Strong hands-on experience with Apache Spark and Glue.
Proven ability to work with Python-based data pipelines.
Experience with Git and GitHub Actions is mandatory.

Required Qualifications Bachelor’s degree in Computer Science, Engineering, Information Systems, or related discipline.

7+ years of enterprise Data Engineering experience. Strong Python development experience. Advanced SQL programming skills.
Extensive experience with Apache Spark and PySpark.
Hands-on experience with AWS data services including: S3 AWS Glue Athena Lambda Step Functions EventBridge Experience building enterprise ETL and ELT pipelines.
Strong understanding of distributed data processing.
Experience working with large-scale cloud data platforms. Strong knowledge of dimensional data modeling.
Experience implementing CI/CD pipelines. Familiarity with Agile/Scrum methodologies.
Excellent communication and stakeholder management skills., * Financial Services or Asset Management industry experience.
Experience with Snowflake or Databricks.
Knowledge of Apache Iceberg, Delta Lake, or Hudi.
Experience with Airflow. Knowledge of Kafka or Kinesis streaming.
Experience supporting AI/ML and advanced analytics platforms. AWS Professional or Specialty Certifications.