Sr. Data Engineer

Asahi Kasei America, Inc.
Charlotte, United States of America
7 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charlotte, United States of America

Tech stack

Query Performance
API
Data analysis
Big Data
Computer Programming
Databases
Continuous Integration
Data Architecture
Data Validation
Data Discovery
Data Integration
ETL
Data Migration
Data Systems
Data Warehousing
Database Design
Hadoop
Hadoop Distributed File System
Hive
Python
Performance Tuning
Query Optimization
Scala
Shell Script
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Data Streaming
T-SQL
Data Processing
Spark
Pandas
PySpark
Information Technology
Data Pipelines
Databricks

Job description

  • Evaluate and improve T-SQL, MDX, DAX, HiveQL programming concepts such as queries, stored procedures, functions, temporary tables, parameterization, complex joins and groupings.
  • Develop and optimize ETL/ELT pipelines, to load data from on premise and online systems.
  • Ensure data solutions stability and performance optimization.
  • Conduct data warehouse model design, development and support.
  • Prepare, cleanse, validated datasets for data science purpose.
  • Assist data troubleshooting, data featuring and data discovery.
  • Develop tools to automate development and monitoring process.
  • Develop python algorithms for data processing.
  • Support Data science environment, assists data science projects.
  • Manage time effectively to ensure that projects delivered on schedule.
  • Provide on-going maintenance and support of existing and new data solutions.
  • Support solution automation and CI/CD.
  • Remote/Hybrid work schedule - Report to Charlotte, NC office (1-2 times per week)
  • Travel - 5% including travel to Europe once per year.

Requirements

Bachelor's Degree in Computer Science / Information technology or related field AND five (5) year s as Data Engineer, Big Data Engineer, Data Architect, SQL Developer, Database Developer, or related.

  • Applicants must have 5 years' experience with:
  • Developing business intelligence solutions including data integration, data schema development, data pipelines, modeling and reporting/analytics
  • Database design principles, data modeling, partitioning, and data warehouse
  • Python, and Shell scripting
  • SQL writing and query tuning, and query performance optimization
  • data analysis, data modeling, data migration, computer programming, and problem-solving.
  • Applicants must have 4 years' experience with:
  • Data validation, cleansing, featuring: Pandas, Spark dataframes, and DQ solutions.
  • Applicants must have 3 years' experience with:
  • CI/CD.
  • CDC.
  • Applicants must have 2 years' experience with:
  • big data pipeline development, monitoring and support: ETL, SSIS, Hadoop, HDFS, Spark, Hive, RDD, and UDF.
  • cloud data ecosystem: Spark API, Spark SQL, PySpark, Scala, Python, and data Streaming.
  • Applicants must have demonstrative experience with:
  • data science tools: Python ML, Scala, and Databricks.

About the company

The Asahi Kasei Group operates with a commitment of creating for tomorrow. Our business sectors, Material, Homes, and Health Care, contribute to the development of society by anticipating the changing needs of those around the world. We look for candidates that offer a fresh perspective and a variety of skills to help us achieve our commitment.

Apply for this position