Sr. Data Engineer

i2e Consulting
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Sql Data Warehouse Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Database Databases Data as a Services Information Engineering Extract Transform Load (ETL) Data Transformation Python (Programming Language) Azure Data Factory
+10 more
Snowflake Apache Spark Usage Tracking Pyspark Information Technology AWS Glue Real Time Data Data Management Dataiku Alteryx

Job description

We seek professionals who combine strong Pharma/Lifesciences domain expertise with an AI-ready mindset, leveraging AI, GenAI, Data, and Digital Technologies to transform business processes, accelerate outcomes, and unlock new opportunities for innovation.

Requirements

Bachelor’s degree or equivalent experience in Computer Science, * Experience in handling large, complex, multi-dimensional datasets including structured, unstructured, and real time data

  • Experienced in developing complex data transformation ETLs
  • Strong experience in working with Python + PySpark + Apache Spark
  • Strong experience of AWS cloud services related to data domain OR equivalent experience in Azure
  • Strong understanding of On-Prem/Cloud Data warehouse databases
  • Has technical leadership capabilities and can lead and deliver projects independently
  • Understands the impact of emerging trends in data tools, analysis techniques and data usage
  • Understands the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs
  • Good to have - knowledge of cloud data engineering tools/components/technologies such as AWS Glue/EMR/Azure Data Factory, etc.
  • Good to have - knowledge of Snowflake/Dataiku/Alteryx

Requirements:

  • Minimum 3-5 years of data engineering experience.
  • Proven experience working with Python, PySpark, Apache Spark, and data services on the cloud.
  • Strong understanding of data modelling principles; ability to produce, maintain, and update data models as per specific business needs.
  • Experience working with various data platforms including Snowflake/Dataiku/Alteryx.
  • Knowledge of On-Prem/Cloud Data warehouse databases.
  • Technical leadership skills, with a demonstrated ability to lead and deliver projects independently.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:59 min

Evolving roles in AI driven software teams

Ignacio Riesgo Ignacio Riesgo +1 · World Congress 2024

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · World Congress 2024

Videos

See all

Related articles

See all