Data Engineer

Insight Global
Ephrata, WA, United States
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Geographic Information Systems Agile Methodology Artificial Intelligence Amazon Web Services Amazon S3 Business Analytics Applications Cloud Computing Information Systems Information Engineering Data Governance Extract Transform Load (ETL) Supervisory Control and Data Acquisition (SCADA)
+9 more
Python (Programming Language) Meta-Data Management Cloud Services SQL Databases Data Ingestion Apache Spark Pyspark Data Management Data Pipelines

Job description

Design, develop, and maintain scalable AWS-based data pipelines and data platforms.

Build and optimize data ingestion, transformation, and storage solutions for enterprise-wide reporting and analytics.

Partner with business stakeholders, analysts, and data scientists to support operational and strategic initiatives.

Develop and maintain ETL/ELT processes using modern cloud technologies.

Support enterprise reporting, business intelligence, and self-service analytics capabilities.

Establish data quality frameworks and monitoring processes.

Collaborate on data governance, metadata management, and Master Data Management (MDM) initiatives.

Support integration of ERP, HR, SCADA, GIS, Asset Management, and Customer Information Systems (CIS).

Contribute to AI and machine learning readiness by ensuring clean, governed, accessible data.

Mentor junior engineers and establish engineering best practices.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

10+ years of Data Engineering experience.

3+ years designing and supporting cloud-native data solutions in AWS.

Strong experience with:

AWS (S3, Glue, Lambda, Redshift, EMR, Athena)

Python

SQL

Spark/PySpark

Data Warehousing

ETL/ELT development

Experience building enterprise-scale data platforms.

Experience supporting analytics, BI, and reporting environments.

Strong understanding of data governance, data modeling, and data quality.

Experience working in Agile environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

5:08 min

Automating data collection and managing crowdsourced training image sets

Kris Howard · LIVE

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · WWC 2024

Videos

See all

Related articles

See all