Remote Dataiku Data Engineer

Insight Global

Hartford, CT, United States

11 days ago

Apply on www.juju.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.juju.com

Tech stack

Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Profiling Relational Databases Database Queries Python (Programming Language) PostgreSQL Microsoft SQL Server Oracle (Applications) Performance Tuning

+8 more

SQL Stored Procedures Freeform SQL Macros Software Troubleshooting Pyspark Dataiku Data Pipelines Alteryx

Job description

The Alteryx to Dataiku Migration Developer will assess and convert existing Alteryx workflows, macros, and ETL processes into scalable Dataiku DSS solutions. On a daily basis, they will design, build, and optimize Dataiku workflows, recipes, and automated data pipelines while partnering with business and technical stakeholders to gather requirements and validate results. This individual will write and tune complex SQL queries, stored procedures, and validation logic to support migration, reconciliation, and reporting efforts. They will work extensively with Oracle and other relational databases to extract, transform, and integrate data across multiple systems. The developer will perform data profiling, cleansing, transformation, and quality checks to ensure accuracy and integrity throughout the migration lifecycle. They will create and execute migration test plans, perform source-to-target validation, troubleshoot issues, and document findings and solutions. Additionally, they will leverage Python and/or PySpark within Dataiku to support advanced transformations and automation while helping establish migration best practices and governance standards.

Requirements

5+ years of experience in Data Engineering, ETL Development, Data Integration, or a related field.

Hands-on experience designing, developing, and optimizing Dataiku DSS workflows, recipes, and data pipelines.

Proven experience migrating Alteryx workflows and ETL processes into Dataiku, including workflow assessment, conversion, validation, and documentation.

Advanced SQL development skills, including complex queries, stored procedures, joins, aggregations, performance tuning, and data reconciliation.

Strong experience working with Oracle and other relational databases such as SQL Server and PostgreSQL.

Experience building and supporting end-to-end ETL/ELT pipelines, data transformation processes, data quality initiatives, and source-to-target validation.

Proficiency in Python and/or PySpark development within Dataiku, with strong troubleshooting, testing, and communication skills.