Data Engineer

Lancesoft, Inc.
Minneapolis, MN, United States
9 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Compensation
$157,560.0
Working hours
Regular working hours

Tech stack

Airflow Data Analysis Big Data Databases Data Validation Data Infrastructure Extract Transform Load (ETL) Data Structures Data Visualization Document-Oriented Databases Financial Software Apache Hadoop
+13 more
Python (Programming Language) Power BI Cloudera SQL Databases Enterprise Data Management Data Processing Google Cloud Data Layers Pyspark Data Lineage Google Bigquery Looker Analytics Data Pipelines

Job description

Purpose: Support data validation, data reconciliation, and reports development for the Finance mainframe application modernization and data platform migration to modern GCP-based data platform. Outcome: Identify data variance between legacy and modern platforms for modern Finance applications and 2 quarter parallel operation. Collaborate with product and business teams to identify root causes for the variances and resolve/document the variance to assist on Go-Live decision. Core Skill: Hhands-on SQL experience with big data platforms/databases like Google BigQuery, Hadoop or similar data platform. Senior experience with ETL and data pipeline tools such as Dataproc, Airflow, Dataform, dbt, or similar tools. Experience with Python/Pyspark coding for data movement and analysis., * Develop queries and dataset required to validate legacy vs modern applications datasets to identify data variances.

  • Develop reports using end user visualization tools to present the variances and trends between sources.
  • Document data variances and identified root causes in collaboration with Product Manager/Engineers/Business Teams and get business sign off for known variances.
  • Build dashboards for data variance trend for the stakeholders and assist on determining tolerance thresholds for Go Live decisions.

Requirements

  • Senior level (5+ years) hands-on SQL experience with big data platforms/databases like Google BigQuery, Hadoop or similar data platform.
  • Senior experience with ETL and data pipeline tools such as Dataproc, Airflow, Dataform, dbt, or similar tools.
  • Good experience with Python/Pyspark coding for data movement and analysis.
  • Experience with data visualization and reporting tools such as Power BI, Looker, and LookML for dashboard development, KPI reconciliation, semantic layer validation, and data analysis.
  • Strong experience in data analysis, data validation, source-to-target reconciliation, duplicate detection, reject/error validation, audit/control total validation, and business rule validation.
  • Ability to analyze mapping documents, reporting requirements, transformation logic, data lineage, and data quality rules.
  • Experience creating reconciliation reports, validation summaries, exception reports, defect logs, and business sign-off documentation.
  • Strong communication and collaboration skills with the ability to work closely with engineering, product, finance, business, and legacy system teams.

Preferred Skillset:

  • Prior retail industry experience, especially working with large enterprise data in finance, supply chain, merchandising, inventory, stores, sales, digital, product, or customer domains.
  • Experience working with Google Cloud Medallion Data Layer and GCP supported data processing tools.
  • Familiarity with SAP S4 data structure and finance domain report building experience.
  • Experience working in agile delivery environments, including user stories, acceptance criteria, sprint ceremonies, defect triage, and iterative delivery., * 1-3 years of experience working in agile team.

Benefits & conditions

At LanceSoft, full time regular employees who work a minimum of 30 hours a week or more are entitled to the following benefits:

  • Four options of medical Insurance
  • Dental and Vision Insurance
  • 401k Contributions
  • Critical Illness Insurance
  • Voluntary Permanent Life Insurance
  • Accident Insurance
  • Other Employee Perks

About the company

LanceSoft is rated as one of the largest staffing firms in the US by SIA. Our mission is to establish global cross-culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of our global network to connect businesses with the right people, and people with the right businesses without bias. We provide Global Workforce Solutions with a human touch.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…