TELECOMMUTE Lead Data Engineer

K Anand Corporation
Houston, United States of America
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Houston, United States of America

Tech stack

Unity
Amazon Web Services (AWS)
Azure
Computer Programming
Continuous Integration
ETL
Data Transformation
Data Warehousing
Database Queries
Hive
Meta-Data Management
Power BI
Oracle Fusion Middleware
Data Processing
Google Cloud Platform
Spark
GIT
PySpark
Data Lineage
Tools for Reporting
Data Pipelines
Databricks

Requirements

Major Focussed Skills

  1. Functional ERP & Oracle Fusion Knowledge
  2. Databricks Scenario-Based Problem Solving
  3. SQL Proficiency & Ranking Functions
  4. Data Warehousing & BI Integration, 7+ years of experience working in data warehousing systems, with 2+ years experience working in building reporting solutions for ERP systems (Oracle Fusion or EBS)
  • 3+ strong hands-on programming expertise in Databricks landscape, including SparkSQL, Workflows for data processing and pipeline development
  • 3+ strong hands-on data transformation/ETL skills using Spark SQL, Pyspark, Unity Catalog working in Databricks Medallion architecture
  • 2+ yrs work experience in one of cloud platforms: Azure, AWS or Google Cloud Platform
  • Experience working in using Git version control, and well versed with CI/CD best practices to automate the deployment and management of data pipelines and infrastructure
  • Hands-on experience building data ingestion pipelines from ERP systems (Oracle Fusion preferably) to a Databricks environment, using Fivetran or any alternative data connectors
  • Experience in a fast-paced, ever-changing and growing environment
  • Understanding of metadata management, data lineage, and data glossaries is a plus
  • Must have report development experience using PowerBI, SplashBI or any enterprise reporting tool

Apply for this position