Lead Data Engineer/Data Architect

Intersources Inc.
Irving, United States of America
31 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 26K

Job location

Irving, United States of America

Tech stack

Java
Airflow
Data analysis
Azure
Big Data
Unix
Data Architecture
Data Mining
Data Structures
Data Visualization
Data Warehousing
Hive
Python
Machine Learning
SAS (Software)
Software Engineering
SQL Databases
SQL Server Integration Services
Azure
Spark
Data Layers
Data Lake
Information Technology
Druid
Presto
Azure
Data Pipelines

Job description

we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with client gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at-all from Day One. Client is building a team to launch a new platform for BNPL and Point Of Sale Lending Products (Avvance). As a Lead Data Engineer/Architect, you will be responsible for big data/analytics projects that gather and integrate large volumes of data. Specializes in developing and programming methods, processes, and systems to consolidate and analyze unstructured, diverse big data sources to generate insights and solutions for client services and product enhancement. Acquires data from multiple data sources to perform analysis. Implements and validates predictive models as well as create and maintain statistical models with a focus on big data. Identifies, analyzes and interprets trends or patterns in complex data to provide answers to business questions as well as provide recommendations for action. Interprets data and analyzes results using various advanced statistical techniques and tools. Presents data and analysis in a clear and concise manner allowing the audience to quickly understand the results and recommendations and make data driven decisions. Collaborates with various partners to prioritize requests/needs and provide a holistic view of the analysis. Measures and monitors results of applied recommendations and present adjustments. Ensures all data acquisition, sharing and results of applied recommendations are compliant with company standards., The Advance Data & Analytics team is building a scalable data platform to support one of the complex B2B2C products. Today, the data lake operates on-premises, integrating data across multiple systems that span the full merchant and consumer lifecycle. The team is actively migrating this platform to Azure to improve scalability, reliability, security, and long-term extensibility. As the migration is completed, the focus shifts to scaling and maturing the platform-keeping data pipelines and transformations aligned with rapidly evolving product features, expanding data coverage, and strengthening data modeling and governance. The team will be enabling standardized analytics and self-service reporting to support key business initiatives. The next phase of the roadmap includes integrating richer event-level and behavioral data, improving platform reliability and automation, and building data science and machine learning use cases using Azure services and more. The Lead Data Architect / Engineer will play a critical role in shaping this post-migration phase by driving architecture decisions, scaling the data foundation, and enabling advanced analytics on top of the modernized platform.

Top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis)

  • SQL Data analytics including ad-hoc SQL queries, data transformations, extraction script analysis, Synapse data layer analysis and planning

Skills/technologies are required (please include the number of years of experience required)?

  • SQL database and query analysis - 5 years, Synapse data layering - 2 years, Unix OS - 5 years, Python 2 years

Requirements

  • Bachelor's degree in a quantitative field such as statistics, computer science, engineering or applied mathematics, or equivalent work experience
  • Ten or more years of relevant experience

Preferred Skills/Experience

  • Strong experience in analytics, advanced analytics/statistics, predictive modeling, machine learning, data visualization
  • Good experience and expertise in Synapse, Presto , Spark SQL , Druid , SuperSet
  • Strong experience and expertise in Java, SQL and Azure Cloud technologies
  • Prior experience in Azure Synapse Analytics, Azure Data Factory, SSIS, Azure Spark pool and building / managing large scale data warehouse is a plus
  • Very knowledgeable in Apache Airflow
  • Previous experience in building data products
  • Understanding of machine learning techniques and algorithms
  • Experience in python/R/SAS/SQL for data extraction, data mining, and predictive analytic
  • Proficient understanding of algorithms, data structures, architectural design patterns and best practices
  • Effective communication, presentation, leadership, problem-solving and analytical skills

Apply for this position