Data Engineer
Role details
Job location
Tech stack
Job description
Come join our growing team of data practitioners and be on the leading edge of Client's digital transformation. Client is seeking a self-driven and highly motivated individual to join a dynamic team with a passion for data, software, and engineering. At client you will have the opportunity to work with the latest technologies in a goal-oriented environment. The Senior Data Engineer is a member of the Enterprise Data and Analytics team supporting business areas including Merchandising, Allocations, Marketing, IT and Supply Chain Analytics teams with insights gained from analyzing Burlington and external data. The successful candidate will have strong experience pulling data from various internal and external data sources and preparing it for advanced analytics, segmentation, and modeling. Must have strong interpersonal and relationship building skills as well as written and verbal communication skills., * Design and Develop ETL to extract data from first and third-party data sources, stitch, and wrangle it for advanced analytics activities and AI/ML and GenAI uses.
- Guide and lead development of data pipelines to enable real-time, high volume, data consumption.
- Leverage data engineering best practices and tools in collaboration with analytics translators, data scientists, and cloud engineers
- Assist with researching first and third-party data sources to enable access and ensure availability of relevant data sources for those who need it
- Provide input to cloud engineers for the design and implementation of data management and/or architecture solutions
- Provide ongoing operational support for ETL/ELT environments including development, test, and production
- Design, implement, and deploy data loaders to load data into the cloud data platform
- Assist in pulling, filtering, tagging, joining, parsing, and normalizing data sets for use
- Mentoring junior members of the team
Requirements
- Bachelor's or Master's degree in Computer Science / Engineering, Informatics, or related areas.
- 5+ years of experience in designing and implementing large scale data loading, manipulation, processing, analysis, and exploration solutions
- Extensive experience developing SQL based data processing
- 5+ years of experience with Data Architecture, Data Warehouse, Lake Houses, Data Lake, Data Marts and Data Stores with focus on AI/ML techniques and LLMs
- Experience with Snowflake and Oracle Databases as well as Azure and ADLS.
- Experience in development & provisioning RESTful APIs to enable real-time data consumption.
- Experience with source control tools such as GitHub and related CI/CD processes.
- Technical expertise with pulling and massaging data
- Great understanding of first/third party data
- Agile Development methodology
- Database Normalization
- Advanced SQL skills
- Understanding of data management principles and processes
- Passion for data, analytics and pushing business innovation
- Strategic thinker who loves technology and innovation
- Excellent communication skills
- AI-based development for data workflows, data wrangling, and code-assist
- Experience with Informatica IDMC
- Experience with GenAI and Natural Language Processing (NLP) frameworks
- Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
- Unix / Linux Experience
- Experience with CI/CD practices
- Previous experience with DevOps
- Experience with Python / Java programming languages
- Experience with one or more enterprise scheduler
- Experience with AI-based testing, experimentation, and prototyping
- Retail or CPG experience preferred