Sr. Data Engineer
Role details
Job location
Tech stack
Job description
Insight Global is searching for a Sr. Data Engineer who will design, build, and maintain scalable data pipelines using TypeScript and Node.js to support critical business workflows. You will work closely within an AWS environment, developing and deploying serverless solutions using Lambda and related services. On a daily basis, you'll leverage Generative AI tools to automate processes, improve efficiency, and enhance development workflows. You will be responsible for designing system architecture from the ground up, making thoughtful decisions beyond existing frameworks when needed. The role also involves working with Databricks to optimize data storage, processing, and performance across large datasets. Collaboration with cross functional teams will be key to delivering reliable, high quality data solutions.
Requirements
7+ years of experience in data engineering, architecting and building large-scale, production-grade data pipelines using TypeScript and Node.js
-
Proven experience designing and operating serverless solutions on AWS, including Lambda-based architectures
-
Actively utilizes Generative AI tools to drive automation, improve developer productivity, and optimize workflows (e.g., Codex)
-
Demonstrated ability to design system architecture from first principles, independent of existing frameworks
-
Expertise in Databricks for scalable data storage, optimization, and analytics workloads
-
Experience working in a entertainment, media or digital environment