Sr Data Engineer

Insight Global
Kansas City, KS, United States
28 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

JavaScript (Programming Language) .NET Framework Artificial Intelligence Amazon Web Services Macintosh Application Environment Microsoft Azure Cloud Computing Information Engineering Data Integration Extract Transform Load (ETL) Data Migration Python (Programming Language)
+15 more
Microsoft SQL Server Standard Sql Salesforce.Com Software Engineering SQL Databases TypeScript Web Services Azure Data Factory Snowflake Software Troubleshooting Vue.js Microsoft Fabric Front End Software Development Streamlit Framework Data Pipelines

Job description

Insight Global is looking for a Senior Data Engineer to join a Web Services team that is expanding its focus on AI-enabled application development. This person will take ownership of the data foundation supporting several applications while helping the organization modernize how data is structured, modeled, integrated, and delivered. A major focus of this position will be evaluating existing data, determining how it should be modeled, and building the pipelines necessary to get that data into the right systems and formats. The current environment includes CSV-based files, SQL Server, SQL, and Azure Data Factory, with the organization moving toward Snowflake as its target data platform. This engineer will assist with those migrations while improving the overall structure, reliability, and usability of the data. The role will also support other areas of the business that need improved data models and pipelines. The ideal candidate can dive into an existing system, understand how it works today, identify opportunities for improvement, make technical recommendations, and then help implement those solutions. The broader application environment includes Python, Streamlit, .NET, Vue, and Quasar, but the primary focus of this position is data modeling and data pipelines. Front-end experience, particularly Vue or Quasar, would be beneficial but is not a requirement for a strong data engineering candidate.

Requirements

  • Senior-level data engineering experience with the ability to work independently and own technical solutions * Strong SQL experience * Strong data modeling experience * Hands-on ETL/ELT and data pipeline development experience * Experience with data migrations and integrating data from multiple sources * Snowflake experience or experience with a comparable modern cloud data platform * Azure Data Factory or comparable data integration/orchestration experience * Cloud experience, preferably Azure; AWS and GCP backgrounds can be considered * Ability to dive into existing systems, understand the current architecture, identify gaps, and recommend improvements * Experience working with legacy, file-based, or SQL data and moving it into modern cloud data environments * Strong troubleshooting and problem-solving skills * Ability to collaborate with application developers, analysts, and other technical stakeholders * Python * Streamlit * Salesforce integration experience * SQL Server to Snowflake migration experience * CSV/file-based data migration experience * Microsoft Fabric * AI/ML data pipeline or AI application experience * TypeScript/JavaScript * Vue * Quasar * .NET ecosystem exposure * Experience building data foundations that support AI-enabled applications

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…