Data Engineer

Karthik Consulting, LLC

United States

19 days ago

Apply on www.karthikconsulting.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.karthikconsulting.com

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Microsoft Azure Information Engineering Extract Transform Load (ETL) Data Stores Github Microsoft SQL Server SQL Azure Oracle (Applications) Scrum Methodology Data Streaming

+5 more

Enterprise Data Management Cloud Platform System Information Technology Cloud Migration Databricks

Job description

The engineer will leverage Azure Data Factory, Databricks, Oracle, SQL Server, and Azure Database services to build and sustain enterprise data pipelines, partnering with program and project teams using Azure DevOps and GitHub within an agile delivery model to support Azure Cloud migration efforts., * Configure and administer enterprise-level data stores supporting ETL/ELT methods and batch and streaming data transport.

Design, develop, and maintain APIs to support enterprise data integration needs.
Leverage Azure Data Factory, Databricks, Oracle, SQL Server, and Azure Database services to build and manage enterprise data pipelines.
Support enterprise data management infrastructure, including Azure Cloud environments and cloud migration initiatives.
Utilize Azure DevOps and GitHub to plan, execute, and measure project deliverables.
Participate in agile development processes, contributing to sprint planning, execution, and delivery.
Develop and execute action plans to maintain security compliance and respond promptly to findings.

Requirements

Minimum of five (5) years of professional experience configuring and administering enterprise-level data stores,
ETL/ELT methods, and batch and streaming data transport, including API development.
Hands-on understanding of data technologies to include, but not limited to, Azure Data Factory, Databricks, Oracle, SQL Server, and Azure Database services.
Proficiency working within an enterprise data management infrastructure, including Azure Cloud and cloud migration efforts.
Experience utilizing program and project management tools, such as Azure DevOps and GitHub, to plan, execute, and measure projects.
Proficiency in agile development methodologies with demonstrated experience working on agile projects.

Preferred Skills & Experience

Experience working with CI/CD pipelines and GitHub.
Experience developing and executing action plans to ensure security compliance and to respond to findings if they occur.
Certifications for Azure (AZ-900, DP-900, DP-203)
Certifications for Databricks (Data Engineer Associate), Minimum Requirement: Bachelor’s degree from an accredited college or university in Computer Science, Engineering, or an applicable technical field., * Strong analytical and problem-solving skills applied to enterprise data infrastructure and cloud environments.
Clear, proactive communication and cross-functional collaboration within agile project teams.
Commitment to continuous improvement, security compliance, and staying current with evolving data engineering and cloud practices.