WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer.

Kanak Elite Services Inc
Orlando, FL, United States
4 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Working hours
Regular working hours
Job source
www.thejobnetwork.com

Tech stack

Java (Programming Language) .NET Framework Microsoft Windows Application Programming Interfaces (APIs) Airflow Amazon Web Services C Sharp (Programming Language) Cloud Computing Databases Information Engineering Data Files Data Infrastructure
+27 more
Extract Transform Load (ETL) Data Mining Data Structures Data Systems Data Warehousing Relational Databases Database Development Apache Hadoop Information Sciences Python (Programming Language) Microsoft SQL Server Visual Basic .NET (Programming Language) Standard Sql Scala (Programming Language) PL-SQL SQL Databases Web Applications Web Services Scripting Informatica Powercenter Snowflake Apache Spark Information Technology Apache Kafka Build Process Data Management Data Pipelines

Job description

  • Partner with a wide range of business teams to implement analytical and data solutions that drive business value and customer satisfaction.
  • Collecting, storing, processing, analyzing, modeling large sets of data and building applications and solutions using data.
  • Primary focus will be on building, maintaining, implementing, monitoring, supporting and integrating analytical and data solutions with the architecture used across the company.
  • Maintain and monitor our analytics data warehouses and data platform.
  • Design, Implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates.
  • Responsible for hands-on development, deployment, maintenance and support of variety of Cloud and on-premise Solutions, web service infrastructure and supporting technologies.
  • Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
  • Works closely with project managers, business analysts, data scientists and other groups in the organization to understand and translate functional requirements and processes into technical specifications.
  • Collaborate with key stakeholders to make sure our data infrastructure meets our business needs in a scalable way.
  • Keep a critical eye on our technical strategy, identify gaps, and come up with creative solutions.

Requirements

  • 1+ years of proven experience working with Apache Spark framework, Hadoop, Java/Scala, Python
  • 1+ years of proven experience building data pipelines and ETL flows in Cloud and on-premise environments using Snowpipe, Informatica, Airflow, Kafka etc.
  • AWS architecture.
  • 2+ years of experience in data modeling/database development using PL/SQL and SQL Server 2016 or later and Snowflake.
  • Bachelor’s degree in computer and information science required.
  • Master’s degree preferred.
  • Snowflake and Python certification preferred but not required., * Bachelor’s degree in computer and information science required.
  • Master’s degree preferred.
  • Snowflake and Python certification preferred but not required.
  • Ability to build data models and manage data warehouses.
  • 3 years of related data engineering/IT experience.
  • 1+ years of proven experience working with Apache Spark framework, Hadoop, Java/Scala, Python and AWS architecture.
  • 1+ years of proven experience in Microsoft .Net technologies such as C#, VB.Net and experience in designing, developing and deploying Windows & Web applications.
  • 2+ years of experience in data modeling/database development using PL/SQL and SQL Server 2016 or later and Snowflake.
  • 1+ years of proven experience building data pipelines and ETL flows in Cloud and on-premise environments using Snowpipe, Informatica, Airflow, Kafka etc.
  • Excellent listening, interpersonal, communication (written & verbal) and problem-solving skills.
  • Ability to collect and compile relevant data.
  • Extremely organized with great attention to detail.
  • Excellent ability to analyze information and think systematically.
  • Strong business analysis skills.
  • A strong team player with some ability to work independently.
  • Good understanding of the company’s business processes and the industry at large.
  • Good working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing data pipelines and data sets leveraging various scripting languages or ETL tools.
  • Ability to perform root cause analysis on internal and external data processes to answer specific business questions and identify opportunities for improvement.
  • Good analytic skills related to working with unstructured datasets.
  • Ability to build and use APIs to push and pull data from various data systems and platforms.
  • Build processes supporting data extraction, transformation, and loading of data into data structures.
  • A successful history of manipulating, processing and extracting value from large, disconnected datasets.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…