Data Engineer

Diverse Lynx LLC
Woodbridge Township, NJ, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Continuous Delivery Continuous Integration Data Files Software Debugging Github Python (Programming Language) Key Management Lynx MySQL NumPy
+14 more
Oracle (Applications) Power BI SQL Stored Procedures SQL Databases Data Streaming Scripting Azure Data Factory Apache Spark Git Pandas Pyspark Azure Synapse Analytics Serverless Computing Databricks

Requirements

  • Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
  • Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc.
  • Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc.
  • Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
  • Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
  • Must have strong hands on to get data through APIs
  • Must be able to install libraries and help users to troubleshoot issues
  • Must have knowledge to get the data through stored procedures via Python
  • Should be able to debug the Python code Hands on experience in Spark Pools, Spark
  • Should be able to merge data/delta loads through Notebooks
  • Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI, Application Programming Interface (API), Continuous Deployment/Delivery, Continuous Integration, Data Sets, Debugging Skills, GitHub, Identify Issues, Lynx, Microsoft Windows Azure, MySQL, Oracle, Power BI, Procedure Development, Python Programming/Scripting Language, Quality Assurance, SQL (Structured Query Language), Scripting (Scripting Languages), Stored Procedures

About the company

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:57 min

Introduction to the Lynx cross-platform UI framework

Xuan Huang Xuan Huang · World Congress 2025

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

1:25 min

Replacing NumPy with cuPy for straightforward GPU acceleration

Paul Graham Paul Graham · World Congress 2025

3:37 min

Balancing scale and velocity with platform adjacency theory

Xuan Huang Xuan Huang · World Congress 2025

Videos

See all

Related articles

See all