Data Engineer
Diverse Lynx LLC
Woodbridge Township, NJ, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Microsoft Azure
Continuous Delivery
Continuous Integration
Data Files
Software Debugging
Github
Python (Programming Language)
Key Management
Lynx
MySQL
NumPy
+14 more
Oracle (Applications)
Power BI
SQL Stored Procedures
SQL Databases
Data Streaming
Scripting
Azure Data Factory
Apache Spark
Git
Pandas
Pyspark
Azure Synapse Analytics
Serverless Computing
Databricks
Requirements
- Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
- Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc.
- Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc.
- Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
- Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
- Must have strong hands on to get data through APIs
- Must be able to install libraries and help users to troubleshoot issues
- Must have knowledge to get the data through stored procedures via Python
- Should be able to debug the Python code Hands on experience in Spark Pools, Spark
- Should be able to merge data/delta loads through Notebooks
- Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI, Application Programming Interface (API), Continuous Deployment/Delivery, Continuous Integration, Data Sets, Debugging Skills, GitHub, Identify Issues, Lynx, Microsoft Windows Azure, MySQL, Oracle, Power BI, Procedure Development, Python Programming/Scripting Language, Quality Assurance, SQL (Structured Query Language), Scripting (Scripting Languages), Stored Procedures
About the company
Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
about 2 years ago
CH
Chris Heilmann
Dev Digest 132 - Binging WADFlix?
about 2 years ago