Data Engineer
Antal International
19 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Tech stack
Azure
Cloud Computing
Databases
Data Transmissions
Persistent Data Structure
Information Sciences
Python
Microsoft SQL Server
MongoDB
Azure
Data Processing
Spark
Data Lake
Kafka
Cosmos DB
Data Pipelines
Microservices
Job description
As a Senior Data Engineer, you will join the business data team and you will work in a fast-paced environment. You will be responsible for the design and implementation of strategic solutions using the latest technologies and tools. DUTIES AND RESPONSIBILITIES
- You will cooperate in the design of the information infrastructure and the data management processes to drive the organization towards a more agile architecture
- Develop a good comprehension of how data will be stored by using CRM tools, Finance and HR tools, etc.
- Develop systems that will normalize and clean datasets, develop data pipelines from different sources, and create a structure for non-structured data
- Develop POC to influence platform architects, software engineers, etc. and to validate the solution proposals
- Design and develop management and data persistence solutions for the usage of applications, benefitting from relational and non-relational DBs and improving the data processing capacity.
Requirements
- Over 4 years of experience and a college degree in Information Science, Computing Science, Mathematics, Statistics, or any other quantitative discipline (Science, Business or Social Sciences).
- At least 3 years of experience as a data developer using Python, Kafka, Spark, Azure Data Lake Storage, Azure Search, Cosmos DB/Mongo, etc.
- Outstanding technical, organizational, and analytical skills.
- Excellent written and oral communication skills, including technical writing.
- Engineering lead that is eager to learn about technology, who adapts to changes easily, and deeply understands the technologies supporting areas such as Cloud Computing (preferably Azure), Micro Services, Network, Security, etc. Experience in the creation of Data Pipelines in the Cloud and working with databases (especially SQL Server DBs)
- Experience handling non-structured data, working in the data lake environment, leveraging the data transfer and the development of data pipelines
- A team oriented, self-disciplined, and reliable person able to develop several projects in a challenging environment
