Senior Data Engineer
Role details
Job location
Tech stack
Job description
Concentrix is seeking a highly skilled Data Engineer to be part of a team of Senior Data Engineers to implement a cutting-edge Azure Databricks solution focused on automating tax reporting. This role will involve managing the ingestion of daily data feeds and producing outputs on the scale of billions of forms per client, ensuring high performance and scalability. The position is full-time permanent, and you will report to our regional lead.
You will:
- Successfully execute data engineering projects.
- Design and implement advanced data solutions utilizing Azure Databricks to automate tax reporting processes.
- Manage and optimize the ingestion and transformation of daily data feeds, ensuring seamless data flow and integration.
- Develop and maintain scalable data pipelines and architectures for high-volume data processing.
- Collaborate with cross-functional teams to ensure alignment and integration with broader IT and business strategies.
- Drive the use of best practices in data engineering, leveraging modern tools and technologies.
Requirements
- Senior with 8+ years of relevant experience
- Advanced Python knowledge and software engineering skills.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with Databricks for data ingestion and transformation.
- Hands-on experience with one or more cloud services Azure.
- Experience with Azure Data Factory, Azure Cosmos DB, Azure functions, Event store, ADLS, Key Vault.
- Experience with OpenAI and Fabric
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
- Good communication skills, fluent English
About the company
Mission:
We will be the greatest customer engagement services company in the world, rich in diversity and talent. We will get there by embracing our culture.
About Concentrix:
We’re a company like no other. We are fanatical about our staff and are constantly helping them grow and achieve their career goals. We are a global workplace that offers YOU infinite possibilities!
Company Overview:
In a world full of average, we stand out. We believe experience is everything. Period. To achieve outstanding results, we’re disrupting the market by being absolutely obsessed with making our clients’ businesses better. We bring together the brightest and most creative minds in business, cutting-edge technology solutions, proven design thinking expertise and exceptional customer experience centers. Our clients notice the difference too… in increased customer loyalty, improved business performance and differentiation in their markets. As a diverse, global organization, we have unconventionally fresh ideas and deliver extraordinary customer experiences for more than 450 of the world’s best brands. Concentrix. A passionate company powered by passionate people.
