Data Engineer

• Configure and customise Redslim tools to meet specific client requirements, developing reusable components and ensuring seamless integration with existing systems.

• Design, implement, and maintain data integration code based on Python and PySpark, actively engaging in feedback loop with core product team and contributing to maintenance and evolution of Redslim tools.

• Develop and implement automated workflows using Artificial Intelligence and conventional software logic.

• Optimise and manage job tasks, Unity Catalog tables and other Databricks services.

• Develop and execute unit and integration tests to ensure data quality and pipeline reliability.

• Research, suggest, and implement best practices and usage of any relevant technology / tool in line with modern industry standards.

• Oversee data governance and security, including implementing data access controls, ensuring data privacy, and adhering to company policies.

Practising a hybrid model, the role will combine opportunities for both remote and on-site work. The role will expose you to working with global clients and cutting-edge data technologies. If you're passionate about data, thrive in solving complex challenges, and have experience managing workloads, we want to hear from you!, We are looking for a Data Engineer, who is curious about technology and suited to using a variety of tools and frameworks to solve data related problems. The ideal candidate would have 2 years of experience in a similar role. The person should have a problem-solving mindset with a strong hands-on attitude who is looking to execute day to day tasks to support the different clients and project. The candidate would like to work in a creative and varied environment, focusing on performance, using the latest technologies., Technical Skills:

o Proficient in Python and PySpark with at least 2 years of experience developing and optimizing data pipelines. Demonstrated ability to write clean, efficient, and well-documented code with experience in library-oriented development, creating reusable functions and modules.

o Strong SQL skills for data querying and transformation.

o Experience with Azure cloud services.

o Experience with Databricks, including Delta Lake, Spark SQL, and Unity Catalog. Ability to optimize Spark jobs for performance and scalability.

o Experience with Azure DevOps for CI/CD.

o Knowledge of data modeling and data warehousing principles.

o Experience with other data processing technologies (e.g., Snowflake, DuckDB).

Desired:

o Experience developing and implementing tools using AI (e.g. with Microsoft's Agent Framework).

o Familiarity with data visualization tools (e.g., Power BI, Tableau).

Mindset:

• Passion for continuous learning and adopting new technologies.

• Exceptional communication skills and ability to collaborate across teams.

• Thrives in a fast-paced, flexible environment.

• Ready to occasionally travel for client and team meetings.

• English is our working language. Spanish and or French would be an advantage.

• Fresh, Agile, Entrepreneur environment with direct and full exposure to corporate initiatives.

• Full on-boarding training and on-boarding plan.

• Flexible work environment within a cohesive and collaborative team.

• Competitive package commensurate with experience.

• Exposure to global clients and cross-functional teams.

About Redslim

We started in 2013, when our customers' data journeys were at a turning point. Redslim came to life to help CPG organizations maximizing the usage of the full scope of their data assets with customized analytical tools. Offering a replicable yet flexible approach to data synchronization, our founding partners created a new space in the world of market intelligence. We're a virtual company to offer a lean experience around remodelling data assets. Ours is a people-first culture that encourages everyone to drive change on the customer's behalf. Not being a typical corporation, we can challenge our status quo. We succeed every day with a collaborative attitude, a quality driven approach, and transparent relationships with our partners.