Data Engineer

Join our dynamic team as a Data Engineer, where you'll be instrumental in transforming unstructured data and building forward-thinking solutions. This role offers a unique chance to innovate with cutting-edge technologies and make a significant impact. Responsibilities

• Design and construct pipelines to ingest, parse, and convert diverse unstructured data.
• Develop scalable workflows using advanced tools and frameworks for document processing.
• Collaborate with AI engineers to optimize data corpora for AI-driven applications.
• Implement systems for querying financial data using natural language.
• Create and maintain APIs ensuring seamless data and model integration.

• Five or more years of experience in data engineering, with specialized skills in Databricks technologies.
• Expertise in handling unstructured data and creating effective embedding pipelines.
• Proficient in PySpark, Python, and SQL, particularly within Databricks environments.
• Solid knowledge of REST API development and microservices architecture.
• Understanding of data modeling principles and governance practices.

Preferred Skills

• Experience with Azure integrations enhancing Databricks capabilities.
• Exposure to orchestration frameworks and vector databases.
• Background or familiarity with data in financial or investment banking sectors.
• Certification in data engineering or related fields could be a plus.

At Horizontal, diversity, equity, and inclusion are fundamental to our hiring strategy and workplace culture. We welcome candidates from all backgrounds to enhance our innovative team.

Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $51 - $89 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.