Lead Bid Data Engineer

Propertyvalue Quantum Technologies Llc
Illinois City, United States of America
17 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Illinois City, United States of America

Tech stack

API
Agile Methodologies
Artificial Intelligence
Azure
Big Data
Data Infrastructure
Distributed Systems
Hadoop
JSON
Python
NoSQL
Scrum
Service-Oriented Architecture
Software Engineering
Data Streaming
Software Technical Review
Web Services
Cloud Platform System
Snowflake
Spark
Cassandra
Kafka
Docker
Databricks

Job description

  • Design, code, test, document, and maintain high-quality and scalable big data solutions
  • Help drive agile processes and mentor junior level members of the team
  • Research, evaluate, and deploy new tools, frameworks and patterns to help build a sustainable big data platform
  • Identify gaps and opportunities for improvement of existing solutions
  • Define and develop APIs for integration with various data sources in the enterprise
  • Translate customer requirements into solution design
  • Participate with prototypes as well as design and code reviews
  • Make accurate development effort estimates to assist management in project and resource planning
  • Keep skills up to date through ongoing self-directed training
  • Collaborate with management, quality assurance, architecture, and other development teams
  • Write technical documentation and participate in production support

Leverage enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear directions on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Requirements

  • 10+ years of hands-on software development experience
  • 5+ years of experience in distributed systems technologies like Spark and Hadoop
  • 3+ years of experience in technologies like Databricks, and Snowflake
  • 3+ years of experience with Agile/SCRUM methodology, * Bachelor's degree in CS or IT related field OR equivalent experience
  • 5+ years of experience with Python, JSON and Web Services
  • 4+ years of experience in Kafka streaming
  • 2+ years with NoSQL databases (Cassandra preferred)
  • 2+ years working with Docker and Kubernetes
  • Experience in infrastructure services on at least one major cloud platform (Azure preferred)
  • Demonstrated experience mentoring and helping others grow
  • Thorough understanding of service-oriented architecture (SOA) concepts

Apply for this position