Data Engineer with (AI, Streaming & Full Stack Databricks)
Innovative Information Technologies, Inc
Dallas, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Dallas, United States of America
Tech stack
API
Artificial Intelligence
DevOps
JSON
Python
DataOps
React
Spark
Infrastructure Automation Frameworks
Real Time Data
Data Pipelines
Databricks
Job description
We are seeking a high-performing Data Engineer to design and implement a real-time data platform using the Medallion Architecture. You will be responsible for the end-to-end development of data pipelines from ingesting real-time source data into Bronze, transforming it into a relational silver layer, and finally delivering high-concurrency, consumption-ready JSON Gold tables. You will act as a "Full Stack" data professional, handling everything from infrastructure automation (DataOps) to complex nested data modeling.
Requirements
- Technical Core expertise: ai experience, Python, Databricks & Spark
- Data Modeling & Languages
- Full Stack & DevOps
Client Focus: Understanding how an API client (e.g., a React app or a microservice) will consume the Gold layer JSON.