Data Engineers

Akaasa Technologies

Chicago, IL, United States

20 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon S3 Information Engineering Extract Transform Load (ETL) Amazon DynamoDB HP Systems Insight Manager Identity and Access Management Python (Programming Language) Software Engineering Data Streaming

+14 more

Reinforcement Learning Datadog Apache Spark AWS ECS Data Lakes Pyspark AWS Glue Apache Kafka Cloudwatch Restful APIs Stream Processing Splunk Data Pipelines Dynatrace

Job description

Build and maintain a real-time streaming connector application in AWS ECS using Python.
Implement real-time data streaming via Apache Kafka to continuously pull data from generative AI/chatbot applications, invoke Norm AI APIs, and process compliance review results.
Handle data engineering tasks, including processing compliance review feedback/comments and routing data to AWS S3 buckets and DynamoDB for downstream reinforcement learning and analysis.
Set up application and platform monitoring using tools like Splunk, CloudWatch, Dynatrace, or Datadog.
Optionally assist in long-term UI dashboard/application development for compliance metrics and review., Senior Data Engineer- Assessment required Hybrid Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concep…
12 hours ago
Apply easily

Requirements

AWS Core Services: AWS ECS, S3, DynamoDB, AWS Glue, IAM roles, and bucket policies.
Kafka: Strong hands-on experience with real-time Kafka streaming architectures.
Python: Proficiency in custom Python development for data pipelines and API consumption.
Additional Technical Skills: Experience with API consumption (RESTful), application monitoring (CloudWatch, Splunk, Dynatrace), and cloud deployment.
Non-Technical Attributes: Genuine curiosity, honesty regarding skill boundaries, strong problem-solving initiative, and adaptability to pick up new tools (e.g., Claude Code, novel AI tools) quickly.