Data Engineers
Akaasa Technologies
Chicago, IL, United States
2 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Amazon Web Services
Amazon S3
Information Engineering
Extract Transform Load (ETL)
Amazon DynamoDB
HP Systems Insight Manager
Identity and Access Management
Python (Programming Language)
Software Engineering
Data Streaming
+14 more
Reinforcement Learning
Datadog
Apache Spark
AWS ECS
Data Lakes
Pyspark
AWS Glue
Apache Kafka
Cloudwatch
Restful APIs
Stream Processing
Splunk
Data Pipelines
Dynatrace
Job description
- Build and maintain a real-time streaming connector application in AWS ECS using Python.
- Implement real-time data streaming via Apache Kafka to continuously pull data from generative AI/chatbot applications, invoke Norm AI APIs, and process compliance review results.
- Handle data engineering tasks, including processing compliance review feedback/comments and routing data to AWS S3 buckets and DynamoDB for downstream reinforcement learning and analysis.
- Set up application and platform monitoring using tools like Splunk, CloudWatch, Dynatrace, or Datadog.
- Optionally assist in long-term UI dashboard/application development for compliance metrics and review., Senior Data Engineer- Assessment required Hybrid Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concep…
- 12 hours ago
- Apply easily
Requirements
- AWS Core Services: AWS ECS, S3, DynamoDB, AWS Glue, IAM roles, and bucket policies.
- Kafka: Strong hands-on experience with real-time Kafka streaming architectures.
- Python: Proficiency in custom Python development for data pipelines and API consumption.
- Additional Technical Skills: Experience with API consumption (RESTful), application monitoring (CloudWatch, Splunk, Dynatrace), and cloud deployment.
- Non-Technical Attributes: Genuine curiosity, honesty regarding skill boundaries, strong problem-solving initiative, and adaptability to pick up new tools (e.g., Claude Code, novel AI tools) quickly.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…