Data Engineer

United Software Group, Inc.

Dallas, TX, United States

3 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

2 years minimum

Working hours

Regular working hours

Job source

disabledperson.com

Tech stack

Amazon Web Services Microsoft Azure Big Data Information Engineering Software Design Patterns Identity and Access Management Python (Programming Language) PostgreSQL MongoDB NoSQL Performance Tuning Redis

+16 more

Software Deployment Software Engineering SQL Databases Data Streaming Systems Architecture Management of Software Versions Delivery Pipeline Large Language Models Apache Spark Data Lakes Pyspark Apache Kafka Data Management Restful APIs Stream Processing Databricks

Requirements

should take Berribot test in 1-2 days. and 2-5 Years of experience only, * 2-3 years of hands-on experience in Data Engineering

Strong experience in Python and PySpark/Spark for large-scale data processing
Experience working with Databricks and Delta Lake architecture
Good understanding of SQL (PostgreSQL) and NoSQL databases (MongoDB, Redis)
Exposure to Kafka Streaming or real-time data processing frameworks
Experience with Azure or AWS cloud platforms
Understanding of data partitioning, performance tuning, and in-memory optimizations
Experience working in Linux/Unix environments
Knowledge of CI/CD pipelines and production deployment practices
Familiarity with REST APIs and application development concepts
Understanding of software design patterns and system architecture
Exposure to multi-user data platforms and access management