Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+22 more
Job description
Design, develop and maintain scalable end-to-end ETL/ELT and data pipelines. Build data processing and transformation solutions using Python, SQL and PySpark. Develop batch and streaming pipelines to integrate data from databases, APIs, files and enterprise source systems. Implement data-quality checks, validation, reconciliation, deduplication and exception handling. Optimize data pipelines, SQL queries and Spark workloads for high-volume processing. Prepare and transform datasets required for AI/ML and Generative AI applications. Develop data ingestion and preparation pipelines supporting LLM/RAG solutions and vector databases. Collaborate with AI/ML engineers, application teams and business stakeholders on downstream data requirements. Implement automated deployment and monitoring through CI/CD and DevOps practices. Support production deployments, monitoring, troubleshooting and root-cause analysis for data-related issues. Thanks & Regards, Sumit Goyal Lead Recruiter Email : Synchrony Systems Inc. 3 Ethel Rd Ste 313, Edison NJ 08817 Disclaimer: We respect your online privacy. If you would like to be removed from our mailing list please reply with “Remove” in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. We are an equal opportunity employer with a diverse workforce. Note : Any resume submitted by Synchrony Systems Inc is presented with the understanding that the candidate is being considered for your direct end-client (end-client is the company where the work will be performed). If there is any other company involved between the end-client and your company, please do not submit this resume without our written approval. If you submit the resume to another third party, Synchrony Systems Inc reserves the right to work with the third party directly.
Requirements
Must Have Technical/Functional Skills Strong hands-on experience in Python, SQL and data engineering. Experience designing and developing ETL/ELT pipelines for large-scale data processing. Strong knowledge of PySpark / Spark for data transformation and processing. Experience with AWS data services such as Glue, S3, Redshift and related cloud services. Hands-on experience with Apache Airflow or equivalent orchestration tools. Strong understanding of data transformation, cleansing, validation, reconciliation and data-quality frameworks. Experience working with structured, semi-structured and unstructured data. Knowledge of batch and streaming data pipelines, preferably Kafka. Experience building data pipelines supporting AI/ML, GenAI, LLM and RAG use cases. Experience with CI/CD, Git, Docker and Kubernetes/EKS for production deployments. Good understanding of data modeling, performance optimization and production support.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…