Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+22 more
Requirements
A robust background in AWS services such as Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch, Redshift, and Bedrock. Strong expertise in SQL and relational databases like Oracle, MySQL, and PostgreSQL. Familiarity with the Salesforce platform, including data models and objects. Proficiency in Python programming for data engineering tasks. Skilled in scripting for task and process automation. Experience with Tableau dashboards and troubleshooting. Some of the additional good to have skills are knowledge of machine learning tooling/frameworks (such as scikit-learn or TensorFlow) and AI/LLM knowledge, particularly with foundation models, RAG, embeddings, vectors, prompt engineering, and MCP. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Strong Application development experience in Scala/Python. Strong Database SQL experience, preferably Redshift. Experience in Snowflake is an added advantage. Experience with ETL/ELT process and frameworks is a must. Create integration and application technical design documentation. Conduct peer-reviews of functional design documentation. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards are applied to each solution component. Resolve complex defects during testing phases and identify root causes. Support and execute performance testing.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www2.jobdiva.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
Data Engineer Salary UK
Top Big Data Technologies That You Need to Know