Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
We are seeking a highly skilled and motivated Senior Data Engineer to lead the design, development, and maintenance of our enterprise data infrastructure. In this dynamic role, you will harness the power of big data technologies and cloud platforms to enable insightful analytics and data-driven decision-making. Your expertise will drive the creation of scalable data pipelines, optimize data storage solutions, and support advanced analytics initiatives. Join us to empower our organization with innovative data solutions that fuel growth and strategic insights., * Design, develop, and optimize robust ETL (Extract, Transform, Load) processes to integrate data from diverse sources such as AWS, Azure Data Lake, Hadoop, and on-premises systems.
- Build scalable data pipelines utilizing Apache Spark, Hadoop ecosystem components (e.g., Hive), and Python scripting to process large volumes of structured and unstructured data efficiently.
- Develop and maintain data warehouses leveraging SQL Server, Oracle, and other relational databases; ensure high performance and security standards.
- Collaborate with cross-functional teams to implement data models, database designs, and linked data architectures that support analytics and reporting needs.
- Utilize tools like Talend, Informatica, and Shell Scripting to automate workflows and streamline data processing tasks.
- Integrate RESTful APIs for seamless data exchange between systems; support model training activities for machine learning initiatives.
- Work within Agile methodologies to deliver continuous improvements in data infrastructure while maintaining documentation for compliance and knowledge sharing.
Requirements
- Proven experience as a Data Engineer or similar role with a focus on big data technologies such as Hadoop, Spark, Hive, and Azure Data Lake.
- Strong proficiency in SQL (including Microsoft SQL Server and Oracle), Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks.
- Hands-on experience designing scalable data warehouses and implementing ETL pipelines using tools like Talend or Informatica.
- Familiarity with cloud platforms such as AWS and Azure for deploying large-scale data solutions.
- Knowledge of database design principles, linked data concepts, RESTful API integration, and model training techniques for machine learning applications.
- Excellent analysis skills with the ability to interpret complex datasets; experience with Looker or similar BI tools is a plus.
- Strong understanding of Agile development practices to facilitate iterative project delivery in fast-paced environments. Join us as a Senior Data Engineer to shape the future of our organization’s data landscape! Bring your passion for innovation, technical expertise in big data ecosystems, cloud platforms, and analytics to help us unlock valuable insights that drive strategic success. We’re committed to fostering an inclusive environment where your skills can thrive-empowering you every step of the way!
Benefits & conditions
Pay: $50.00 - $55.00 per hour
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
How to Become an AI Engineer