Senior Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a highly skilled and motivated Senior Data Engineer to lead the design, development, and maintenance of our enterprise data infrastructure. In this dynamic role, you will harness the power of big data technologies and cloud platforms to enable insightful analytics and data-driven decision-making. Your expertise will drive the creation of scalable data pipelines, optimize data storage solutions, and support advanced analytics initiatives. Join us to empower our organization with innovative data solutions that fuel growth and strategic insights., * Design, develop, and optimize robust ETL (Extract, Transform, Load) processes to integrate data from diverse sources such as AWS, Azure Data Lake, Hadoop, and on-premises systems.
- Build scalable data pipelines utilizing Apache Spark, Hadoop ecosystem components (e.g., Hive), and Python scripting to process large volumes of structured and unstructured data efficiently.
- Develop and maintain data warehouses leveraging SQL Server, Oracle, and other relational databases; ensure high performance and security standards.
- Collaborate with cross-functional teams to implement data models, database designs, and linked data architectures that support analytics and reporting needs.
- Utilize tools like Talend, Informatica, and Shell Scripting to automate workflows and streamline data processing tasks.
- Integrate RESTful APIs for seamless data exchange between systems; support model training activities for machine learning initiatives.
- Work within Agile methodologies to deliver continuous improvements in data infrastructure while maintaining documentation for compliance and knowledge sharing.
Requirements
- Proven experience as a Data Engineer or similar role with a focus on big data technologies such as Hadoop, Spark, Hive, and Azure Data Lake.
- Strong proficiency in SQL (including Microsoft SQL Server and Oracle), Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks.
- Hands-on experience designing scalable data warehouses and implementing ETL pipelines using tools like Talend or Informatica.
- Familiarity with cloud platforms such as AWS and Azure for deploying large-scale data solutions.
- Knowledge of database design principles, linked data concepts, RESTful API integration, and model training techniques for machine learning applications.
- Excellent analysis skills with the ability to interpret complex datasets; experience with Looker or similar BI tools is a plus.
- Strong understanding of Agile development practices to facilitate iterative project delivery in fast-paced environments. Join us as a Senior Data Engineer to shape the future of our organization's data landscape! Bring your passion for innovation, technical expertise in big data ecosystems, cloud platforms, and analytics to help us unlock valuable insights that drive strategic success. We're committed to fostering an inclusive environment where your skills can thrive-empowering you every step of the way!
Benefits & conditions
Pay: $50.00 - $55.00 per hour