Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of robust data systems that empower insightful decision-making. In this role, you will design, build, and maintain scalable data pipelines and architectures that support large-scale data processing and analytics. Your expertise will enable the organization to harness the full potential of its data assets, ensuring seamless integration across diverse platforms and tools. If you thrive in a fast-paced environment where cutting-edge technology meets business needs, this is your opportunity to make a significant impact., * Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from various sources into data warehouses and lakes.
- Design and maintain scalable data models and schemas using dimensional modeling techniques for business intelligence and analytics purposes.
- Manage big data systems utilizing Hadoop, Spark, Apache Hive, and cloud-based solutions such as Azure Data Lake and AWS.
- Collaborate with cross-functional teams to integrate linked data sources and ensure data quality, consistency, and security across platforms.
- Build and enhance data management integration processes using tools like Informatica, Talend, and RESTful APIs for seamless data exchange.
- Support the development of analytics solutions by working with SQL databases like Microsoft SQL Server, Oracle, and cloud databases to enable advanced query management.
- Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement initiatives for data engineering workflows.
Requirements
- Proven experience designing and implementing large-scale big data systems with technologies such as Hadoop, Spark, Apache Hive, or similar frameworks.
- Strong proficiency in SQL programming with experience in SQL databases including Microsoft SQL Server, Oracle, or cloud-based options like Azure Data Lake or other cloud databases.
- Hands-on expertise in software development using Java, Python, Bash (Unix shell), Shell Scripting, or VBA for automation and pipeline development.
- Familiarity with cloud platforms such as AWS or Azure Public Cloud environments for deploying scalable data solutions.
- Knowledge of data warehousing design principles including dimensional modeling and ETL pipeline development for efficient data storage and retrieval.
- Experience working with business intelligence tools like Looker or similar platforms for creating dashboards and visualizations.
- Excellent analysis skills with the ability to interpret complex datasets and support model training initiatives.
- Strong understanding of data management integration practices including RESTful API development and linked data concepts.
- Ability to work effectively within an Agile environment while managing multiple priorities simultaneously.
Join us to leverage your expertise in big data systems, cloud technologies, and software development-helping us transform raw information into strategic insights that drive our success!
Benefits & conditions
Pulled from the full job description
- 401(k), * 401(k)