Data Engineer
Role details
Job location
Tech stack
Job description
Join our innovative team as a Data Engineer and become a vital driver of our data-driven decision-making process! In this role, you will design, develop, and maintain robust data pipelines and architectures that empower our organization to harness the full potential of big data. Your expertise will enable seamless integration of diverse data sources, optimize data storage solutions, and facilitate insightful analytics. If you thrive in a fast-paced environment where your technical skills can make a real impact, this is the perfect opportunity to elevate your career in data engineering!, * Develop and implement scalable ETL (Extract, Transform, Load) processes using tools like Informatica, Talend, or custom scripting with Python, Bash, or Shell Scripting to ensure efficient data flow across systems.
- Design and maintain data warehouses and lakes utilizing platforms such as Azure Data Lake, Hadoop, or Apache Hive to support advanced analytics and reporting.
- Build and optimize data models for analytical applications using SQL, Java, or Python to enhance query performance and data accessibility.
- Collaborate with cross-functional teams to gather requirements and translate them into technical solutions that support business insights.
- Manage cloud-based infrastructure on AWS and Azure, leveraging services like Spark for big data processing and Model training for machine learning initiatives.
- Ensure data quality, security, and compliance by implementing best practices in database design and access controls.
- Develop RESTful APIs for seamless data integration between systems while supporting agile development methodologies.
Requirements
- Proven experience with cloud platforms such as AWS or Azure, including familiarity with services like Azure Data Lake or AWS EMR.
- Strong programming skills in Java, Python, Bash (Unix shell), or Shell Scripting for automation and custom solution development.
- Extensive knowledge of big data technologies including Hadoop, Spark, Apache Hive, and related ecosystems.
- Hands-on experience with SQL databases such as Microsoft SQL Server, Oracle, or similar relational database systems; proficiency in database design is essential.
- Familiarity with ETL tools like Informatica or Talend to streamline data workflows efficiently.
- Ability to analyze complex datasets using analytics tools like Looker or equivalent BI platforms for reporting purposes.
- Understanding of linked data concepts and experience working with RESTful APIs for system integrations.
- Knowledge of model training techniques and analysis skills to support machine learning projects is a plus.
- Experience working in Agile environments with strong collaboration skills to adapt quickly to evolving project needs. Embark on a journey where your technical expertise fuels innovation! We're dedicated to fostering an inclusive environment that supports your growth while offering opportunities to work on cutting-edge technologies in the realm of big data and cloud computing. Join us in transforming raw data into actionable insights that drive strategic success!
Benefits & conditions
$30 - $40 an hour - Contract, Pulled from the full job description
- Relocation assistance
- Flexible schedule