Data Engineer - Remote

ConsenSys Software Inc. is a wide organization with each individual business unit facing unique data challenges. Infura needs to provide real time analytics on top of a data pipeline doing billions of events per day. MetaMask Swaps needs to provide financial accounting for a purely on chain data source. Truffle needs to track developer engagement across the open source ecosystem. We are looking for a data engineer to join our shared data engineering team, with a goal of helping to build, maintain and evolve our data warehouse to support the organization. You will join a team to work with the business to ensure we have a first class data warehouse supporting our business units and our business decision making. Some of the key areas you will help ensure we are doing well are:

• data quality

• data governance

• master data management Responsibilities:

• Understanding of the business and data strategy

• Contribute to the collection, storage, management, quality, and protection of data

• Implementing data privacy policies and complying with data protection regulations

• Effectively communicate the status, value, and importance of data collection to executive members and staff

• Knowledge of relevant applications, big data solutions, and tools

• Knowledge of real time streaming data pipelines

• Governance: Advising on, monitoring, and governing enterprise data

• Operations: Enabling data usability, availability, and efficiency

• Innovation: Driving enterprise digital transformation innovation, cost reduction, and revenue generation

• Analytics: Supporting analytics and reporting on products, customers, operations, and markets

• 5+ years of work experience in an enterprise engineering domain

• Excellent problem-solving skills and sharp attention to detail

• Solid written and verbal communication skills

• Proficient in Python programming and well versed with popular frameworks like Pandas, Flask, Airflow, Apache Beam etc.

• Experience with any one cloud technologies i.e GCP, AWS or Azure (GCP preferred)

• Hands on experience with Cloud function, Big Query, DataFlow, Cloud Run, Airflow etc.

• Strong with Linux Commands and Shell Scripting

• Experience with Docker & Kubernetes

• Experience building CI/CD pipelines

• Knowledge of any one SCM tools like Git, BitBucket etc.

• Strong knowledge on Terraform scripting

• Strong skills with writing SQL

• Enthusiasm for shipping high-quality code and helping peers do the same

• Proactiveness and be self-driven to be successful working in a remote environment

• Understanding of web development practices and terminology

• Relevant knowledge of cloud security and data security

• A belief in our mission and values Bonus points:

• Blockchain expertise

• Hands-on experience with Kafka

• Hand-on experience with Apache Spark (py-spark preferred)

Volver a la última búsqueda Trabajos ) Data Engineer (Remote) ( volver a la última búsqueda Recibir ofertas similares por correo electrónico No gracias, llévame a la oferta de empleo Al crear una alerta, aceptas nuestros Términos y condiciones y Política de privacidad, y el uso de cookies. Inscribirse en esta oferta Profesiones + Técnico + Recepciónista + Administrador + Ventas + Enfermero