Senior Data Engineer/Orchestration Specialist

Macpower Digital Assets Edge LLC
San Francisco, CA, United States
4 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Query Performance JavaScript (Programming Language) Airflow Amazon Web Services Amazon S3 Big Data BigQuery Computer Programming Information Engineering Data Infrastructure Data Integrity Python (Programming Language)
+7 more
Software Engineering SQL Databases Data Processing Cloud Platform System Data Management Looker Analytics Data Pipelines

Job description

About the role: We are seeking a talented and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in building and maintaining data pipelines, developing and managing dashboards, and contributing to tool development. Your expertise will enable us to efficiently process and analyze large volumes of data, providing valuable insights to drive business decisions.

What you’ll be working on:

  • Build scalable and efficient data pipelines to collect, process, and transform large volumes of data from diverse sources.
  • Develop and maintain data models, ensuring data integrity and optimizing query performance.
  • Collaborate with stakeholders to understand their data requirements and provide the necessary infrastructure and support.
  • Build and maintain interactive dashboards and visualizations to enable data-driven decision-making across the organization.
  • Contribute to the development of internal data tools and frameworks, automating repetitive tasks and improving data accessibility and usability.
  • Stay up to date with the latest advancements in data engineering technologies and best practices and proactively recommend improvements to our data infrastructure.
  • Mentor and provide guidance to junior data engineers, fostering a culture of learning and growth.

Interview process:

  1. Potential Recruiter Screen
  2. Hiring Manager Screen (Technical)
  3. Virtual Onsite: Two Coding/Problem solving sessions (1 hour each)
  4. Offer Stage

Requirements

Must have:

  • Experience: 4 years of experience as a Data Engineer
  • Experience: hands-on experience building or maintaining data pipelines with a modern orchestration tool like Airflow/Prefect/Dragster.
  • Technical Skills: strong programming skills in languages like Python, Scala or JavaScript, with a solid understanding of software engineering principles.
  • Technical Skills: strong expertise with SQL and non-SQL DBs, cloud-based data platforms (e.g., AWS, GCP) and their related services (S3, Big Query, etc.).
  • SQL: Expert level writing of SQL for data manipulation, transformation and for analytics.
  • Dash Boarding: Experience building and maintaining interactive and intuitive dashboards using tools like Looker.
  • Development: Comfortable with tool development, including building and enhancing internal data tools and frameworks.

Benefits & conditions

Nice to have:

  • Prior Startup Experience: Experience scaling from Series A/B through later stages.
  • Business Model Experience: B2C and B2B experience and payments experience would be a bonus.

Benefits: Medical, Dental, Vision, Paid time off, Parental leave, Parental leave.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…