Senior Data Engineer - Data Analytics & BI

New Era Technology
San Jose, CA, United States
9 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Business Analytics Applications Data Analysis Microsoft Azure Big Data Software Code Optimization Databases Data Dictionary Information Engineering Data Integrity Extract Transform Load (ETL)
+33 more
Data Transformation Data Systems Data Visualization Relational Databases Decision Support Systems DevOps Distributed Data Store Apache Hadoop Apache Hive Internet Communications Python (Programming Language) Machine Learning MongoDB NoSQL Query Optimization Runbook SQL Databases Tableau (Software) Visual Studio Online Workflow Management Systems Jupyter Notebook Google Cloud Cloud Platform System Delivery Pipeline Apache Spark Information Technology Cassandra Data Analytics Data Management Presto Data Pipelines Custom Reports Programming Languages

Job description

The Senior Data Engineer designs, builds, and maintains large-scale data infrastructure and analytics solutions that power business insights across the organization. The ideal candidate brings deep expertise in SQL, Python, and data visualization, with a strong track record of delivering self-service reporting platforms, scalable ETL pipelines, and high-quality dashboards that enable data-driven decision making. In this role, you will partner closely with cross-functional stakeholders to translate complex data needs into clear, actionable solutions while upholding engineering best practices in architecture, performance, and data quality., * Triage requests for people data and ad hoc reports, prioritize requests, and effectively communicate appropriate delivery expectations.

  • Collaborate with partners and stakeholders to create dashboards that display meaningful and actionable key performance indicators (KPIs).
  • Create visualizations from which leaders can easily draw insights and recommendations.
  • Build and automate easy-to-use, self-service reports and dashboards.
  • Provide direction and coaching to end users on how to use and interpret metrics.
  • Document reporting requirements with partners by collaborating with relevant Data Analytics team members on iterations and changes to core dashboards and solutions.
  • Pull, organize, and analyze relevant data from multiple sources using tools such as Tableau, VS Code, and Jupyter Notebook, and programming languages such as SQL and Python.
  • Partner and align with cross-functional teams including Data Engineering and Data Science, executing best practices in data gathering, pipeline design, and analytics.
  • Audit data integrity, investigate concerns, and establish processes to streamline and improve data quality.
  • Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver data from diverse internal and external sources.
  • Improve the performance of ETL tasks through good architecture and code optimization.
  • Be part of the on-call team and monitor and address operational issues to ensure reliability and uptime of data systems.
  • Stay current with emerging trends in data engineering, analytics tooling, and cloud-based data platforms.

Requirements

  • Experience with Apache Hive and Presto for large-scale distributed query processing.
  • Familiarity with machine learning algorithms and data science workflows.
  • Experience with large-scale data migration projects, including requirements gathering, pipeline design, and operational support.
  • Mentoring experience with junior engineers and analysts.
  • Familiarity with DevOps principles and their application to data management and deployment workflows., * BA/BS/MS in a field that emphasizes data analysis and visualization (e.g., computer science, social sciences, physical sciences, math, engineering, or statistics), or equivalent work experience., * 8+ years of experience with SQL, including complex query optimization and working with large-scale relational and columnar databases.
  • 5+ years of experience in Python for data engineering, including pipeline development, automation, and data transformation.
  • 8+ years of experience creating custom reports and dashboards and building visualizations in Tableau or comparable tools.
  • Experience with data management, specifically validating and auditing data and reports from multiple systems.
  • Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform, and distributed data technologies such as Spark or Hadoop.

LANGUAGE SKILLS:

  • Excellent presentation and communication skills, including the ability to explain technical subject matter to a non-technical audience and influence stakeholders at all levels.
  • Ability to produce clear technical documentation including design specs, runbooks, and data dictionaries., * Proficiency in SQL and relational database systems, as well as NoSQL databases such as MongoDB or Cassandra.
  • Strong Python programming skills with experience in orchestration tools such as Apache Airflow and data transformation tools such as DBT.
  • Demonstrated ability to navigate ambiguity and operate effectively in a fast-paced, rapidly evolving environment, shifting fluidly between strategic initiatives and tactical analysis requests.
  • A “do it the right way” mindset with commitment to proper documentation, thorough testing, and engineering excellence.

PHYSICAL DEMANDS: Regular use of hands and fingers to operate a computer keyboard, mouse, and other office equipment. Regular, repetitive movements such as typing, mouse movements, and scrolling. Ability to hear and understand spoken communications, both in person and via remote communication tools (e.g., phone, video conferencing). Ability to see and read computer screens and printed documents, as well as adjust focus. This includes prolonged periods of looking at a computer screen.

About the company

Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 3,000 professionals, we’re committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale.

At New Era, you’ll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Guided by our core attributes - putting people first, embracing continuous learning, and thriving through collaboration and inclusion - we nurture our people to deliver exceptional customer service.

If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work-together

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:22 min

Analyzing differences between mobile and traditional backend DevOps

Mete Baydar Mete Baydar · World Congress 2025

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:27 min

Defining DevOps through its historical origins and foundational texts

Sonal Patil · LIVE

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all