Senior Data Engineer
LineVision, Inc.
Boston, United States of America
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Shift work Languages
English Experience level
Senior Compensation
$ 160KJob location
Boston, United States of America
Tech stack
Query Performance
Airflow
Amazon Web Services (AWS)
Business Analytics Applications
Databases
Information Engineering
Data Infrastructure
Data Integrity
ETL
Relational Databases
DevOps
Python
Operational Databases
Power BI
Software Engineering
SQL Databases
Data Streaming
Tableau
System Availability
Amazon Web Services (AWS)
Data Lineage
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data Pipelines
Job description
- Design, build, and lead data pipelines that ingest and process diverse data sources, architecting seamless integration into LineVision's data platform
- Own system of record architecture and lead implementation of next-generation data infrastructure supporting company growth
- Lead cross-functional collaboration with Infrastructure, Data Science, Product, Marketing, Finance, and Research teams to define data needs and architect solutions
- Design monitoring, alerting, and metadata systems for data pipelines, setting standards for proactive issue detection and operational reliability
- Lead optimization of relational database systems for query performance, high availability, and resilience, * Establish relationships with key stakeholders across Engineering, Product, and Business teams to understand current data infrastructure and requirements
- Complete onboarding on existing data pipelines and architecture, demonstrating command of LineVision's data flows and AWS infrastructure
- Take ownership of multiple critical data pipelines, identifying gaps and proposing architectural improvements
Within the first 6 months:
- Design and lead the build of monitoring and alerting systems across assigned pipelines, improving observability and incident detection
- Architect an automated archiving and lifecycle management solution for object stores or databases, optimizing storage costs, * Lead migration execution of multiple critical databases into a unified environment, establishing patterns for others to follow
- Own a schema management, data registry, or cataloging solution end to end, enabling discoverability and lineage tracking
- Lead migration and self-hosting of business intelligence platform components with minimal guidance
Requirements
- Advanced proficiency in Python and SQL, with a track record designing and optimizing production data pipelines
- Deep experience with AWS storage and compute services (Lambda, RDS, SQS, AWS Glue, Athena, or similar), including architecture-level trade-off decisions
- Strong background in data modeling, ETL design, and job orchestration frameworks such as Apache Airflow, with experience leading small to medium-scale projects
- Outstanding collaboration and communication skills, with proven ability to lead technical discussions across diverse audiences, * Experience working with large volumes of real-time time-series data in production environments
- Experience mentoring or informally leading other engineers on pipeline design and best practices
- Familiarity with analytical tools such as Tableau or Power BI, understanding downstream consumption of data pipelines
- Demonstrated ability to independently execute complex migrations with attention to data integrity and reliability
- Hands-on experience with sensor data pipelines using lambda functions
Reporting & Team Structure
- Reports to the Sr Data Engineering Lead
- Collaborates closely with Data Science, Software Engineering, DevOps, Product Management, and Business Operations teams, + Panel 1: Technical competency & experience
- Panel 2: Teamwork, culture fit, and collaboration
- Final Round: Leadership Team & Hiring Manager Sign-Off
Benefits & conditions
Pulled from the full job description
- Paid time off
- Flexible schedule, * Ownership. You will hold broad responsibilities with high autonomy and trust in a communicative, collaborative, and fast-paced environment.
- Flexibility. You will be empowered to maintain work-life balance with trust-based PTO and a flexible work schedule.
- Real World Innovation. You will join a motivated and high-performing team working with cutting edge, patented technology to help solve key obstacles to meet the demands of an AI-powered future.
About the company
LineVision is a grid-enhancing technology company enabling electric utilities to deliver affordable, reliable power and accelerate the electrification of the global economy. Our grid intelligence platform delivers the most accurate, network-wide dynamic line ratings and enables safer, more reliable grid operations with a combination of optical sensors and advanced environmental modeling. LineVision's global customer base includes eight of the ten largest US utilities, including National Grid, Southern Company, and Exelon.
We are LineVisionaries:
* We are Innovators: We light the way with tenacious creativity and do good work.
* We are Empowered: With high trust and high autonomy, the floor is yours, and the opportunity is ours.
* We are Welcoming: Come as you are, our doors are open. We are better together.
* We are Trusted Partners: We elevate our customer champions through shared thought leadership. We deliver on commitments.
* We are All In: We are building a community of passionate individuals who want to dent the universe.
At LineVision there's no such thing as a "perfect" candidate. We are looking for exceptional people who want to make a positive impact through their work and facilitate an organization where everyone can thrive. So whatever background you bring with you, please apply if this role would make you excited to come to work every day.