> Markdown version of [/jobs/ext/2026372-software-engineer-data-engineering](https://www.wearedevelopers.com/jobs/ext/2026372-software-engineer-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Data Engineering

- **Company:** Verse Inc.
- **Location:** San Francisco, CA, United States (Remote available)
- **Experience:** Expert
- **Salary:** $180,000.0 - $250,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Amazon S3, Apache HTTP Server, Acceptance Test-Driven Development, Big Data, BigTable, BigQuery, Cloud Computing, Code Review, Databases, Information Engineering, Data Infrastructure, Data Systems, Data Visualization, Protocol Buffers, Apache Hadoop, Apache HBase, Apache Hive, Python (Programming Language), PostgreSQL, Software Maintenance, DataOps, Scala (Programming Language), Software Engineering, Data Streaming, System Testing, Rust (Programming Language), Parquet, Scripting, Enterprise Software Applications, Computer Network Operations, Snowflake, Apache Spark, Event Driven Architecture, Data Lakes, Kubernetes, Information Technology, Apache Flink, Avro, Star Schema, Apache Kafka, Data Management, Machine Learning Operations, Presto, Vertica, Data Pipelines, Amazon Redshift, Databricks, Programming Languages
- **Published:** August 11, 2026
- **Apply:** https://www.careerbuilder.com/job-details/software-engineer-data-engineering-san-francisco-ca--2a3d2b7f-cefb-437a-b769-6e5f57c39053

## About the Role

* Advanced software development skills in Python, Rust, Java, Scala, or similar data-oriented language ecosystems
 * Deep understanding of databases, data {lake,ware}house architectures, and data pipeline solutions across heterogeneous data and workloads in cloud-native environments
 * Proficiency in carefully handling large, complex data and processing them (streaming and batch) in both transactional and analytical settings
 * Commitment to delivering high quality software on time or ahead of schedule while adhering to best software development practices
 * Continuous obsession for staying informed on contemporary technologies, tools, libraries, services, frameworks, or breakthroughs that could benefit the team
 * Discipline using generative AI tools in day-to-day work

What Will Make You Standout (Preferred Qualifications)

 * Bachelor's or master's degree in Computer Science, Data Science, or a related field
 * Senior level software development talent and up
 * Proven track record being a technical leader in high-performing data engineering teams
 * Intimate knowledge of scaling "big data" solutions in cloud-based environments
 * Hands on experience deploying and maintaining software such as Hadoop, Spark, Airflow, DBT, Dagster, Temporal, Presto/Trino, Iceberg, AlloyDB, Postgres, HBase, BigQuery, BigTable, Fabric, Hive, RedShift, S3, GCS, etc.
 * Experience building event-driven architectures with streaming tools such as Kafka, NATS, GCP Pub/Sub, Kinesis, Bufstream, Flink, Beam
 * Knowledge of managed or hosted data solutions such as Databricks, Snowflake, ClickHouse, Tinybird, etc
 * Practical knowledge working with data in formats like Parquet, Avro, Protobuf, time series, text, image, video
 * Working closely to support AI/ML-focused teams (knowledge of MLflow and Ray is a big a plus)
 * Comfort building internal dashboards and data-focused visualizations, Analysis Skills, Apache Avro, Artificial Intelligence (AI), Best Practices, Big Data, Cloud Computing, Code Reviews, Communication Skills, Computer Science, Customer Relations, Data Formats, Data Lake, Data Management, Data Quality, Data Science, Data Visualization, Ecosystems, Electricity, Energy Management, Enterprise Applications, Establish Priorities, GCP (Good Clinical Practices), Java, Network Operations Center, Power Generation, Python Programming/Scripting Language, Reporting Dashboards, Rust Programming Language, Scala Programming Language, Snowflake Schema, Software Development, Software Engineering, Startup, System Test, Talent Management, Technical Leadership, Technical Writing, Technical/Engineering Design, Test Design, Time Management

## Description

You will be a member of the technical staff designing, building, and maintaining the next generation of data platform tools, pipelines, and orchestration frameworks to support multiple teams and products across a diverse range of data at Verse. This role supports Core Engineering needs within the organization and builds on top of existing engineering foundations focused on data. As a technical leader with advanced data engineering expertise, teammates will look to you to vet proposals, solutions to internal and customer-facing problems, system designs, and drive the implementation of these solutions with highest standards of software-engineering best practices. You will be an integral part of scaling our data platform as the company grows., * Ensure data quality, contracts and integrity with best practices around access, governance, and federation throughout the data lifecycle

 * Implement, maintain, and promote best practices and hygiene in our dataland code repository for others to follow and emulate
 * Write shared libraries and reusable data tools across a variety of data flows, sources, and sinks
 * Partnering closely with our Data Science and data-heavy internal teams to support various analytical and AI/ML workflows
 * Foster a culture and mindset of well-designed systems, test-driven software, and proactive communication with a high degree of transparency, mutual respect, and consideration for teammates
 * Participate in code reviews, maintain technical documentation, and adhere to best software development practices


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure)
- [Green Cloud Computing](https://www.wearedevelopers.com/videos/592-green-cloud-computing)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Answer the Interview Question: “Why Do You Want to Be a Software Engineer?”](https://www.wearedevelopers.com/magazine/392-how-to-answer-the-interview-question-why-do-you-want-to-be-a-software-engineer)