> Markdown version of [/jobs/ext/1320987-software-engineer](https://www.wearedevelopers.com/jobs/ext/1320987-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer

- **Company:** 6 Sense Insights, Inc.
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Salary:** $179,400.0 - $263,120.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Data Analysis, Big Data, Data Integration, Extract Transform Load (ETL), Data Systems, Django Web Framework, R (Programming Language), Apache Hadoop, Apache Hive, SQL Databases, Data Ingestion, Apache Spark, Build Management, Information Technology, Apache Flink, Apache Kafka, Presto, Software Coding, Data Pipelines
- **Published:** July 17, 2026
- **Apply:** https://www.dice.com/job-detail/7ff8272f-a380-4896-9879-505b6df4eb07

## About the Role

You are a Data Engineer, who is passionate about writing beautiful code and building great products. You have an intuitive sense of the right tools and frameworks to use to solve a given problem. You are not afraid to traverse the entire spectrum of the development process from writing code and testing to deploying and managing your systems in production. You are smart but know that there is no substitute for hard work. You have good communication skills, a 'can do' entrepreneurial attitude, and a team-oriented mindset., * BS/MS degree in Computer Science or related technical field or equivalent practical experience

 * Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka etc.)
 * Experience with performing data analysis, data ingestion and data integration
 * Experience with ETL (Extraction, Transformation & Loading) and architecting data systems
 * Experience with schema design, data modeling and SQL queries
 * Hands-on experience using modern AI coding assistants (e.g., Claude Code, Windsurf, or equivalent) to design, implement, and optimize data pipelines and large-scale data processing systems
 * Passionate and self-motivated about technologies in the Big Data area

Nice to Have Skills

 * Experience with Django framework
 * Exposure to AWS

Interpersonal Attributes

 * You can work independently as well as part of a team
 * You take ownership of projects and drive them to conclusion
 * You're a good communicator and are capable of not just doing the work, but teaching others and explaining the "why" behind complicated technical decisions
 * You can present your architecture and designs to cross teams
 * You aren't afraid to roll up your sleeves: This role will evolve over time, and we'll want you to evolve with it!

## Description

* Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)
 * Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
 * Establish strong engineering design standards and best practices for both technical and non-technical stakeholders


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Software Engineer Career: Things You Should Know](https://www.wearedevelopers.com/magazine/143-software-engineer-career-things-you-should-know)
- [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)
- [7 Important Tips That Every Software Developer Should Know](https://www.wearedevelopers.com/magazine/101-7-important-tips-that-every-software-developer-should-know)