> Markdown version of [/jobs/ext/2708461-data-engineer](https://www.wearedevelopers.com/jobs/ext/2708461-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** The Weather Company, LLC - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Agile Methodology, Amazon Web Services, Amazon S3, Data Analysis, JIRA, Unit Testing, Big Data, Concurrent Computing, Continuous Integration, Data Infrastructure, Data Integration, Data Structures, Distributed Systems, Apache Hadoop, Monitoring of Systems, Python (Programming Language), Machine Learning, Object-Oriented Software Development, Raw Data, Cloud Services, Amazon Simple Notification Service (SNS), Software Engineering, Software Systems, SQL Databases, Parquet, Data Processing, Test-Driven Development (TDD), Grafana, Concurrency, Apache Spark, Electronic Medical Records, AWS Lambda, Git, Information Technology, Cassandra, Functional Programming, Amazon Simple Queue Service (SQS), Software Version Control, Data Pipelines - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-data-engineer-the-weather-company-8129389 ## About the Role * Bachelor's or Master's in a related field, or commensurate experience * 5+ years in Computer Science, with a proven track record of successful projects. * 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK. * 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java * 5+ years of experience with SQL. * 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc. * Advanced proficiency in building data integrations using both API and file-based protocols. * Advanced proficiency with test-driven development and unit testing. * Experience with Git Version Control or similar * Experience with CI/CD pipeline patterns and best practices * Proficiency with alerting and monitoring tools like Grafana * Demonstrated ability to learn new technologies and languages. * Able to put together process documentation concisely and clearly. * Excellent written and verbal communication skills. * Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects. * Solid experience implementing high-availability, scalable cloud solutions * Strong understanding of data structures and algorithms * Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques * Solid knowledge of concurrency and concurrent programming techniquess and distributed computing techniques * Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts ## Description We're seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. In this role, you'll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases. You'll work with modern big data technologies and AWS services, contribute hands-on code, lead smaller data initiatives, and mentor junior engineers. This is an ideal role for someone who thrives in complex data environments, values strong engineering fundamentals, and enjoys turning raw data into dependable, production-ready systems. The impact you'll make: * Designs and implements sophisticated software systems using either object-oriented or functional programming techniques implemented in Python, Scala or Java languages. * Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash * Maintain an advanced level of proficiency with Computer Science/Software Engineering knowledge. * Work well independently and as part of a team, mentoring junior engineers in routine, less-complex tasks, and leading small projects * Other duties as assigned. ## Related Videos - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)