> Markdown version of [/jobs/ext/2028635-spark-solutions-architect](https://www.wearedevelopers.com/jobs/ext/2028635-spark-solutions-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Spark Solutions Architect - **Company:** Zachary Piper - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $150,000.0 - $250,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Big Data, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Distributed Systems, Python (Programming Language), Performance Tuning, Query Optimization, SQL Databases, Google Cloud, Cloud Platform System, Apache Spark, Information Technology, Machine Learning Operations, Data Pipelines, Databricks, Programming Languages - **Published:** August 11, 2026 - **Apply:** https://www.clearancejobs.com/jobs/8711557/spark-solutions-architect ## About the Role Zachary Piper Solutions is seeking multiple Spark Solutions Architect(s) to support federal customers on a variety of programs. These roles focus on solutions architecting, big data engineering, optimization, and performance tuning using Apache Spark. The ideal candidate will have strong experience in data engineering, SQL query optimization, and distributed computing. Customer-facing skills and excellent communication are essential for success in this position. Work Environment: Remote Clearance: Minimum for a DoD Secret to TS/SCI (Polygraphs can be held), * Bachelor's degree in computer science or related field required. * Minimum 5 years of experience in data engineering and solutions architecture. * Strong expertise in Apache Spark and performance optimization techniques. * Proficiency in SQL and experience with data warehousing and query tuning. * Familiarity with Python or Scala programming languages. * Working knowledge of cloud ecosystems (AWS, Azure, or GCP). * Excellent communication and customer-facing skills. * Ability to manage scope, timelines, and deliverables in technical projects. Preferred: * Experience with machine learning and data science concepts. * Familiarity with CI/CD pipelines and MLOps practices. * Knowledge of Databricks platform and big data architecture design. ## Description * Design and implement scalable data pipelines and architectures using Apache Spark. * Optimize Spark jobs for performance and efficiency across large datasets. * Collaborate with clients to understand requirements and deliver technical solutions. * Support data engineering tasks including ETL, data warehousing, and query optimization. * Assist with integration of Spark-based solutions into cloud environments (AWS, Azure, GCP). * Provide technical guidance on best practices for big data processing and analytics. * Participate in short- to medium-term customer engagements, ensuring successful delivery of projects. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Flex your Energy: Building a Cloud-Native Platform for Renewable Energy Communities](https://www.wearedevelopers.com/videos/1990-flex-your-energy-building-a-cloud-native-platform-for-renewable-energy-communities) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Let's Get Aggregated: Custom UDAFs in Spark ](https://www.wearedevelopers.com/videos/1649-let-s-get-aggregated-custom-udafs-in-spark) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)