> Markdown version of [/jobs/ext/4366839-data-engineer-california-college-guidance-initiative](https://www.wearedevelopers.com/jobs/ext/4366839-data-engineer-california-college-guidance-initiative). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer, California College Guidance Initiative - **Company:** Foundation Inc - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $120,000.0 - $145,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Business Analytics Applications, Data Analysis, JIRA, Cloud Computing, Cloud Database, Information Systems, Databases, Information Engineering, Data Files, Extract Transform Load (ETL), Data Transformation, Data Structures, Data Warehousing, Relational Databases, Database Queries, Integrated Development Environments, Python (Programming Language), PostgreSQL, Metadata, Microsoft SQL Server, MySQL, Standard Sql, Salesforce.Com, Shell Script, SQL Databases, Data Streaming, Systems Integration, Talend, Unstructured Data, Jupyter Notebook, Scripting, Data Storage Technologies, Cloud Platform System, Snowflake, Apache Spark, Event Driven Architecture, Containerization, Information Technology, Slack, Apache Kafka, Build Process, Data Management, Data Delivery, Data Pipelines, Serverless Computing, Amazon Redshift - **Published:** October 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=41f7ab221d3982ae ## About the Role The ideal candidate has extensive experience building out data ETL/ELT workloads, including the testing, maintenance, and refinement of containerized workloads in cloud architectures. The Data Engineer should also have experience successfully scaling up an organization's data intake from batch to streaming data, as well as automating data delivery. This person is comfortable working with data storage and can troubleshoot data accessibility via SQL, Python, shell scripting, AWS, Snowflake, and take on a leadership role in special projects when needed. Additionally, this person should have experience developing technical documentation and implementing security governance protocols. While there are no direct supervisory responsibilities for this position, the ideal candidate will have proactively and successfully collaborated with other subject matter experts to move time-bound projects to completion. Additionally, the ideal candidate will have experience working with K-12 or education data and/or have an interest in large educational systems and the equity challenges students face when navigating such systems. We work to solve large scale, system-level problems. You must be comfortable working with unknowns and ambiguous solutions, as well as passionate about promoting public education and advancing educational equity. This role reports to the Director, Cloud Infrastructure., * Relevant BA/BS in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. * Minimum of three (3) years of experience as a Data Engineer or a related role. * Ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management. * Advanced proficiency with cloud data warehousing analytical tools such as Snowflake, Redshift, Spark, Kafka, etc. * Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases. * Advanced proficiency using ETL tools like Jupyter Notebooks, dbt, Talend, etc. * Advanced proficiency with scripting languages like Python, Scala, R, etc. * Advanced proficiency building and optimizing data pipelines and data sets. * A successful history of manipulating, processing and extracting value from large structured and unstructured datasets. * Demonstrated ability to consistently develop strong technical documentation * Advanced certifications such as SnowPro Core, AWS Cloud Practitioner Certification, or AWS Certification, Solutions Architect - Associate are a plus Experience working with K-12 data and/or education data is encouraged * What Intangibles Do You Need? * Strong data analysis and decision-making skills with the ability to take abstract brainstorming and generate concrete proposals for action. * Ability to advance projects without detailed supervision, prioritize tasks, and effectively manage multiple projects simultaneously * Experience supporting and collaborating with cross-functional teams in a dynamic environment. * Commitment to developing and maintaining trusting professional relationships, giving and receiving direct feedback, and modeling CCGI's values. * Ability to write with attention to accuracy, audience, and concision within task tickets in project management tools like Jira. * Excellent verbal communication skills and the ability to communicate complex information simply with both technical and non-technical audiences. A commitment to increasing educational access and equity. * ## Description * Lead the development, maintenance, and optimization of batch and streaming ETL/ELT processes, including the development, refinement, and containerization of data loading and processing using event driven architecture and workflow orchestration. * Develop, containerize, test and maintain workflows within integrated development environments (IDEs) using AWS cloud services, Snowflake data warehouses, Python and SQL scripts, dbt, and shell scripts. * Review, redesign, and expand data models supporting data warehousing and self-service business intelligence architecture to create fully automated data pipeline(s) from staged or streamed data to organization of data warehouse objects and producing access via reporting, alerts or API access. * Design and implement data pipeline automation requiring Python scripting and SQL statements, integrating with systems such as Salesforce, Slack and AWS services using serverless, cloud servers and containerized systems. * Participate in meetings, research processes, requirement collection, data analysis, and collaborate with the key project collaborators.stakeholders of your projects. * Develop and maintain expert knowledge of CaliforniaColleges.edu data, systems, and business processes. * Continuously improve data pipelines and architecture by staying updated on industry trends and best practices. Other duties as assigned by your supervisor. *, This role will join a team of 5 experienced data engineers, working remotely across California, to oversee all of CCGI's internal cloud-based data infrastructure. This includes overseeing the entirety of CCGI's data warehousing, data engineering, and data orchestration systems, as well as user-centered data product design and development. We are looking for candidates who bring experience with them to the role and are interested in joining a collaborative environment that encourages ongoing knowledge sharing and professional development. The Cloud Infrastructure team works regularly with other technical teams at CCGI as well as our student- and educator-facing teams to build sustainable and innovative technical solutions to advance our mission and goals. This role reports to the Director, Cloud Infrastructure.