> Markdown version of [/jobs/ext/2225067-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/2225067-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Data Engineer - **Company:** OCTUS INC. - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Automation of Tests, Cloud Engineering, Code Review, Continuous Integration, Information Engineering, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Mining, Data Warehousing, Database Queries, DevOps, Python (Programming Language), Cloud Services, Software Engineering, Data Streaming, Data Ingestion, Sql Optimization, Snowflake, Grafana, Backend, Containerization, Semi-structured Data, Apache Flink, Apache Kafka, Machine Learning Operations, Amazon Simple Queue Service (SQS), Terraform, Data Pipelines, Docker, Amazon Redshift, Databricks - **Published:** August 25, 2026 - **Apply:** https://www.builtincolorado.com/auth/login?destination=/job/principal-data-engineer/10834670 ## About the Role * Strong foundation in software engineering principles, including SOLID design, modularity, and scalability. * Expert proficiency in Python for data pipeline and automation development. * Advanced SQL skills and experience optimizing complex queries and data models. * Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.). * Experience with data warehousing or lakehouse technologies (Redshift, Snowflake, Databricks, etc.). * Experience implementing and managing Terraform or similar IaC frameworks. * Strong understanding of data ingestion, transformation, and orchestration tools and patterns, including those used in AI/ML pipelines. * Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices. * 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions. * Extensive experience in a technical leadership capacity, including mentoring and leading complex data infrastructure projects end-to-end. * Familiarity with containerization (Docker) and workflow orchestration best practices. * Excellent communication, collaboration, and problem-solving skills. Nice to Have * Exposure to streaming data technologies (Kafka, Kinesis, Flink). * Experience integrating data quality and observability tools (Great Expectations, Monte Carlo, etc.). * Familiarity with Scrapy, BeautifulSoup, or other data extraction frameworks for ingestion pipelines. ## Description Octus is seeking a Principal Data Engineer to design, develop, and lead scalable data ingestion and transformation pipelines. This is a hands-on Individual Contributor (IC) role that encompasses some management duties, including mentoring, architecture guidance, and providing technical leadership. You'll play a key role in designing and maintaining robust data infrastructure that powers data platforms, products and automation initiatives across the firm. The ideal candidate is an expert Python and SQL developer with deep experience building modern data workflows using AWS services and infrastructure-as-code. Responsibilities * Lead the overarching technical strategy for the data platform, ensuring alignment between data infrastructure and long-term business goals. * Lead the design and development of data ingestion and transformation pipelines, ensuring scalability, efficiency, and reliability across diverse data sources (APIs, web data, internal feeds, etc.). * Serve as a foundational technical leader and mentor for senior engineers within the data platform team, guiding architecture, design, and implementation decisions. * Architect and manage data pipelines and orchestration workflows using AWS services such as MWAA (Airflow), Lambda, ECS, and SQS. * Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards. * Partner with data analysts, scientists, and backend engineers to ensure data consistency, discoverability, and reliability. * Apply best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data. * Ensure data quality and lineage through automated testing, monitoring, and alerting. * Promote continuous improvement through code reviews, observability practices, and team-wide knowledge sharing. * Collaborate closely with technology leadership to align data platform development with business strategy and product goals. * Stay up to date with industry trends in data engineering, cloud architecture, AI/ML integration, and automation. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)