Data Engineer (BigQuery / Cloud Data Platforms)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+36 more
Job description
- Design, build, and maintain scalable ELT/ETL data pipelines ingesting structured and semi-structured data from cloud services, APIs, databases, and file sources into BigQuery and other cloud data warehouses.
- Develop and manage data models, schemas, and transformation logic using dbt (data build tool), SQL, and Python; enforce testing and documentation standards across the data layer.
- Implement and operate pipeline orchestration using Apache Airflow (Cloud Composer), Prefect, or equivalent; monitor pipeline health, SLA adherence, and failure alerting.
- Integrate data platforms with upstream source systems including cloud-native services (AWS RDS, Azure SQL, GCS/S3), operational databases, and third-party SaaS APIs.
- Implement data access controls, column-level security, and encryption within BigQuery and related cloud storage services aligned to FedRAMP High and FISMA requirements.
- Build and maintain data cataloging and lineage metadata practices to support data governance and auditability requirements.
- Collaborate with Data Scientists and analysts to ensure data availability, schema stability, and performance of analytical workloads.
- Develop and maintain infrastructure-as-code for data platform components using Terraform; participate in CI/CD pipeline integration for data assets.
- Support data quality frameworks - profiling, anomaly detection, and SLA monitoring - across production data pipelines.
- Contribute to ATO documentation and data security controls including data classification, retention policies, and audit logging.
Requirements
Do you have experience in Security compliance frameworks implementation?, Do you have a Bachelorâs degree?, You build data pipelines that run reliably in production - not just demos. Youâve designed schemas and ingestion pipelines against messy, real-world source systems, you understand data quality as an engineering discipline, and you can work comfortably within the access controls and compliance requirements of a federal environment., * 3 to 6 years of progressive, hands-on experience in data engineering with a focus on cloud data platforms and pipeline development.
- Bachelorâs degree in Computer Science, Data Engineering, Information Systems, Mathematics, or a related field. Relevant experience may substitute.
- Strong SQL skills and hands-on experience with BigQuery as an analytical data warehouse; familiarity with BigQuery optimization (partitioning, clustering, materialized views).
- Proficiency in Python for data engineering tasks (ingestion, transformation, pipeline scripting).
- Experience with dbt for data transformation and modeling in cloud warehouse environments.
- Hands-on experience with pipeline orchestration tools: Apache Airflow, Cloud Composer, or equivalent.
- Working knowledge of cloud storage and data services across at least one major cloud provider (GCS, S3, Azure Blob Storage, Cloud Spanner, Redshift, or equivalent).
- Understanding of data modeling principles (dimensional modeling, data vault, or similar) and schema design for analytical workloads.
- Familiarity with data governance concepts - cataloging, lineage, access controls, retention - and their application in regulated environments.
- Knowledge of FedRAMP, FISMA, and NIST 800-53 data security requirements.
- U.S. Citizenship and the ability to obtain and maintain a DHS suitability / Public Trust clearance.
Desired Qualifications
- Google Cloud Professional Data Engineer certification.
- AWS Certified Data Analytics Specialty or Azure Data Engineer Associate.
- dbt certification.
- Security+ or equivalent certification.
- Experience with streaming data platforms (Pub/Sub, Kafka, Kinesis).
- DHS, or other federal data engineering experience.
- Active Public Trust or higher clearance.
Clearance
DHS suitability and a Public Trust background investigation are required for this role. Active Public Trust or higher clearance is preferred. Selected applicants will be subject to a security investigation and may need to meet eligibility requirements for access to controlled or classified information.
Benefits & conditions
Pulled from the full job description
- AD&D insurance
- 401(k)
- Health insurance
- Paid time off
- Vision insurance
- Dental insurance
- Family leave, * Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance (Basic, Voluntary & AD&D)
- Paid Time Off (Vacation, Sick & Public Holidays)
- Family Leave (Maternity, Paternity)
- Short Term & Long Term Disability
- Training & Development
- Work From Home
- Wellness Resources
- Employee Bonus Programs
About the company
Northramp is seeking a Data Engineer to join the team supporting the clientâs Cloud BPA Bridge program - a mission-critical effort to consolidate, modernize, and operate the clientâs enterprise cloud services across IaaS, PaaS, and SaaS environments under FedRAMP High authorization.
You will design and operate cloud-native data pipelines, warehousing, and integration layers that make the clientâs data accessible, reliable, and analytics-ready. The role centers on modern cloud data platforms - with BigQuery as the primary analytical data warehouse - supporting the clientâs enterprise reporting, AI/ML, and program management data needs.
This role is part of Northrampâs integrated delivery model, where engineers and advisors work as one team to bring sound judgment, disciplined execution, and deep federal experience to high-stakes modernization programs., Northramp is a federal consulting firm that helps agencies modernize and operate mission-critical systems with sound judgment, disciplined execution, and deep federal experience. We specialize in high-stakes digital transformation in highly regulated environments where failure is not an option. Our integrated delivery model brings engineers and advisors together as one team, combining technical depth with an operatorâs mindset to move organizations from strategy to execution with confidence.
We hold high standards because our clientsâ missions demand it, and we support our people in meeting them. Northramp is where you are challenged, trusted, and supported - a place for people who take pride in their work, value clarity and follow-through, and want to make a meaningful impact through technology.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developerâs Story
Highest Paying Tech Companies for Developers
What Are The Top Skills Required For Azure Developers?
Top Big Data Technologies That You Need to Know