Platform Software Engineering Architect

Oracle
San Francisco, CA, United States
2 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≀ 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$163,500
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Data Analysis Apache HTTP Server Cloud Computing Cloud Foundry Data Architecture Extract Transform Load (ETL) Data Structures Data Warehousing Relational Databases File Systems Distributed Systems
+27 more
Memory Management Oracle Exadata Intrusion Detection Systems Java Virtual Machine (JVM) JSON Python (Programming Language) Metadata Meta-Data Management Performance Tuning Query Optimization Migration Manager Software Engineering PL-SQL System Software Parquet Data Ingestion Sql Optimization Concurrency Apache Spark Infrastructure Automation Frameworks Information Technology Low Latency Presto Data Lakehouse Oracle Analytics Cloud Oracle Cloud Infrastructure Data Pipelines

Job description

We are seeking a visionary, deeply technical, and hands-on Principal Data Lakehouse Architect to spearhead the migration and evolution of our enterprise data platform. In this role, you will lead the architectural design and execution of shifting our massive, petabyte-scale monolithic enterprise data warehouse into a modern, open, and decoupled data lakehouse architecture.

This is not a purely advisory role-you will balance high-level strategic architecture with active, hands-on engineering, layout design, and performance tuning. You will be responsible for building a highly scalable, cloud-native platform capable of processing hundreds of millions of daily streaming ingestion rows (including high-volume metered usage data) while implementing robust resource guardrails for multi-tenant enterprise workloads., Core Responsibilities

  • Architecture & Migration Strategy: Lead the end-to-end architectural design and migration path from legacy monolithic relational data warehouses (e.g., Oracle Exadata) to an open data lakehouse model on cloud infrastructure.
  • Storage & Table Format Engineering: Design, optimize, and maintain open table formats using Apache Iceberg over cloud object storage (such as OCI Object Storage). Manage advanced Iceberg features including hidden partitioning, partition evolution, schema evolution (via unique field IDs), snapshot management, and compaction strategies.
  • Metadata & Catalog Management: Establish secure, enterprise-grade metadata management and access control systems utilizing centralized catalogs and metastores like OCI Data Catalog or Apache Polaris.
  • Distributed Compute & Query Engines: Architect and fine-tune distributed compute frameworks-specifically Apache Spark for heavy ETL/ELT pipelines and Trino for high-concurrency, low-latency analytical query execution.
  • Hybrid Application Development: Build and review core infrastructure tools using a highly performant combination of Java (for infrastructure robustness and concurrency) and Python/PL/SQL (for data processing pipelines and semantic integrations).
  • Workload Isolation & Multi-Tenancy: Implement hard resource guardrails and compute clusters isolated by line-of-business (LOB) to ensure intense quarter-end financial workloads and concurrent analytics processing do not suffer from resource contention.
  • Semantic Layer & Analytics Integration: Collaborate with functional architects to design scalable data structures, business ontologies, and trusted centralized datasets that interface seamlessly with enterprise reporting layers like Oracle Analytics Cloud (OAC) and next-generation conversational AI agents.

Requirements

  • Experience: Minimum 8-10+ years of experience in data architecture, enterprise data warehousing, and large-scale distributed systems, with a proven track record of delivering production-grade data lakehouses.
  • Hands-on Expertise: Deep, production-tested experience with Apache Iceberg, including internal metadata hierarchy navigation (manifest lists, manifest files, metadata JSON evolution).
  • Distributed Engines: Advanced operational engineering knowledge of Apache Spark and Trino/Presto, including query optimization, memory management, and cost-based optimizers.
  • Languages: Strong programming fluency in Java, Python, and advanced SQL/PL/SQL. Comfort navigating low-level performance considerations (e.g., concurrency, JVM tuning, and optimizing file storage formats like Apache Parquet).
  • Data Scale: Experience managing and processing massive datasets exceeding 1 Petabyte in size, with daily ingestion pipelines handling 100M+ rows.
  • Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field., * Strong understanding of building semantic layers, entity-resolution pipelines, or business ontologies supporting NLP and conversational analytical interfaces.
  • Experience deploying and scaling data architecture within Oracle Cloud Infrastructure (OCI) or related enterprise cloud environments.
  • Background in refactoring complex financial analytics, multi-tenant resource scheduling, and managing intense data workloads during tight corporate close cycles.

Benefits & conditions

US: Hiring Range in USD from: $163,500 to $355,400 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

  1. Medical, dental, and vision insurance, including expert medical opinion
  2. Short term disability and long term disability
  3. Life insurance and AD&D
  4. Supplemental life insurance (Employee/Spouse/Child)
  5. Health care and dependent care Flexible Spending Accounts
  6. Pre-tax commuter and parking benefits
  7. 401(k) Savings and Investment Plan with company match
  8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
  9. 11 paid holidays
  10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
  11. Paid parental leave
  12. Adoption assistance
  13. Employee Stock Purchase Plan
  14. Financial planning and group legal
  15. Voluntary benefits including auto, homeowner and pet insurance

About the company

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…