> Markdown version of [/jobs/ext/4619273-senior-data-platform-engineer-weights-biases](https://www.wearedevelopers.com/jobs/ext/4619273-senior-data-platform-engineer-weights-biases). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Platform Engineer - Weights & Biases - **Company:** Weights & Biases - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Automation of Tests, Microsoft Azure, Cloud Computing, Cloud Database, Code Review, Information Systems, Databases, Computer Engineering, Continuous Integration, Data as a Services, Data Discovery, Information Engineering, Data Infrastructure, Data Transformation, Data Structures, Data Systems, Data Warehousing, Database Design, Distributed Data Store, Distributed Systems, Python (Programming Language), Machine Learning, Meta-Data Management, Metadata Repositories, Operational Databases, Scala (Programming Language), Software Engineering, SQL Databases, Web Applications, Data Logging, Data Server Interface, Google Cloud, Database Performance, Backend, Data Layers, Semi-structured Data, Information Technology, Deployment Automation, Data Management, Software Version Control, Golang - **Published:** November 7, 2026 - **Apply:** https://www.juju.com/job/28_25303_091c3590a58a96b26aef660fcbea38a3 ## About the Role * Bachelor's degree or foreign equivalent in Computer Science, Computer Engineering, Data Science, Information Systems, or a closely related technical or quantitative field involving substantial coursework in Engineering. * At least five years of progressive professional experience in software engineering, data engineering, data infrastructure, or a closely related occupation. * Professional experience designing and implementing production data pipelines and distributed data-processing systems. * Professional experience with data transformation or workflow-orchestration technologies such as dbt, Dagster, Airflow, or comparable platforms. * Professional experience designing data models, schemas, and storage strategies for large-scale analytical databases or cloud data warehouses. * Professional experience programming in Python, Go, Java, Scala, or another general-purpose programming language used to build production data systems. * Professional experience with SQL, database performance optimization, data-quality testing, and production monitoring. * Knowledge of software-engineering practices, including version control, automated testing, code review, continuous integration, deployment automation, and technical documentation. * Knowledge of web-application telemetry, event instrumentation, logging systems, APIs, and distributed-service architecture. * Ability to communicate technical designs, risks, and tradeoffs to engineering, data science, analytics, and business stakeholders., * Experience operating multi-petabyte data platforms or other high-volume, business-critical data systems. * Experience with cloud infrastructure and data services on AWS, Google Cloud Platform, or Microsoft Azure. * Experience with data catalogs, metadata management, lineage systems, governance frameworks, or semantic layers. * Knowledge of machine-learning workflows, model-development terminology, or the data requirements of production AI applications. * Experience supporting internal platform users, responding to technical questions, and converting user feedback into platform improvements. * Demonstrated ability to work effectively in a self-directed environment, identify opportunities for improvement, and collaborate across engineering and business teams. ## Description * Design and implement scalable data systems and pipelines - 30%: Architect, develop, test, and maintain distributed batch and streaming pipelines that ingest, transform, validate, and deliver structured and semi-structured data across production systems. * Develop data transformation and orchestration frameworks - 20%: Build and optimize workflows using technologies such as dbt, Dagster, Airflow, or comparable tools. Establish testing, deployment, dependency-management, data-quality, and observability standards for these workflows. * Improve data warehouse performance and reliability - 15%: Design data models, schemas, partitioning strategies, and storage patterns for large-scale analytical workloads. Diagnose and resolve performance, scalability, availability, and cost-efficiency issues within multi-petabyte data environments. * Build product telemetry and data instrumentation - 15%: Partner with software engineering teams to define event schemas and implement reliable logging, telemetry, and instrumentation for web applications, backend services, and distributed systems. * Develop data catalog and semantic-layer capabilities - 10%: Design metadata, lineage, governance, and semantic-modeling systems that enable consistent business definitions and secure self-service analytics. * Support data-powered AI applications - 5%: Establish data interfaces and platform foundations for internal AI applications, including systems that support automated data discovery, workflow assistance, customer-growth analysis, churn-risk modeling, and abuse detection. * Operate and support the platform - 5%: Monitor production systems, troubleshoot incidents, document operational procedures, and participate in an on-call rotation after completing the required onboarding and training. This position requires independent technical judgment to evaluate architectural alternatives, identify system constraints, and select appropriate data structures, algorithms, database designs, and distributed-processing patterns.