Solutions Architect
Sigmoid
New York, NY, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.juju.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Java (Programming Language)
Application Programming Interfaces (APIs)
Artificial Intelligence
Airflow
Amazon Web Services
Amazon Elastic Compute Cloud
Amazon S3
Data Analysis
Apache HTTP Server
Confluence
JIRA
+52 more
Automation of Tests
Microsoft Azure
Cluster Analysis
Computer Programming
Continuous Integration
Data Architecture
Data Discovery
Information Engineering
Data Governance
Extract Transform Load (ETL)
Distributed Computing Environment
Github
Apache Hive
Identity and Access Management
Interoperability
JSON
Python (Programming Language)
Metadata
Performance Tuning
Query Optimization
Cloud Services
SQL Databases
Unstructured Data
Management of Software Versions
Parquet
Data Processing
Multithreading
Large Language Models
Snowflake
Concurrency
Apache Spark
Spring-boot
Model Validation
Caching
Generative AI
Gitlab
Git
Cloudformation
Event Driven Architecture
Data Lakes
Information Technology
Slack
Avro
AWS Glue
Apache Kafka
Presto
Functional Programming
Terraform
Software Version Control
Data Pipelines
Databricks
Microservices
Job description
-
- Define platform vision & roadmap - architect the unified cloud-native data platform strategy covering ingestion, transformation, storage, governance, and secure access.
-
- Build core platform capabilities - design and deliver lake house infrastructure, batch/streaming pipelines, metadata/catalog services, observability, and security on Snowflake and/or Databricks.
-
- Optimize data performance - design, implement, and tune Apache Iceberg tables (partitioning, compaction, metadata) for consistent, high-performance query execution across compute engines. 4. Enforce engineering excellence - establish CI/CD, Infrastructure as Code (Terraform/CloudFormation), automated testing, schema/versioning, data quality, and end-to-end observability standards.
-
- Drive data governance & contracts - partner with Product, Analytics, ML, and SMEs to define data semantics, schemas, SLAs, documentation, versioning, and access controls aligned to compliance requirements.
-
- Deliver governed data products - build curated semantic/serving models and publish consumption interfaces via BI tools and/or APIs with proper governance.
-
- Optimize cost & performance - tune pipelines and queries using partitioning/clustering, caching, archiving, lifecycle management (retention/purge), and workload
-
- Own platform operations - manage on-call, incident response, backfills, root-cause analysis, post-incident reviews, and continuous reliability improvements.
-
- Lead & scale engineering teams - build and lead a multi-squad organization; hire, mentor, and develop technical leaders while ensuring delivery and operational excellence.
-
- Manage delivery & partnerships - oversee outsourcing partners, SOWs, capacity planning, and milestone tracking; provide hands-on technical leadership for team pods including planning, mentoring, and performance management.
Requirements
-
- 15+ years in software and/or data engineering with a BS/MS in Computer Science, Engineering, or equivalent practical experience; demonstrated progression from hands-on development to technical leadership roles.
-
- Strong programming proficiency in Python and SQL (Java/Scala preferred) with a track record of writing production-quality, well-tested, maintainable code using modern testing frameworks and version control (Git, GitHub/GitLab).
-
- Expertise in microservices architecture, REST/gRPC APIs, and event-driven systems such as Kafka, with hands-on experience in Java (Spring Boot), multithreading, concurrency, and performance tuning.
-
- Hands-on Apache Spark expertise - design, troubleshoot, and optimize batch and streaming workloads with deep focus on performance tuning, cost-aware optimization, and cluster resource management. Enterprise Snowflake and/or Databricks experience - build and operate production workloads including job orchestration (Airflow, dbt, Databricks Workflows), query optimization, and day-to-day platform operations.
-
- Cloud-native data pipeline development - proven experience building production-grade pipelines in AWS (preferred) or GCP/Azure, leveraging services such as S3, Glue, EMR, Lambda, EC2, and IAM for secure, scalable data processing.
-
- Solid data architecture fundamentals - deep understanding of data modeling, ETL/ELT patterns, schema evolution, and distributed data processing principles across structured, semi-structured, and unstructured data formats (JSON, Parquet, Avro, Delta Lake).
-
- Lakehouse platform expertise - working knowledge of Databricks, Snowflake, Trino/Presto, and Apache Iceberg 2 hands-on experience with interoperability, connectivity patterns, and multi-engine query access.
-
- Metadata and catalog governance - practical experience with open table formats (Apache Iceberg) and catalog ecosystems such as Unity Catalog, AWS Glue Data Catalog, Apache Hive Metastore, or equivalent for data discovery, lineage, and access control.
-
- Capital Markets domain knowledge - experience in financial services with understanding of key reference and application domains such as Securities, Benchmarking, Holdings, Sales, Accounts, and Products.
-
- Global collaboration and communication - excellent written and verbal skills with demonstrated ability to partner effectively with engineering, operations, and business stakeholders across time zones; experience working with Jira, Confluence, and Slack for cross-functional coordination.
-
- AI-enabled solutioning experience - demonstrated ability to architect and deliver AI/ML and generative AI capabilities using enterprise data responsibly, including LLM-powered analytics, retrieval-augmented generation (RAG), intelligent automation, model evaluation, data privacy/security, governance, observability, and cost controls.
About the company
Sigmoid unlocks business value for Fortune 1000 companies through expert data engineering, data science, and AI consulting. We solve complex challenges for leaders in CPG, Retail, BFSI, and Life Sciences. With 10+ delivery centers in the USA, Canada, UK, Europe, Singapore, and India, we deliver cutting-edge data modernization and generative AI solutions. Join us to shape the future of data-driven innovation!
Why Sigmoid?
- Inc. 500 Fastest-Growing Companies (4 years running)
- Deloitte Technology Fast 500 (4 years running)
- Top Employer: AIM’s 50 Best Firms for Data Scientists
- Recently named British Data Awards Finalist & more accolades on the way!
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.juju.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…