Senior Data Engineer
Robotics Technologies LLC
Sunnyvale, CA, United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$166,400
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Airflow
Amazon Web Services
Amazon S3
Big Data
Cyber Security
Databases
Information Engineering
Data Integration
Extract Transform Load (ETL)
Data Security
+21 more
Data Systems
DevOps
Distributed Systems
Amazon DynamoDB
Identity and Access Management
JSON
Python (Programming Language)
PostgreSQL
Metadata
Role-Based Access Control
Standard Sql
SQL Databases
Unstructured Data
Parquet
Data Processing
Data Ingestion
Apache Spark
Amazon Relational Database Service
Pgvector
Presto
Data Pipelines
Job description
Our client seeks a Senior Data Engineer to design, build, and support scalable and secure data solutions for enterprise Wealth & Asset Management applications. The role focuses on data ingestion, transformation, storage, integration, quality, governance, and processing across structured and unstructured data sources., * Design and develop scalable data ingestion and ETL/ELT pipelines.
- Build solutions for structured, semi-structured, and unstructured data.
- Develop reusable data-processing and transformation components using Python and SQL.
- Design and support data models using PostgreSQL, Amazon RDS, DynamoDB, and Amazon S3.
- Support document ingestion and extraction using Amazon Textract, where applicable.
- Prepare and transform data for application, search, analytics, and AI-enabled use cases.
- Support vector-based retrieval using PostgreSQL/pgvector, where required.
- Implement data quality, validation, reconciliation, metadata, lineage, retention, and governance controls.
- Implement secure data access and encryption for sensitive information.
- Optimize data pipelines and databases for performance, reliability, scalability, and cost.
- Implement monitoring and troubleshoot data-processing and integration issues.
- Collaborate with application, AI, DevOps, architecture, cybersecurity, and business teams.
Requirements
- 8+ years of experience in data engineering, data integration, or related roles.
- Hands-on experience with Python, SQL, PostgreSQL, Amazon RDS, DynamoDB, and S3.
- Experience developing and supporting ETL/ELT pipelines and data-processing workflows.
- Experience with data modeling, APIs, JSON, Parquet, and pgvector.
- Understanding of data quality, metadata, governance, security, and operational monitoring.
- Experience working within large enterprise or regulated environments.
- Experience supporting document-processing and AI-enabled data solutions.
Required Technical Skill:
Must Have:
- Apache Spark
- Trino (Presto)
- Apache Airflow
- AWS
- SQL
- Large-scale Data Engineering
- Distributed Computing
- AWS Knowledge- Does NOT need to be an AWS expert.
Should understand:
- S3
- IAM Roles
- IAM Policies
- RBAC / Permission
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦