Senior Data Engineer (USC)
Connexions Data
United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Amazon Web Services
Amazon S3
Business Analytics Applications
Big Data
Cloud Engineering
CompTIA Security+
Databases
Data Governance
Data Infrastructure
Extract Transform Load (ETL)
Data Warehousing
+39 more
Relational Databases
Disaster Recovery
Document-Oriented Databases
Amazon DynamoDB
Identity and Access Management
JSON
Python (Programming Language)
PostgreSQL
Metadata Repositories
Microsoft SQL Server
NoSQL
Operational Databases
Oracle (Applications)
Scrum Methodology
Reference Data
Amazon Simple Notification Service (SNS)
SQL Databases
Systems Integration
Management of Software Versions
Enterprise Data Management
Sql Optimization
Apache Spark
Change Data Capture
Indexer
Servicebus
Event Driven Architecture
Data Lakes
Pyspark
Data Lineage
AWS Glue
Qlikview
Integration Frameworks
AWS Data Analytics
Real Time Data
Functional Programming
Cloudwatch
Amazon Simple Queue Service (SQS)
Data Pipelines
Amazon Redshift
Job description
The Data Engineer: Under the general supervision, may include, but are not limited to, the following:
- Design scalable, secure, and high-performance database architectures to support Mirador modernization
- Define data models and storage strategies aligned with cloud migration goals
- Optimize performance, availability, and disaster recovery across environments
- Collaborate with IBM IVM team to identify data needs for use stories and update unified data model
- Leverage data lake to capture functionality-specific data
- Ensure compliance with data governance, security, and retention policies
- Document database designs, configurations, and operational procedures
Requirements
Clearance: Active Top Secret (TS) clearance or TS eligibility with ability to complete adjudication/transfer requirements, * Active Top Secret (TS) clearance or TS eligibility with ability to complete adjudication/transfer requirements along with a Security Plus certification on day one.
- 7+ years of experience designing, building, and supporting enterprise data engineering solutions and modern data platforms.
- Strong expertise in relational databases (PostgreSQL, Oracle, SQL Server) and experience integrating semi-structured and NoSQL data sources (DynamoDB, JSON, APIs).
- Extensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
- Hands-on experience with RedShift
- Hands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
- Experience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as RedShift.
- Strong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
- Experience designing metadata-driven ingestion frameworks, data lineage, and data quality validation processes.
- Proficiency in data modeling, schema evolution, data versioning, and master/reference data management.
- Strong understanding of event-driven architectures and application/database synchronization patterns.
- Experience optimizing SQL, Spark jobs, partitioning strategies, indexing, and Redshift performance for large-scale datasets.
- Experience working within Agile/Scrum teams and collaborating with application developers, architects, and business stakeholders.
Nice to have skills:
- AWS Certified Data Engineer Associate or AWS Certified Solutions Architect.
- Experience designing enterprise data lakes and lakehouse architectures.
- Experience implementing enterprise metadata repositories and data catalogs.
- Familiarity with data governance and integration platforms : Qlik and AWS Glue Data Catalog.
- Experience supporting real-time and near-real-time data integration architectures.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦