Data Engineer
CYNET SYSTEMS INC.
San Jose, CA, United States
15 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$114,400.0 - $124,800.0
Working hours
Regular working hours
Job source
Tech stack
Airflow
Amazon Web Services
Microsoft Azure
Big Data
Continuous Integration
Data Validation
Information Engineering
Data Infrastructure
Extract Transform Load (ETL)
Data Migration
Data Structures
Document-Oriented Databases
+18 more
Python (Programming Language)
PostgreSQL
NoSQL
Oracle (Applications)
Performance Tuning
Query Optimization
Cloud Services
SQL Databases
Workflow Management Systems
Data Logging
Google Cloud
Indexer
Git
Database Migration
Containerization
Software Version Control
Data Pipelines
Docker
Job description
- Lead the end-to-end migration (transformation and load) of high-volume, high-complexity data into a new PostgreSQL-based infrastructure.
- Design, build, and maintain robust ETL/ELT pipelines capable of processing millions of records reliably and efficiently.
- Map and reconcile complex legacy data structures across multiple business entities into a unified target schema.
- Define and implement data validation frameworks to ensure integrity, completeness, and accuracy throughout the migration.
- Optimize pipeline performance, including query tuning, indexing strategy, and batch/incremental load design in PostgreSQL.
- Identify, troubleshoot, and resolve data quality issues, schema mismatches, and pipeline failures.
- Document data mappings, transformation logic, and migration runbooks for engineering and business stakeholders.
- Partner with business and technical stakeholders to align migration scope, timelines, and data requirements.
- Establish monitoring, logging, and alerting to track pipeline health and data quality post-migration.
- Mentor junior data engineers and contribute to engineering best practices and standards.
Requirements
- 5+ years of experience in data engineering, with demonstrated ownership of large-scale data migration projects.
- Strong to expert-level proficiency in Python for building and automating data pipelines.
- Deep hands-on experience with PostgreSQL/Oracle, including schema design, query optimization, and performance tuning.
- Proven experience designing and managing ETL/ELT pipelines at scale (millions of records).
- Experience mapping and transforming complex, legacy data structures across disparate systems or business entities.
- Strong understanding of data validation, reconciliation, and quality assurance techniques.
- Solid grasp of data modeling principles (normalization, indexing, partitioning).
- Experience with version control (Git) and CI/CD practices for data pipelines., * Experience with orchestration tools (e.g., Airflow, Dagster, Prefect).
- Familiarity with cloud data platforms (AWS, Google Cloud Platform, or Azure).
- Experience with other relational or NoSQL databases and cross-database migrations.
- Background working in regulated or high-stakes data environments.
- Experience with containerization (Docker) and infrastructure-as-code.
- Exposure to data quality/testing frameworks (e.g., Great Expectations, dbt tests).
Skills:
- Python.
- PostgreSQL.
- Oracle.
- ETL/ELT.
- Data Migration.
- Schema Design.
- Query Optimization.
- Data Modeling.
- Git.
- CI/CD.
Qualification And Education:
- 5+ years of experience in data engineering.
- Expertise in Python and SQL databases.
Benefits & conditions
Our Benefits Include:
- Medical, Dental, and Vision Insurance
- 401(k) Retirement Plan
- Health Savings Account (HSA)
- Disability Insurance (Short-Term and Long-Term)
- Life and AD&D Insurance
- Paid Sick Leave (where required by applicable state or local law)
- Supplemental Insurance Plans
- Identity Theft Protection
- Pet Insurance
- Employee Wellness Programs
- Employee Assistance Program (EAP)
- Career Growth and Professional Development Opportunities
About the company
Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading technology staffing and workforce solutions company serving Fortune 500 companies, government agencies, and enterprise organizations across the United States and Canada. We deliver agile, scalable talent solutions across IT, engineering, life sciences, clinical, and professional staffing, powered by a high-performing recruitment engine operating across North America and Asia.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
21 days ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago