Data Engineer
INFT Solutions inc
United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Amazon Web Services
Apache HTTP Server
Continuous Integration
Data Auditing
Information Engineering
Data Stores
Apache Hadoop
Hadoop Distributed File System
Apache Hive
JSON
Job Scheduling
+13 more
Python (Programming Language)
Systems Development Life Cycle
SQL Databases
Parquet
File Transfer Protocol (FTP)
Snowflake
Apache Spark
Sybase
Data Lakes
Kubernetes
Avro
Apache Kafka
Data Pipelines
Requirements
- Strong hands-on Data Engineering and datastore migration experience.
- Experience migrating on-prem Data Lakes to AWS-hosted LakeHouse environments.
- Strong Python or Java programming and advanced SQL troubleshooting.
- Experience with Apache Spark, Snowflake, and Apache Iceberg.
- Data pipeline migration, job scheduling, and SQL/Spark code conversion.
- Data reconciliation, validation, and data quality assurance.
- Strong data modeling: SCD Type 2, schema evolution, partitioning, and clustering.
- Experience with CI/CD, SDLC, and Kubernetes (K8s).
- Familiarity with Kafka, Hadoop/HDFS, Hive, JSON, Avro, Parquet, FTP, and Sybase IQ.
- Strong stakeholder communication, ownership, and cross-team collaboration.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦