Data Engineer
TechDigital Corporation
Rahway, NJ, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Airflow
Amazon Web Services
Big Data
Cloud Computing
Data Governance
Data Integrity
Extract Transform Load (ETL)
Data Warehousing
Apache Hadoop
Statistical Hypothesis Testing
Python (Programming Language)
Systems Development Life Cycle
+9 more
Scala (Programming Language)
SQL Databases
Workflow Management Systems
Scripting
Apache Spark
Apache Kafka
Data Management
Data Pipelines
Programming Languages
Job description
Mandatory Skills: SQL/Python/Data Engineer/AWS
- Data Engineers who can build scalable, reliable data pipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and big data technologies (Spark, Kafka, Hadoop).
- Key skills include data modeling, ETL/ELT pipeline construction, data warehousing and orchestration tools like Airflow. Strong problem-solving, collaboration, and data governance skills are crucial. Collect, process, and analyze large datasets to extract meaningful insights.
- Design and conduct experiments to test hypotheses and validate data-driven solutions.
- Collaborate with cross-functional teams to identify data needs and align strategies with organizational goals.
- Create templates, dashboards and visualizations to communicate findings effectively to stakeholders.
- Ensure data integrity and accuracy through cleaning, preprocessing, and validation techniques.
- Optimize data collection and storage processes for efficiency and scalability. Knowledge on Manufacturing process is preferred.
Requirements
Data Management, Scalable System Development, SQL (Structured Query Language), Scala Programming Language, Big Data, Python Programming/Scripting Language, Apache Spark, Cloud Computing, Amazon Web Services (AWS), Apache Hadoop
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦