Data Engineer
Walker, Inc
United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$111,000.0 - $135,000.0
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Java (Programming Language)
Adaptable Database Systems
Agile Methodology
Amazon Web Services
Bash Shell
Big Data
Cloud Computing
Cloud Database
Information Engineering
Data Integration
Extract Transform Load (ETL)
+26 more
Data Systems
Data Warehousing
Dimensional Modeling
Electronic Data Interchange (EDI)
Apache Hadoop
Hadoop Distributed File System
Apache Hive
Python (Programming Language)
Microsoft SQL Server
SQL Azure
Oracle (Applications)
Azure Data Lake
Shell Script
Software Engineering
SQL Databases
Data Streaming
Talend
Scripting
Data Ingestion
Apache Spark
Amazon Relational Database Service
Vba Programming Language
Data Management
Restful APIs
Looker Analytics
Data Pipelines
Job description
- Design, develop, and optimize ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow across various platforms using tools like Informatica, Talend, or custom scripting with Python and Bash.
- Build and maintain scalable data warehouses and big data systems utilizing technologies such as Hadoop, Spark, Apache Hive, Azure Data Lake, and AWS cloud services.
- Collaborate with cross-functional teams to understand business requirements and translate them into effective data models using dimensional modeling and data warehousing best practices.
- Manage SQL databases including Microsoft SQL Server, Oracle, and cloud-based SQL databases to support query management and reporting needs.
- Develop and implement data management integration strategies ensuring high-quality data ingestion from linked data sources and public cloud environments.
- Support business intelligence tools like Looker by creating dashboards and reports that deliver actionable insights to stakeholders.
- Write efficient code in Java, Python, or Shell Scripting for automation of data workflows and model training processes while adhering to Agile development methodologies.
Requirements
- Proven experience working with big data systems such as Hadoop ecosystem components (HDFS, Spark, Hive) or similar frameworks in a cloud environment (Azure Data Lake, AWS).
- Strong background in software development with proficiency in Java, Python, SQL (including Microsoft SQL Server and Oracle), and scripting languages like Bash or VBA.
- Demonstrated expertise in designing scalable data models for warehousing solutions using dimensional modeling techniques.
- Hands-on experience with ETL pipeline development using tools like Informatica or Talend along with RESTful API integrations for seamless data exchange.
- Familiarity with business intelligence tools such as Looker or equivalent platforms for creating insightful dashboards.
- Knowledge of cloud databases (Azure SQL Database, Amazon RDS) and public cloud platforms supporting big data systems is highly desirable.
- Ability to analyze complex datasets effectively while applying strong analysis skills to support strategic initiatives.
Join us to leverage your passion for data engineering in a vibrant environment where innovation drives success!
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦