Data Engineer
Serv IT, Inc.
United States
12 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$118,783.0 - $143,051.0
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Agile Methodology
Amazon Web Services
Amazon S3
Data Analysis
Bash Shell
Big Data
Databases
Data Architecture
Data Integration
Extract Transform Load (ETL)
Data Systems
+25 more
Data Visualization
Data Warehousing
Database Design
Distributed Computing Environment
Apache Hadoop
Hadoop Distributed File System
Apache Hive
Python (Programming Language)
Machine Learning
Microsoft SQL Server
Oracle Databases
Oracle (Applications)
Azure Data Lake
Shell Script
SQL Databases
Data Streaming
Talend
Data Processing
Informatica Powercenter
Apache Spark
Data Lakes
Vba Programming Language
Restful APIs
Looker Analytics
Data Pipelines
Job description
- Develop, implement, and optimize ETL (Extract, Transform, Load) processes to ensure seamless data flow across various platforms using tools like Talend, Informatica, and Shell Scripting.
- Design and maintain scalable data warehouses and data lakes utilizing AWS, Azure Data Lake, Hadoop, Apache Hive, Spark, and related big data technologies.
- Build and manage databases with Microsoft SQL Server, Oracle, and other relational systems; ensure high performance and security standards.
- Collaborate with cross-functional teams to gather requirements, analyze data needs, and translate them into technical solutions using SQL, Python, Java, and Bash scripting.
- Integrate linked data sources through RESTful APIs for comprehensive analytics capabilities.
- Support model training initiatives by preparing large datasets for machine learning applications.
- Conduct analysis to identify trends or issues within datasets; communicate findings effectively using Looker or other visualization tools.
- Maintain documentation of data architecture designs, workflows, and procedures following Agile methodologies for continuous improvement.
Requirements
- Proven experience in designing and implementing large-scale data pipelines using AWS services such as S3, Glue, or Redshift.
- Strong proficiency in programming languages including Java and Python for data processing tasks.
- Extensive knowledge of big data frameworks like Hadoop ecosystem (HDFS, Hive) and Spark for distributed processing.
- Hands-on experience with SQL Server, Oracle databases, and Data Warehouse concepts to support enterprise analytics initiatives.
- Familiarity with ETL tools such as Talend or Informatica for efficient data integration workflows.
- Experience working with cloud platforms like Azure Data Lake or similar environments is highly desirable.
- Solid understanding of database design principles combined with analysis skills to interpret complex datasets effectively.
- Knowledge of shell scripting (Bash), Unix/Linux environments, RESTful API integration, and VBA is a plus. Join us if you’re passionate about transforming raw data into powerful insights! We’re committed to fostering an innovative environment where your technical expertise makes a real impact on our organization’s success.
Benefits & conditions
- Dental insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…