Data Engineer (W2 only)
Digipulse Technologies Inc.
Westlake, TX, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Big Data
Databases
Continuous Delivery
Continuous Integration
Information Engineering
Data Infrastructure
Extract Transform Load (ETL)
Data Mining
Database Development
Database Queries
+14 more
Apache Hadoop
SQL Stored Procedures
SQL Databases
Workflow Management Systems
Google Cloud
Cloud Platform System
Apache Spark
Fastapi
Containerization
Kubernetes
Data Analytics
Data Pipelines
Docker
Jenkins
Job description
Join our dynamic team as a Data Engineer based in Westlake, TX. In this role, you will be responsible for designing, developing, and maintaining our data infrastructure, ensuring the seamless flow of data across various systems. You will work closely with data scientists, analysts, and other stakeholders to build efficient data pipelines and support the organization’s data-driven initiatives., * Develop and maintain ETL processes using tools such as Informatica to ensure accurate and timely data extraction, transformation, and loading.
- Design and implement database schemas and data models to support business requirements and data analytics needs.
- Write and optimize SQL queries and stored procedures to efficiently manage and manipulate data within our databases.
- Build and manage Jenkins pipelines specifically for deploying Python applications, ensuring continuous integration and delivery (CI/CD) processes are in place.
- Maintain and enhance existing CI/CD pipelines to improve deployment efficiency and reliability.
- Collaborate with cross-functional teams to understand data requirements and provide technical expertise to support data-driven decision-making.
- Monitor and troubleshoot data pipelines and databases to ensure optimal performance and reliability.
- Stay up-to-date with the latest trends and best practices in data engineering and continuously improve our data infrastructure.
Requirements
- Experience with ETL processes and tools such as Informatica.
- Strong understanding of database design and development.
- Proficiency in data modeling and creating efficient database schemas.
- Solid understanding and experience with Python for data development and manipulation.
- Experience building and managing Jenkins pipelines, specifically for deploying Python applications.
- Strong knowledge of continuous integration and continuous delivery (CI/CD) practices.
- Proficiency in SQL and experience writing and optimizing complex queries.
- Experience with stored procedures and database management.
<>Preferred Skills
- Experience with other ETL tools and technologies beyond Informatica.
- Familiarity with cloud-based data platforms and services (e.g., AWS, Google Cloud, Azure).
- Experience with big data technologies such as Hadoop, Spark, or similar frameworks.
- Knowledge of containerization technologies such as Docker and orchestration tools like Kubernetes.
- Strong problem-solving skills and the ability to work independently as well as part of a team.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…