Data Engineer (W2 only)

Digipulse Technologies Inc.
Westlake, TX, United States
2 days ago
Apply on www.adzuna.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Big Data Databases Continuous Delivery Continuous Integration Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Mining Database Development Database Queries
+14 more
Apache Hadoop SQL Stored Procedures SQL Databases Workflow Management Systems Google Cloud Cloud Platform System Apache Spark Fastapi Containerization Kubernetes Data Analytics Data Pipelines Docker Jenkins

Job description

Join our dynamic team as a Data Engineer based in Westlake, TX. In this role, you will be responsible for designing, developing, and maintaining our data infrastructure, ensuring the seamless flow of data across various systems. You will work closely with data scientists, analysts, and other stakeholders to build efficient data pipelines and support the organization’s data-driven initiatives., * Develop and maintain ETL processes using tools such as Informatica to ensure accurate and timely data extraction, transformation, and loading.

  • Design and implement database schemas and data models to support business requirements and data analytics needs.
  • Write and optimize SQL queries and stored procedures to efficiently manage and manipulate data within our databases.
  • Build and manage Jenkins pipelines specifically for deploying Python applications, ensuring continuous integration and delivery (CI/CD) processes are in place.
  • Maintain and enhance existing CI/CD pipelines to improve deployment efficiency and reliability.
  • Collaborate with cross-functional teams to understand data requirements and provide technical expertise to support data-driven decision-making.
  • Monitor and troubleshoot data pipelines and databases to ensure optimal performance and reliability.
  • Stay up-to-date with the latest trends and best practices in data engineering and continuously improve our data infrastructure.

Requirements

  • Experience with ETL processes and tools such as Informatica.
  • Strong understanding of database design and development.
  • Proficiency in data modeling and creating efficient database schemas.
  • Solid understanding and experience with Python for data development and manipulation.
  • Experience building and managing Jenkins pipelines, specifically for deploying Python applications.
  • Strong knowledge of continuous integration and continuous delivery (CI/CD) practices.
  • Proficiency in SQL and experience writing and optimizing complex queries.
  • Experience with stored procedures and database management.

<>Preferred Skills

  • Experience with other ETL tools and technologies beyond Informatica.
  • Familiarity with cloud-based data platforms and services (e.g., AWS, Google Cloud, Azure).
  • Experience with big data technologies such as Hadoop, Spark, or similar frameworks.
  • Knowledge of containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Strong problem-solving skills and the ability to work independently as well as part of a team.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.com
Prepare application

Good distractions

Loading talks and stories from around this role…