Data Engineer

Indotronix Avani Group
United States
2 days ago
Apply on candidateportal.ceipal.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Shift work

Tech stack

Java (Programming Language) Amazon Web Services Cloud Database Databases Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Structures Python (Programming Language) Scala (Programming Language) Software Deployment
+12 more
Data Streaming Subversion Unstructured Data Freeform SQL Apache Spark Electronic Medical Records Git Data Lakes Apache Kafka Build Tools Software Version Control Programming Languages

Job description

Join Gartner as a Data Engineer and play a pivotal role in developing our Data Intelligence Platform. Leverage cutting-edge technologies to create scalable data solutions, support data-driven decision-making, and collaborate with cross-functional teams in a fast-paced, innovation-focused environment. This contract opportunity offers exposure to advanced cloud tools, data science initiatives, and high-impact projects with real-world business value.

Responsibilities

  • Design and implement high-performance, scalable, and secure data models and solutions.
  • Develop and optimize complex SQL statements and support in-application SQL performance.
  • Build, automate, and deploy robust ETL pipelines and data services for analytics and data science.
  • Integrate data from diverse sources, including on-premises databases, external APIs, and harvesting tools.
  • Partner with business units and data science teams to understand requirements and deliver tailored solutions.
  • Manage AWS resources (EMR, ECS) and continuously enhance deployment and operational processes.
  • Ensure database security, availability, backup, and recovery procedures are in place.
  • Support automation using Infrastructure as Code (IaC), Terraform, and CI/CD tools like Jenkins.
  • Contribute to data governance, access control, and risk reduction efforts.
  • Prepare clear documentation, technical specifications, and provide training on data lake ecosystems.

Requirements

7-9 years of hands-on experience in designing and building cloud-based data models, ETL pipelines, and infrastructure.

  • Strong command of SQL and expertise in modern relational database systems.
  • Proven experience with both structured and unstructured data.
  • Skilled in optimizing complex SQL queries and troubleshooting database issues.
  • Proficient in Spark, Glue, EMR, Apache Kafka, AWS Kinesis.
  • Familiarity with programming languages such as Java, Python, Scala.
  • Experience with version control (Git, Subversion) and automated build systems (CI/CD).
  • Solid understanding of data structures and algorithms.

Preferred Skills

  • Experience with data governance, advanced access control, and additional AWS cloud services.
  • Expertise in Infrastructure as Code (IaC) using Terraform.
  • Advanced knowledge of automation and deployment best practices., Solution Design and Development of Cloud based data models ETL Pipelines and infrastructure for reporting analytics and data science

Benefits & conditions

Collaborate with industry-leading experts in a dynamic, learning-oriented environment.

  • Work on impactful projects with visibility across the organization.
  • Access to cutting-edge cloud and data engineering technologies.
  • Flexible remote work arrangements (role location: United States).
  • Opportunities for skill enhancement and career advancement through challenging assignments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on candidateportal.ceipal.com
Prepare application

Good distractions

Loading talks and stories from around this role…