Data Engineer

Indotronix Avani Group
United States
2 days ago
Apply on candidateportal.ceipal.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Amazon Web Services Cloud Computing Cloud Computing Security Databases Continuous Integration Data Governance Data Structures Python (Programming Language) Machine Learning DataOps Scala (Programming Language)
+6 more
Subversion Git Infrastructure Automation Frameworks Build Tools Software Version Control Programming Languages

Job description

Join Gartner as a Data Engineer and become an integral part of the team developing our cutting-edge Data Intelligence Platform. You’ll drive innovation by building advanced data models, optimizing data operations, and integrating diverse technologies to power personalization and recommendation engines. This role offers hands-on exposure to cloud technologies and the opportunity to shape high-impact data solutions in a collaborative, forward-thinking environment., Architect and implement high-performance, scalable data models and solutions

  • Write, optimize, and troubleshoot complex SQL statements and database procedures
  • Design and automate ETL pipelines to support analytics and data science initiatives
  • Integrate data from multiple sources, including REST APIs and on-premise databases
  • Collaborate closely with business units and data science teams to deliver actionable insights
  • Manage and optimize AWS resources (EMR, ECS) and enhance deployment processes
  • Support data lake ecosystem with technical training and documentation
  • Lead automation using Infrastructure as Code (Terraform) and CI/CD tools (Jenkins)
  • Promote adoption of new cloud technologies for improved efficiency and lower costs
  • Implement data governance, access controls, and security risk mitigation strategies

Requirements

7-9 years in architecting, designing, and developing cloud-based data models and ETL pipelines

  • Deep experience with structured/unstructured data and modern relational databases
  • Advanced SQL skills and proficiency in database optimization
  • Strong background in Spark, Glue, EMR, Apache Kafka/AWS Kinesis
  • Proficient in programming languages: Java, Python, Scala
  • Expertise with version control (Git, Subversion) and automated build systems (CI/CD)
  • Solid understanding of data structures, algorithms, and database best practices

Preferred Skills

  • Experience with configuration management tools and AWS provisioning
  • Exposure to advanced data science and machine learning platforms
  • Familiarity with data governance frameworks and cloud security standards, Solution Design and Development of Cloud based data models ETL Pipelines and infrastructure for reporting analytics and data science.

Benefits & conditions

Work on impactful, high-visibility projects in a dynamic, innovative setting

  • Collaborate with top-tier professionals and cross-functional teams
  • Gain exposure to the latest cloud technologies and data engineering best practices
  • Grow your expertise in an environment that values continuous learning and professional development

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on candidateportal.ceipal.com
Prepare application

Good distractions

Loading talks and stories from around this role…