Data Engineer

IBA InfoTech Inc.
Charlotte, NC, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Artificial Intelligence C Sharp (Programming Language) Customer Data Management Data Stores Data Warehousing Python (Programming Language) Oracle (Applications) Salesforce.Com Jupyter Adobe Kubernetes
+1 more
Data Management

Job description

As a Data Engineer, you’ll perform the technical implementation of customer data platforms (CDPs) and serve as a key player as it relates to data management. Your responsibilities will include:

  • Interface with clients to gather requirements, map solutions, and make recommendations
  • Lead customer project conference calls or interfaces with the project manager
  • Create technical specifications to drive the development of the solution
  • Deliver technical specifications documents for customer review
  • Design custom development solutions that meet customer requirements
  • Progress through full development lifecycle for a custom solution
  • Deploy new solutions to production environments
  • Maintain and support new and existing solutions and frameworks
  • Innovate on new ideas to solve customer needs and assist to market internally new solutions
  • Provide project estimates and timelines to drive new business
  • Partnership and collaboration with sales and other internal teams
  • Teaming with engagement managers to communicate project status, risk and issues to clients as appropriate
  • Engaging cloud solution engineers and other domain-specific SMEs (Adobe, Salesforce, Oracle, Google and similar) to support platform implementation as needed
  • Coordinating Testing/SIT/UAT activities as required by project scope and team structure

Requirements

  • 3+ years experience in ETL development using Big Data Technologies
  • 3+ years experience in building large-scale data processing projects using cloud technologies
  • 3+ years experience with data modeling and tuning of relational as well as NoSQL datastores
  • Experience with Programming and Scripting Languages (.NET, Python, Powershell, Java, Batch, Bash and similar)
  • Industry experience as a data engineer or related specialty (software engineer, application developer)
  • Experience building/operating highly scalable, fault-tolerant, distributed systems for extraction, ingestion, and processing of large data sets
  • Experience with software engineering best practices, including but not limited to version control, CICD, automated unit testing
  • Experience using cloud-native tools and design patterns
  • Degree in computer science, engineering, or relevant industry experience
  • Excellent interpersonal skills and the ability to articulate complex technical concepts with technical and non-technical individuals
  • Ability to approach a technical solution to solve for challenges from a business perspective
  • Understanding and experience working with customer-centric data and how to define uses for this data to enable business goals
  • Understanding of the full SDLC process
  • Limited immigration sponsorship may be available

Preferences:

  • Experience and knowledge with marketing cloud solutions
  • Experience and knowledge with web analytics or digital marketing
  • Experience working with public cloud offerings (AWS, Azure, Google Cloud Platform, and similar)
  • GCP - (Cloud Functions, Composer, SQL, Storage, Dataproc, Datastore, Kubernetes, Big Query, Stackdriver, Pub/Sub)
  • AWS - (Lambda, Glue, Data Pipeline, Redshift, Aurora, Athena/Spectrum, S3/Glacier, Fargate, Cloud Watch, Kinesis)
  • Azure - (Functions, Batch, Blob Storage, Data Warehouse, Data Factory, Containers, Monitor, Service Bus)
  • Experience and knowledge with data science, ML/AI, R, or Jupyter
  • Experience and knowledge with customer data platforms or demand-side platforms
  • Experience as an enterprise technical or engineer consultant
  • Experience using C#, Java or Python
  • Experience with Martech/Adtech tools and how to integrate technologies into the data management solution. (Adobe, Salesforce, Oracle, Google, and similar)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on ibainfotech.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:17 min

Eco-friendly factory operations and generative AI image errors

Chris Heilmann +1 · LIVE

3:31 min

Producing candlestick visualization charts inside integrated Jupyter notebooks

Akmal Chaudhri Akmal Chaudhri · LIVE

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:04 min

Overview of Kubernetes operators and custom resource definitions

Philipp Krenn · WWC 2022

5:36 min

Building a data analysis stack with Python and Jupyter

Markus Harrer Markus Harrer · WWC 2021

Videos

See all

Related articles

See all