Data Engineer
IBA InfoTech Inc.
Charlotte, NC, United States
about 2 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Artificial Intelligence
C Sharp (Programming Language)
Customer Data Management
Data Stores
Data Warehousing
Python (Programming Language)
Oracle (Applications)
Salesforce.Com
Jupyter
Adobe
Kubernetes
+1 more
Data Management
Job description
As a Data Engineer, you’ll perform the technical implementation of customer data platforms (CDPs) and serve as a key player as it relates to data management. Your responsibilities will include:
- Interface with clients to gather requirements, map solutions, and make recommendations
- Lead customer project conference calls or interfaces with the project manager
- Create technical specifications to drive the development of the solution
- Deliver technical specifications documents for customer review
- Design custom development solutions that meet customer requirements
- Progress through full development lifecycle for a custom solution
- Deploy new solutions to production environments
- Maintain and support new and existing solutions and frameworks
- Innovate on new ideas to solve customer needs and assist to market internally new solutions
- Provide project estimates and timelines to drive new business
- Partnership and collaboration with sales and other internal teams
- Teaming with engagement managers to communicate project status, risk and issues to clients as appropriate
- Engaging cloud solution engineers and other domain-specific SMEs (Adobe, Salesforce, Oracle, Google and similar) to support platform implementation as needed
- Coordinating Testing/SIT/UAT activities as required by project scope and team structure
Requirements
- 3+ years experience in ETL development using Big Data Technologies
- 3+ years experience in building large-scale data processing projects using cloud technologies
- 3+ years experience with data modeling and tuning of relational as well as NoSQL datastores
- Experience with Programming and Scripting Languages (.NET, Python, Powershell, Java, Batch, Bash and similar)
- Industry experience as a data engineer or related specialty (software engineer, application developer)
- Experience building/operating highly scalable, fault-tolerant, distributed systems for extraction, ingestion, and processing of large data sets
- Experience with software engineering best practices, including but not limited to version control, CICD, automated unit testing
- Experience using cloud-native tools and design patterns
- Degree in computer science, engineering, or relevant industry experience
- Excellent interpersonal skills and the ability to articulate complex technical concepts with technical and non-technical individuals
- Ability to approach a technical solution to solve for challenges from a business perspective
- Understanding and experience working with customer-centric data and how to define uses for this data to enable business goals
- Understanding of the full SDLC process
- Limited immigration sponsorship may be available
Preferences:
- Experience and knowledge with marketing cloud solutions
- Experience and knowledge with web analytics or digital marketing
- Experience working with public cloud offerings (AWS, Azure, Google Cloud Platform, and similar)
- GCP - (Cloud Functions, Composer, SQL, Storage, Dataproc, Datastore, Kubernetes, Big Query, Stackdriver, Pub/Sub)
- AWS - (Lambda, Glue, Data Pipeline, Redshift, Aurora, Athena/Spectrum, S3/Glacier, Fargate, Cloud Watch, Kinesis)
- Azure - (Functions, Batch, Blob Storage, Data Warehouse, Data Factory, Containers, Monitor, Service Bus)
- Experience and knowledge with data science, ML/AI, R, or Jupyter
- Experience and knowledge with customer data platforms or demand-side platforms
- Experience as an enterprise technical or engineer consultant
- Experience using C#, Java or Python
- Experience with Martech/Adtech tools and how to integrate technologies into the data management solution. (Adobe, Salesforce, Oracle, Google, and similar)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on ibainfotech.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
LM
Luis Minvielle
Top-Paying Tech Jobs (with Salaries)
over 2 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago