Data Engineer - AI & Analytics
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+34 more
Job description
- Assess customer data environments to evaluate data quality, structure, lineage, and AI/ML readiness.
- Design, build, and optimize scalable ETL/ELT pipelines across APIs, relational databases, cloud storage, files, and streaming platforms.
- Develop cloud-native data infrastructure supporting enterprise AI, analytics, and machine learning initiatives.
- Build high-performance batch and real-time data processing pipelines.
- Create reusable, production-ready data assets for analytics, business intelligence, and machine learning teams.
- Implement best practices for data governance, security, privacy, metadata management, and regulatory compliance.
- Optimize data models, storage formats, and pipeline performance for large-scale processing.
- Develop and maintain technical documentation, architecture diagrams, and operational procedures.
- Collaborate with data scientists, software engineers, analysts, and business stakeholders to deliver scalable data solutions.
- Troubleshoot and resolve complex data integration and performance challenges across modern and legacy environments.
Requirements
- Advanced proficiency in Python and SQL for enterprise data engineering.
- Experience with PySpark or comparable distributed processing frameworks.
- Hands-on experience with Databricks, Apache Spark, or similar cloud data platforms.
- Experience using Apache Airflow or equivalent workflow orchestration tools.
- Strong knowledge of Parquet, Delta Lake, and modern analytical storage formats.
- Experience building streaming solutions using Kafka or equivalent messaging platforms.
- Proficiency with Docker, Git, CI/CD pipelines, and DevOps practices.
- Strong understanding of cloud data architectures, API development, and distributed systems.
- Knowledge of data modeling, performance tuning, and scalable data architecture design.
- Familiarity with Master Data Management (MDM), data governance, data lineage, PII compliance, and responsible AI data practices.
- Exposure to analytics libraries, statistical computing frameworks, and Natural Language Processing (NLP) technologies is a plus.
- Excellent analytical, troubleshooting, and collaboration skills.
Experience:
- 5+ years of experience in data engineering, cloud data platforms, or big data development.
- Demonstrated success designing enterprise-scale data platforms supporting AI, analytics, or machine learning workloads.
- Experience developing robust ETL/ELT pipelines across structured, semi-structured, and streaming data sources.
- Strong background in application development, API development, debugging, and performance optimization.
- Experience working with modern cloud technologies and distributed computing environments.
- Ability to translate complex business and technical requirements into scalable data architecture solutions.
Education:
- Bachelor’s degree in Computer Science, Information Systems, Data Science, Engineering, or a related technical discipline.
- Equivalent professional experience will also be considered.
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
Benefits & conditions
The expected base salary for this position ranges from $70.00 to $75.00/hour. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered.
About the company
CTG, a Cegeka company, delivers IT and business solutions that enhance clients’ digital agility, empowering them to seize new opportunities and overcome any challenge. Backed by more than 60 years’ experience and a commitment to being a reliable, results-driven partner, we work shoulder to shoulder with clients to shape digital together. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. With more than 9,000 team members in over 15 countries, we combine global expertise with local insight to deliver innovative solutions. We operate across the Americas, Europe, and India, working with over 3,000 clients in many of today’s highest-growth industries.
Together, we shape what’s next-working shoulder to shoulder to deliver impactful solutions for our clients and society. Our culture is built by the people who work at CTG, the values we hold, and the actions we take. It’s a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. At CTG, you’ll find a workplace where you are encouraged to grow, supported in your ambitions, and empowered to shape your own career journey. For more information, visit ;br> CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully committed to promoting employment opportunities for members of protected classes.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production