Data Engineer, AVP
Role details
Job location
Tech stack
Job description
We are seeking a highly skilled and motivated Senior Data Engineer/Developer to design, build, and maintain robust, scalable, and high-performance data solutions., The Data Engineer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities., * Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
- Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
- Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
- Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
- Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
- Ensure essential procedures are followed and help define operating standards and processes
- Serve as advisor or coach to new or lower level analysts
- Has the ability to operate with a limited level of direct supervision.
- Can exercise independence of judgement and autonomy.
- Acts as SME to senior stakeholders and /or other team members.
- Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
Requirements
- 5+ years of relevant experience as a data engineer
- Data Pipelining & ETL: Expertise in designing and implementing scalable data pipelines using Python/Pyspark, with experience in ETL tools (e.g., Microsoft BI/SSIS, IBM DataStage etc.).
- Database Management: Advanced proficiency (3+ years) in RDBMS (T-SQL/PL/SQL) and NoSQL (e.g., MongoDB).
- Big Data Platforms: Extensive experience (3+ years) with Hadoop ecosystem technologies (e.g., HDFS, Hive, Pig, Sqoop), preferably Cloudera.
- Data Architecture & Modeling: Solid understanding of data warehousing, dimensional modeling, and 3NF to ensure scalable and performant data solutions.
- DevOps & Automation: Ability to implement CI/CD pipelines, use Git for version control, and leverage Docker/Kubernetes for containerization.
- Code Quality & Standards: Experience contributing to enforcing good coding standards and participating in code reviews to maintain high-quality codebases.
- Framework Contribution: Skill in contributing to the enhancement of existing data frameworks and evaluating new technologies for adoption.
- Job Orchestration: Proficiency in managing data workflows with enterprise scheduling tools (e.g., Autosys).
- Data Connectivity & Visualization: Experience with secure data connectivity tools (e.g., Connect Direct, SSH Tectia) and data visualization platforms (e.g., Tableau).
- AI-Driven Development: Capability to utilize AI tools (e.g., Devin) for efficient code refactoring and optimization.
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Working knowledge of consulting/project management techniques/methods
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Education:
- Bachelor's degree/University degree or equivalent experience