Software Engineering Advisor - Data & Analytics Engineering
Role details
Job location
Tech stack
Job description
Join a team that powers critical data and analytics capabilities across both on-premises and AWS cloud environments. We are seeking a skilled Software Engineering Advisor to help modernize and optimize enterprise data platforms that enable trusted, data-driven decisions across the business. In this role, you will combine deep technical expertise with a passion for operational excellence, partnering with architects, analysts, and engineering teams to deliver scalable, high-performing data solutions. The ideal candidate brings strong experience with Teradata, Databricks, AWS, and modern data engineering practices., * Design, build, and maintain scalable data pipelines that integrate enterprise data from Teradata into Databricks and AWS cloud platforms.
- Drive performance optimization across data processing workloads by improving query efficiency, database structures, and data loading strategies.
- Develop and support ETL solutions using Informatica and related technologies to ensure reliable data movement and transformation.
- Partner with data architects, analysts, data stewards, and business stakeholders to deliver accurate, accessible, and trusted data assets.
- Monitor, troubleshoot, and resolve data pipeline issues to improve reliability, performance, and data integrity.
- Implement data quality controls, validation frameworks, and monitoring solutions that enhance confidence in enterprise reporting and analytics.
- Contribute to capacity planning, security initiatives, and platform performance improvements across the data ecosystem.
- Document technical solutions, architecture decisions, and operational processes to support long-term maintainability.
- Collaborate within Agile teams to deliver high-quality solutions while identifying innovative approaches and alternative technical recommendations.
Requirements
- 5+ years of experience in software engineering, data engineering, or a related development role.
- 5+ years of hands-on Teradata development experience, including query tuning and performance optimization.
- Advanced SQL skills with experience developing complex queries, stored procedures, and database objects.
- 4+ years of experience building data solutions with Databricks and Apache Spark.
- Experience with AWS services such as S3, Glue, Lambda, EC2, and workflow orchestration tools.
- Experience developing and supporting enterprise ETL processes and data pipelines.
- Proficiency with Python for data engineering and automation.
- Knowledge of data warehousing concepts, large-scale data processing, and data modeling principles.
- Experience with CI/CD practices and tools such as GitHub and Jenkins.
- Strong analytical, troubleshooting, communication, and collaboration skills.
- Experience working within Agile delivery environments.
Preferred Qualifications
- Experience migrating or modernizing enterprise data warehouse solutions.
- Familiarity with workflow scheduling and orchestration platforms such as Airflow.
- Experience supporting cloud-based analytics and data platform transformations.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience working in highly regulated or large enterprise environments.