Data Engineer

We are seeking an experienced Data Engineer to design, develop, and optimize scalable data pipelines and data warehouse solutions. The ideal candidate will have strong expertise in ETL/ELT development, Snowflake, Python, and SQL, along with experience building robust data integration solutions that support business intelligence, analytics, and data science initiatives., * Design, develop, and maintain scalable ETL/ELT pipelines for ingesting and transforming data from multiple source systems.

• Build, optimize, and maintain data warehouse solutions using Snowflake.
• Develop data processing frameworks and automation scripts using Python.
• Write complex and optimized SQL queries, stored procedures, and views for data transformation and reporting.
• Implement data validation, cleansing, and quality checks to ensure data accuracy and consistency.
• Optimize Snowflake performance, including warehouse sizing, clustering, partitioning, and query tuning.
• Collaborate with business analysts, data scientists, and application teams to understand data requirements.
• Monitor data pipelines, troubleshoot production issues, and implement proactive monitoring solutions.
• Develop reusable data integration components and follow best practices for coding, testing, and deployment.
• Ensure data security, governance, and compliance standards are followed throughout the data lifecycle.
• Create technical documentation for data models, ETL processes, and system architecture.

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 4 years of experience as a Data Engineer or similar role.
• Strong hands-on experience developing ETL/ELT pipelines.
• Extensive experience with Snowflake data warehouse development and administration.
• Strong programming skills in Python.
• Advanced proficiency in SQL, including performance tuning and query optimization.
• Experience working with structured and semi-structured data (JSON, XML, CSV, Parquet).
• Experience with Git or other version control systems.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration abilities.

Preferred Qualifications

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Knowledge of orchestration tools such as Apache Airflow.
• Experience with CI/CD pipelines and DevOps practices.
• Familiarity with data modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
• Understanding of data governance, security, and data quality frameworks.
• Experience with big data technologies such as Spark is a plus.