Senior Data Engineer

We are looking for a Senior Data Engineer with 8 years of experience in designing, developing, and maintaining scalable data pipelines and data engineering solutions. The ideal candidate should have strong expertise in Python, SQL, ETL/ELT, cloud platforms, and big data technologies., * Design, develop, and maintain scalable ETL/ELT pipelines.

• Develop data processing solutions using Python, PySpark, and SQL.

• Build and optimize data ingestion and transformation workflows.

• Work with large datasets, data lakes, and data warehouses.

• Develop and optimize complex SQL queries and database operations.

• Implement data quality checks, validation, and error-handling processes.

• Work with cloud platforms such as AWS, Azure, or GCP.

• Use Apache Spark and workflow orchestration tools to process and manage data pipelines.

• Collaborate with data architects, analysts, and business teams to understand requirements.

• Monitor pipeline performance, troubleshoot issues, and support production environments.

• Follow best practices for data security, governance, and performance optimization.

• Participate in code reviews, technical discussions, and Agile ceremonies.

• 8 years of experience in Data Engineering.

• Strong proficiency in Python, SQL, and ETL/ELT processes.

• Hands-on experience with PySpark and Apache Spark.

• Experience with AWS, Azure, or GCP.

• Knowledge of data warehousing and data lake architecture.

• Experience with Snowflake, Databricks, or other modern data platforms.

• Familiarity with Apache Airflow or similar orchestration tools.

• Experience with relational and NoSQL databases.

• Knowledge of Git, CI/CD, and data pipeline monitoring.

• Strong analytical, troubleshooting, and communication skills.

Preferred Qualifications

• Experience with Kafka or other streaming technologies.

• Familiarity with Delta Lake and cloud-based data architectures.

• Experience with data modeling and data governance.

• Experience working in Agile/Scrum environments.

Work Location: Hybrid remote in Aldie, VA 20105