ETL architect and developer

We’re looking for a Senior ETL data engineer to help us transform how consumers interact with real estate data. You should be a self-motivated leader that takes ownership of projects.

You are a Hands-on Senior ETL architect and developer who is excited to tackle the challenges that come with working on large volumes of diverse data with complex business rules.

You should be located in the Philadelphia/South Jersey region and be a US citizen, willing to come to our corporate office to work. However, you will start remote given current physical distancing restrictions.Thrive in building scalable, high throughput systems that processes more than 10 billion data points a day from over 500 sources that all need to be standardized and enhanced.

• Demonstrate the ability to quickly grasp complex subject matter and apply data engineering skills and technical knowledge to assess and provide solutions.
• Demonstrate a willingness to assist other team members in areas outside of direct assignments, when necessary.
• Collaborate in a virtual environment to complete projects with team members in various locations.
• You must be available for extended hours.
• Strong communication skills, a positive attitude, and empathy.
• Self-awareness and a desire to continually improve.

• Desire to write and maintain a clean and well-tested code base, avoiding tech debt.

• 7+ years of SQL Server database development experience
• 5+ years of ETL experience
• 5+ years of experience in working with Oracle and Postgres with experience in moving Oracle based processes to Postgre
• Advanced SQL knowledge for working with relational data in Oracle and Postgres
• Advanced programming experience with Python ( Java experience) with a focus on working with unstructured data .
• Experience programming in a Linux/UNIX environment including shell scripting.
• Experience with Bash scripts.
• Advanced experience with ETL processes: Preparing, staging, scheduling, monitoring, and maintaining automated data processes from large disconnected datasets into a production environment.
• Ability to develop analytical models (e.g., regression, simulation, statistical, etc.) for structured and unstructured data sets with a focus on data lineage to proactively identify risk areas and identify/catch outliers, trends and/or projections, where appropriate.
• Experience as well as a focus on DevOps principles such as CI/CD and IaC (Terraform)
• Working knowledge of message queuing (SNS/SQS/ and stream processing (Kinesis).