Data Engineer II
Role details
Job location
Tech stack
Job description
As a Data Engineer II, you will share ownership of Redfin's Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams.
About the Role
-
Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin
-
Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources
-
Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in
-
Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production
-
Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices
-
Support and maintain dev / test / prod environments
-
Serve as part of weekly on call rotation
Requirements
-
3+ years experience with a modern programming language (Python, Java, etc). Python is preferred
-
3+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc). Snowflake is preferred
-
Experience creating and maintaining complex data pipelines
-
Experience with batch and streaming data pipelines
-
Experience with both structured and unstructured data sets
-
Ability to translate business needs into technical requirements
-
Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus
-
Experience with API development is a plus
-
Experience with cloud services (AWS / Azure / GCP) is a plus. AWS is preferred
-
Ability to structure data to make it accessible, performant, and resilient to change
-
Experience with message queuing and stream processing data is a plus
-
Ability to handle ambiguity and function in a fast paced, constantly changing environment
-
Ability to communicate well with both technical and non technical users
Benefits & conditions
The compensation information below is provided in compliance with all applicable job posting disclosure requirements. The compensation for this position is $119,900.00-$162,200.00 . The position may also be eligible for an annual bonus, incentives, and other employment-related benefits including, but not limited to, medical, dental, and vision benefits, 401K retirement plan, and paid-time off. More information regarding these benefits and others can be found here (https://url.us.m.mimecastprotect.com/s/_BJHClY8MQF9kpgWSGf8CzlIAe?domain=myrocketcareer.com/) . The information regarding compensation and other benefits included in this paragraph is the company's current, good faith estimate at the time of posting. [Compensation and benefits are subject to modification from time to time as the Company, in its sole and exclusive discretion, deems appropriate.] The Company may determine during its future reviews of the proposed compensation and benefits provided for this position, that the compensation and benefits for such position should be reduced. In no event will the Company reduce the compensation for the position to a level below the applicable jurisdictional minimum wage rate for the position. Los Angeles County and San Francisco Candidates only: qualified applicants with arrest or conviction records will be considered for employment per the Fair Chance Ordinance and the Fair Chance Initiative for Hiring.