Senior Data Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Engineer, you'll spend most of your time building and operating ETL while also operating and extending our data infrastructure. This is a hands-on individual contributor role with real ownership and genuine influence over how Tilia's data architecture evolves.
Day-to-day responsibilities:
- Build, extend, and debug ETL jobs, testing and validating locally before deploy
- Build the SQL transformations that turn production data into the curated datasets the business runs on
- Help execute our migration to a new AWS data lake on S3 and Athena, fed by DMS, without breaking what's live
- Calculate charges and earnings for our customers and their content creators, generate traceable invoices, and reconcile settlements
- Produce US money-transmitter reporting on outstanding stored value and money transmission liability
- Model new data, carefully weighing partitioning, indexing, and data types
- Write data validations to ensure high quality reporting
- Investigate pipeline failures, find the root cause, and fix it
- Partner with backend engineers on schema changes, keeping pipelines in step with a changing production environment
- Translate finance and compliance requirements into pipelines and data models
- Work with analysts and product to build the data behind key business and publisher reporting metrics
Key stakeholders:
- Internal: your data team, backend engineering, analysts, product, finance, and compliance
- External: publishers who rely on our reporting, and our payment and banking data partners
Tech stack:
Python, SQL, Airflow, BigQuery, MySQL, Change Data Capture, and AWS data services including S3, Athena, and DMS.
Success in this role means:
- Reliable, accurate pipelines that finance, compliance, and analysts can trust
- Financial and regulatory reports that hold up under audit
- A clean cutover to the new AWS data lake without disrupting live reporting
Requirements
A Bachelor's degree in Computer Science or a related field is preferred, though equivalent professional experience is equally valued. No specific certifications are required.
Experience
A proven track record building and operating production data pipelines and warehouses.
Technical skills:
- Expertise with RDBMS and SQL, including window functions, complex joins, aggregation, query optimization, and index design
- Python proficiency for building and maintaining ETL code, including testing
- Production data-warehouse experience with BigQuery, Snowflake, Redshift, or similar, modeling and transforming data at scale rather than just querying it
- Workflow orchestration experience with Airflow or a comparable tool such as Dagster, Prefect, or Luigi
- Hands-on experience with AWS data and analytics services such as S3, Athena, and DMS
- A correctness-first instinct for financial data: you build for auditability and reconcile rather than assume
Leadership and collaboration:
- Clear, effective communication of data trade-offs to both technical and non-technical stakeholders
- Ability to explain to finance, compliance, and analysts what the data does and doesn't say
Industry background, preferred but not required:
- Payments or fintech data experience
- Regulatory or compliance reporting experience: money transmission, tax, SOC-2, or PCI
- Background in virtual economies, gaming platforms, or creator economy products
Nice to have:
- Change Data Capture experience with Maxwell, Debezium, or AWS DMS
- Experience with metadata-driven or config-driven ETL frameworks
- Go literacy, enough to read the backend services that produce your source data
- Experience building reporting for non-engineering consumers in Tableau, Looker, or similar