Senior Software Engineer, Database Infrastructure Service
Job title: Senior Software Engineer, Database Infrastructure Service in USA at Airbnb
Company: Airbnb
Job description: The Community You Will Join:
- The mission of the DBExports team in the Online Database Infrastructure org is to provide a managed, reliable, performant and scalable platform for exporting data out of Airbnb's online databases for offline processing. The team currently builds and operates two managed solutions - one for near real time access to change logs (CDC) and another to provide periodic mutation and full table snapshots.
- As a member of this team you would be working with talented engineers on cutting edge technologies to help support Airbnb's business. You will be the resident expert on the online data exports platform and guide and collaborate with our internal product teams to effectively use the platform.
- Build and operate data ingestion system that enables various ways of accessing data at Airbnb, including ingest DB data in the warehouse in various formats and frequency, and stream change data capture (CDC) at near real time.
- Be hands-on (code, design, test) and collaborate with cross team partners (internal customers, dependencies and leadership) to deliver on multi-month projects in a timely fashion.
- Raise operational standards by effectively and proactively identifying, debugging and fixing operational issues. Be part of the oncall rotation for the DBExports platform.
- Mentor junior engineers on the team.
- 5+ years of experience building and operating large scale core backend distributed systems like storage, data ingestion, backup and restore, streaming.
- Ability to own and dive deeply in a complex code base.
- Experience maintaining, analyzing, and debugging production systems
- Knack for writing clean, readable, testable, maintainable code.
- Strong collaboration and communication skills in a remote-working environment.
- Demonstrate strong ownership and consistently deliver in a timely manner.
- Experience working in either Java, Scala or Python.
- Experience with building large scale data exports/ingestion platforms.
- Experience with building large scale distributed databases.
- Experience with AWS and/or GCP.
- Experience working with SPARK, Kafka, Flink, K8s, Airflow, AWS Aurora or TiDB.