Job description
About the Team and the Role:
At eBay, data flows swiftly within our marketplace — fueling countless real-time interactions among buyers and seller worldwide. To support this, our Rheos team (from the Ancient Greek for current, stream, or flow) provides the fully managed, continuously scaling stream processing and messaging data platform that enables near real-time buyer experiences, seller insights, and a data-driven commerce business.
We are seeking an experienced Senior Software Engineer with a strong background in streaming and messaging technologies, responsible for the design and development of the streaming Lakehouse storage system. This role also involves development and operations of eBay’s messaging and streaming infrastructure to ensure our distributed systems are reliable, scalable, and high performing to serve as the backbone for eBay’s mission-critical applications.
What You Will Accomplish
• Build, operate, and optimize eBay messaging and streaming platform, ensuring system reliability, scalability, and high performance.
• Troubleshoot and resolve production issues, ensuring minimal downtime. Maintain and improve system monitoring, logging, and alerting.
• Design and develop the streaming Lakehouse storage system
What You Will Bring:
• 7-10 years of hands on experience Building Software with a focus on streaming and messaging technologies. Solid background in messaging and streaming infrastructure. Strong proven experience designing and developing Streaming Lakehouse Storage systems.
• Solid foundation in computer science, with knowledge of algorithm design, operating systems, computer networks, databases, and other related fundamentals.
• Proficiency in at least one programming language among Java, Rust, or C++.
• In-depth understanding of the implementation principles of message middleware such as Kafka, Pulsar, or RocketMQ.
• Familiarity with the design and implementation of Lakehouse table formats like Apache Iceberg, Apache Paimon, or Apache Fluss.
• Great teammate and able to work with a global team.
Plus Points
• Familiarity with the design and implementation of storage engines such as RocksDB or LevelDB.
• Understanding of the implementation principles of database storage systems.
• Contributions to relevant open-source projects.