Metrics
👨🏼 User Metrics
-Shoppers are now seeing 13.1% more lodgings and 10 less banners per session
-100% of shoppers see at least 2 hotel listings
-Loading the hotel list is much faster - an unexpected positive consequence of moving the map to a floating button
📈 Business Metrics
- Conversion improved by 14% (Goal: 9%)
-Purchase frequency increased to 20% from 6% (Goal: 22%)
Reflection
💭 Adding rules always adds an extra layer of friction, which is sometimes necessary.
Following the introduction of banner rules, a significant portion of my time was devoted to educating other teams about the permissible content for the shopping experience. It took a lot of time to gain buy-in on these standards.
What's next
✅ We A/B Tested three different versions: Control (80%), New UI with Banners (10%) and New UI without Banners (10%). Without Banners variant performed marginally better, so given business constraints, we launched the with Banners variant to 100% of iOS and Android users.
✅ Personalizing banner order based on user type / having more logic for which banner gets the first position.