Wayfair Delivery Instruction Adoption

Scroll down

Preventing $1.8MM in missed deliveries through customer awareness and UX enhancements.

Project

Delivery Instructions

Client

Wayfair

sector

E-Commerce

project date

April 2021

Overview

Missed deliveries are stressful for customers, frustrating for delivery drivers, and expensive for Wayfair to resolve.

10% of Wayfair deliveries are missed, incurring both a short-term expense to resolve and long-term damage to the brand after a customer has a poor experience. There are many variables that can potentially cause a missed delivery - locked gates, signature requirements, unclear navigation instructions, the list goes on. My task was to re-evaluate the Delivery Instructions experience on Wayfair to prevent as many missed deliveries as possible.

A Macbook with a mockup of the Delivery Instructions modal window on it.

Problem Overview

Every year, Wayfair gets over 67,500 calls from customers asking to add delivery instructions to their order, costing the business over $500,000 annually. Wayfair has a self-service tool that allows customers to add their own instructions, but it only a single entry point which is hidden away inside a drawer with a 15% clickthrough rate. Wayfair was not doing much to market this feature either, never being mentioned anywhere in post-order communications, emails, or SMS texts.

Some quick observation in Fullstory showed that most users who call Wayfair to add delivery instructions came from the Track Package page, which lacked an entry point into that flow. This kicked off my investigation into the disconnect between where customers expect to add delivery instructions and where they actually are on Wayfair.

Heuristic Evaluation

I conducted a heuristic evaluation of the Add Delivery Instructions flow on Wayfair, Amazon, and Target, to better understand customer expectations. One pain point I observed is that Wayfair only allows delivery instructions on the item level, instead of the address level. This meant that every time you place an order, you need to rewrite the instructions on every item. This unexpected behavior caused frustration for the user and increased the risk of future missed deliveries, especially for B2B customers who can have hundreds or thousands of items per order.

Another gap identified in Wayfair’s experience is the inability to add delivery instructions to an item before it has shipped. This limitation prevented customers from adding instructions at checkout, so they would instead have to wait 48 hours for the item to ship, return to the site, and add instructions without Wayfair prompting this action in any direct way. The overarching issue identified from this evaluation is that adding delivery instructions on Wayfair required a lot more active thought and direct action from the user compared to your typical e-commerce site.

A spreadsheet showcasing the various delivery instruction options and locations of those instructions on Wayfair.A spreadsheet showcasing the various delivery instruction options and locations of those instructions on Target and Amazon.

Customer Expectations

After evaluating the overarching experience, I dove deeper into the delivery instructions form itself to see which fields were table stakes to include. Wayfair only had a single text field to enter all instructions, but most of the e-commerce sites I reviewed had a range of validated fields with specific categories such as “drop-off location”, “security code”, and “business hours”. Call analytics showed that over 75% of Wayfair's delivery instruction requests fit into 3 categories: add gate code, add phone number, or add navigation/drop-off instructions.

A screenshot of Amazon's Delivery Instructions menu on the checkout page.

Customer Card Sort

Wayfair has 11 different categories of delivery instructions, but customers have no way of knowing what Wayfair considers to be a valid request. To better understand how customers organize categories in their head, I utilized usertesting.com and Optimal Sort to recruit active Wayfair customers for a card sorting exercise.


66% of test participants created the same two groupings - Requests and Contact Info. “Requests” are instructions that customers would like Wayfair to do, but they understand that it may not be possible (such as rerouting an item that is already in transit). The “Contact Info” grouping are options that customers view as permanent and guaranteed to be followed, such as adding a gate code or drop-off location to their order.

A spreadsheet of responses from the unmoderated user test.An example of the results from the card sorting exercise.

Unmoderated User Test

For my last piece of discovery I conducted an unmoderated user test to understand where customers look to find the entry point into delivery instructions, pain points in their search process, and to clarify if the existing modal matched their expectations.

Customers were split into two groups - the first group added a gate code to their order, while the second group added a proxy person to sign for their package. Both groups overwhelmingly looked in the checkout page to add their respective delivery instructions. For the sake of speed-to-market, I targeted the 3 highest impact categories (gate code, phone number, navigation/drop-off instructions) to include in the v1 component and I collaborated with the checkout team to ensure that this component would be implemented in checkout for the initial launch.

A user testing plan outlining how to conduct an unmoderated test, the goals, and the questions that will be asked.A spreadsheet showing the results of the unmoderated user testing session.

Initial Concepts

I began designing UI concepts for a more robust delivery instructions component on the checkout page. I held regular discussions with my PM, engineering team, and analytics to understand the back-end impact that each design would have, and where data refactoring could potentially slow down development of the new component. After a dot-voting session, we agreed on option 1 (Form Style) as the best path forward due to its ease of implementation, consistent scalability, and the visibility that it gives customers to see every option that is available.

Content Enhancement

As I learned from my previous research, customers don’t intuitively know what is considered to be a valid delivery instruction. The first way in which I targeted this was by collaborating with a content strategist to write helper text for each field, providing clear and concise examples of valid instructions. We also created a Help Center article that clarifies what and why we can't always adhere to a customer's instructions, which we link to within the new component.

Recommendations written by content strategy  on how to word the helper text for various delivery instruction fields.Recommendations written by content strategy on how to enhance the copy on various banners and error messages relating to delivery instructions.

Implementation Challenges

While we were able to successfully build the delivery instructions modal at checkout, it had to be placed on a dedicated page for all other entry points. This is because we couldn't link to an open modal window in emails or the Help Center, but this also provided back-end benefits such as improved click-tracking data. For v1, the dev team took the checkout modal and simply placed it on a blank page, causing it to look unresponsive on desktop, but this issue was resolved in the next iteration.

We had to remove “Drop-off Location” in the initial implementation of delivery instructions because it was causing confusion for delivery agents. One driver explained that a customer paid for “Room of Choice” delivery inside their home, but the instructions said “Leave at side entrance”. This slowed the driver down as he had to reach out to the customer directly to clarify how they wanted the item to be delivered. Drop-off Location has been pinned as a future enhancement once we have the data capability to hide location options which would create a conflict for the driver.

Entry Points

One of the key KPIs in this project was to increase visibility and adoption of delivery instructions. To achieve this goal I added new entry points across the site on pages such as My Orders, Track Package, and Contact Us. These new entry points serve a dual purpose, not only promoting delivery instructions but also deflecting a customer who would have otherwise called Wayfair for help.

I worked with the comms team to add entry points within our emails, most significant being the Order Confirmation email. Data showed that customers are most likely to add instructions to their order when the confirmation email is sent, so we ensured that the CTA is visible above the fold for both desktop and mobile users. We plan to add entry points into the virtual assistant and in SMS text support once those tools are fully launched globally.

Customer Support Enhancement

The problems with the existing delivery instructions component extended to Wayfair’s call center team as well. Much like the customer-facing modal, the internal wizard was just a single open text field where agents could enter anything the customer asked for. This resulted in newer agents having to either guess if an instruction is valid, or put the customer on hold to ask their supervisor. I redesigned this modal to show every available delivery instruction, with example text, so agents can assure customers that the driver will follow their request.

There are a few common requests that get automatically rejected by delivery drivers, such as writing in the instructions to deliver to a different address. I included these in the modal for visibility, but clicking on "Launch Tool" will redirect them to the appropriate wizard to make that change.

A modal window used by call center employees to make various order changes, including adding delivery instructions.An expanded modal window showing various options to make changes to a user's order that require a different wizard to be launched.

Future-State

One month after the successful launch of the new delivery instructions flow, analytics calculated the annual cost savings to Wayfair as a result of reduced Follow-On Contact Rate, Abandonment to Contact Rate and Missed Deliveries coming in at a savings of approximately $1.8MM per year.

I ran a design evaluation post-launch with the product team to catch any UI bugs, and to organize my recommendations for v2 enhancements. Most of the comments revolved around scaling and copy improvements, which I added to a feature list which has since been reviewed and approved by engineering and management.