josephwu

AR Shopping Platform

Photogrammetry-based AR for a furniture shopping experience.

Year
2021
Role
UX Designer
Tags
AR/VRUIUX design3D ReconstructionHCI

See the actual object in your actual room before you buy.

Online resale platforms drown in returns because buyers can't understand the product or trust the seller. ShopAR is a photogrammetry-based AR selling platform: it gives buyers a real understanding of each object, builds a community of trust, and makes AR product creation easy enough for any seller.

ShopAR app mockups showing a chair viewed in AR and the furniture marketplace.

The concept moves AR creation to the user. The seller photographs the object from every side, and photogrammetry matches feature points across the images and stitches them into a 3D object with textures already mapped. The buyer sees all sides of the real item, not a studio render.

Concept sketch: photographing an object from all sides to build a photogrammetry model viewable in the app.

The platform is two-sided, so the research built two personas. Kathleen, the seller, loses money on every return and has no infrastructure beyond photos to show what she sells.

Seller persona: Kathleen, who loses money on returns.

Joseph, the buyer, can't see hidden defects, can't judge size, and can't tell how an object will look outside a white-background listing.

Buyer persona: Joseph, who can't judge products from listing photos.

Auditing current resale apps showed how their design makes the problem worse: angle-picked photos hide damage, white backgrounds strip context, and returns get complicated when a third-party seller is involved. Both sides stop trusting the app.

Audit of current resale shopping platforms.

Journey maps for selling and buying tied each pain point to a specific step in the process, from taking listing photos to handling the return.

Seller journey map from listing to return.

On the cost-impact matrix, augmented reality stood out: the one intervention that accurately represents objects in context without new hardware on either side.

Feasibility matrix with augmented reality as the standout solution.
Information architecture for the two-sided ShopAR platform.

Early wireframes laid out the flows: browse, inspect, capture, and place.

Early low-fidelity flows for browsing, capturing, and placing furniture.

We tested the flows as clickable prototypes before committing to visual design.

Screen recording of an early prototype test.

High-fidelity version 1 introduced the community page: users upload their own rooms and furniture in AR, which gives people a reason to come back to the platform.

High-fidelity version 1 screens with capture view and community feed.

Version 2 tightened the shopping core. Each piece carries a detail view with the product's story before you take it into AR.

ShopAR home screen with categories and popular items.

A simple instruction and feedback loop walks sellers around the object, so capturing a photogrammetry model feels like taking a few photos.

Guided capture flow prompting pictures from all sides of the item.

The AR view places the stitched model in the buyer's room with accurate materials, and accurate damage, because it comes from real photos. Open questions for the next pass: specular objects, baked-in lighting, and closing the mesh under the object.

Photogrammetry furniture model placed in a real room through the AR view.

Credits

Team
Kenny Kim, Aishwarya Sreenivas, Joseph Wu
Duration
November 2021 (1 month)