Live Session
Wednesday Posters
Industry Poster
Visual Representation for Capturing Creator Theme in Brands-Creators Marketplace
Asnat Greenstein-Messica (Lightricks), Keren Gaiger (Lightricks), Sarel Duanis (Lightricks), Ravid Cohen (Lightricks) and Shaked Zychlinski (Lightricks)
Abstract
Providing cold start recommendations in a brand-creator marketplace is challenging as brands’ preferences extend beyond the mere objects depicted in the creator’s content and encompass the creator’s individual theme consistently resonates across images shared on her social media profile. Furthermore, brands often use textual keywords to describe their campaign’s aesthetic appeal, with which creators must align. To address these challenges, we propose two methods: SAME (Same Account Media Embedding), a novel creator representation employing a Siamese network to capture the unique creator theme and OAAR (Object-Agnostic Adjective Representation), enabling filtering creators based on textual adjectives that relate to aesthetic qualities through zero-shot learning. These two methods utilize CLIP, a state-of-the-art language-image model, and improve it in addressing the aforementioned challenges.