Examining the Impact of Keyword Ambiguity on Search Advertising Performance: A Topic Model Approach

MIS Quarterly (Forthcoming)

75 Pages Posted: 4 Mar 2014 Last revised: 22 Jul 2020

See all articles by Jing Gong

Jing Gong

University of Virginia - McIntire School of Commerce

Vibhanshu Abhishek

Carnegie Mellon University - H. John Heinz III School of Public Policy and Management

Beibei Li

Carnegie Mellon University - H. John Heinz III School of Public Policy and Management

Date Written: August 11, 2017

Abstract

In this paper, we explore how keyword ambiguity can affect search advertising performance. Consumers arrive at search engines with diverse interests, which are often unobserved and nontrivial to predict. The search interests of different consumers may vary even when they are searching using the same keyword. In our study, we propose an automatic way of examining keyword ambiguity based on probabilistic topic models from machine learning and computational linguistics. We examine the effect of keyword ambiguity on keyword performance using a hierarchical Bayesian approach that allows for topic-specific effects and nonlinear position effects, and jointly models click-through rate (CTR) and ad position (rank). We validate our study using a novel data set from a major search engine that contains information on consumer click activities for 2,625 distinct keywords across multiple product categories from 10,000 impressions. We find that consumer click behavior varies significantly across keywords, and such variation can be partially explained by keyword ambiguity. Specifically, higher keyword ambiguity is associated with higher CTR on top-positioned ads, but also a faster decay in CTR with screen position. Therefore, the overall effect of keyword ambiguity on CTR varies across positions. Our study provides implications for advertisers to improve the prediction of keyword performance by taking into account keyword ambiguity and other semantic characteristics of keywords. It can also help search engines design keyword planning tools to aid advertisers when choosing potential keywords.

Keywords: Sponsored search advertising, topic models, contextual ambiguity, machine learning, keyword selection

JEL Classification: M37, D8

Suggested Citation

Gong, Jing and Abhishek, Vibhanshu and Li, Beibei, Examining the Impact of Keyword Ambiguity on Search Advertising Performance: A Topic Model Approach (August 11, 2017). MIS Quarterly (Forthcoming), Available at SSRN: https://ssrn.com/abstract=2404081 or http://dx.doi.org/10.2139/ssrn.2404081

Jing Gong

University of Virginia - McIntire School of Commerce ( email )

P.O. Box 400173
Charlottesville, VA 22904-4173
United States

Vibhanshu Abhishek (Contact Author)

Carnegie Mellon University - H. John Heinz III School of Public Policy and Management ( email )

Pittsburgh, PA 15213-3890
United States

Beibei Li

Carnegie Mellon University - H. John Heinz III School of Public Policy and Management ( email )

Pittsburgh, PA 15213-3890
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
1,024
Abstract Views
5,393
Rank
40,597
PlumX Metrics