Seeing the Non-Stars: (Some) Sources of Bias in Past Disambiguation Approaches and a New Public Tool Leveraging Labeled Records

67 Pages Posted: 7 Jun 2012 Last revised: 28 Jan 2015

See all articles by Samuel Ventura

Samuel Ventura

Carnegie Mellon University - Department of Statistics

Rebecca Nugent

Carnegie Mellon University - Department of Statistics

Erica R.H. Fuchs

Department of Engineering and Public Policy, Carnegie Mellon University

Date Written: January 27, 2015

Abstract

To date, methods used to disambiguate inventors in the United States Patent and Trademark Office (USPTO) database have been rule- and threshold-based (requiring and leveraging expert knowledge) or semi-supervised algorithms trained on statistically-generated artificial labels. Using a large, hand-disambiguated set of 98,762 labeled USPTO inventor records from the field of optoelectronics consisting of four sub-samples of inventors with varying characteristics (Akinsanmi et al. 2014) and a second large, hand-disambiguated set of 53,378 labeled inventor records corresponding to a subset of academics in the life sciences (Azoulay et al. 2012), we provide the first supervised learning approach for USPTO inventor disambiguation. Using these two sets of inventor records, we also provide extensive evaluations of both our algorithm and three examples of prior approaches to USPTO disambiguation arguably representative of the range of approaches used to-date. We show that the three past disambiguation algorithms we evaluate demonstrate biases depending on the feature distribution of the target disambiguation population. Both the rule- and threshold-based methods and the semi-supervised approach perform poorly (10-22% false negative error rates) on a random sample of optoelectronics inventors – arguably the closest of our sub-samples to what might be expected of the majority of inventors in the USPTO (based on disambiguation-relevant metrics). The supervised learning approach, using random forests and trained on our labeled optoelectronics dataset, consistently maintains error rates below 3% across all of our available samples. We make public both our labeled optoelectronics inventor records and our code to build supervised learning models and disambiguate inventors. Our code also allows users to implement supervised learning approaches with their own representative labeled training data.

Keywords: Inventor, Disambiguation, Patents, Supervised Learning, Random Forests

Suggested Citation

Ventura, Samuel and Nugent, Rebecca and Fuchs, Erica Renee, Seeing the Non-Stars: (Some) Sources of Bias in Past Disambiguation Approaches and a New Public Tool Leveraging Labeled Records (January 27, 2015). Research Policy, Forthcoming, Available at SSRN: https://ssrn.com/abstract=2079330 or http://dx.doi.org/10.2139/ssrn.2079330

Samuel Ventura (Contact Author)

Carnegie Mellon University - Department of Statistics ( email )

Baker Hall
Pittsburgh, PA 15213
United States

Rebecca Nugent

Carnegie Mellon University - Department of Statistics ( email )

Baker Hall
Pittsburgh, PA 15213
United States

Erica Renee Fuchs

Department of Engineering and Public Policy, Carnegie Mellon University ( email )

Pittsburgh, PA 15213-3890
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
212
Abstract Views
2,181
Rank
260,474
PlumX Metrics