A method for inferring label sampling mechanisms in semi-supervised learning

Saharon Rosset; Ji Zhu; Hui Zou; Trevor Hastie

A method for inferring label sampling mechanisms in semi-supervised learning

Saharon Rosset, Ji Zhu, Hui Zou, Trevor Hastie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

19 Scopus citations

Abstract

We consider the situation in semi-supervised learning, where the "label sampling" mechanism stochastically depends on the true response (as well as potentially on the features). We suggest a method of moments for estimating this stochastic dependence using the unlabeled data. This is potentially useful for two distinct purposes: A. As an input to a supervised learning procedure which can be used to "de-bias" its results using labeled data only and b. As a potentially interesting learning task in itself. We present several examples to illustrate the practical usefulness of our method.

Original language	English
Title of host publication	Advances in Neural Information Processing Systems 17 - Proceedings of the 2004 Conference, NIPS 2004
Publisher	Neural information processing systems foundation
ISBN (Print)	0262195348, 9780262195348
State	Published - 2005
Externally published	Yes
Event	18th Annual Conference on Neural Information Processing Systems, NIPS 2004 - Vancouver, BC, Canada Duration: 13 Dec 2004 → 16 Dec 2004

Publication series

Name	Advances in Neural Information Processing Systems
ISSN (Print)	1049-5258

Conference

Conference	18th Annual Conference on Neural Information Processing Systems, NIPS 2004
Country/Territory	Canada
City	Vancouver, BC
Period	13/12/04 → 16/12/04

Cite this

@inproceedings{bfe4fbf89405465c86b50e9eea9002a1,

title = "A method for inferring label sampling mechanisms in semi-supervised learning",

abstract = "We consider the situation in semi-supervised learning, where the {"}label sampling{"} mechanism stochastically depends on the true response (as well as potentially on the features). We suggest a method of moments for estimating this stochastic dependence using the unlabeled data. This is potentially useful for two distinct purposes: A. As an input to a supervised learning procedure which can be used to {"}de-bias{"} its results using labeled data only and b. As a potentially interesting learning task in itself. We present several examples to illustrate the practical usefulness of our method.",

author = "Saharon Rosset and Ji Zhu and Hui Zou and Trevor Hastie",

year = "2005",

language = "אנגלית",

isbn = "0262195348",

series = "Advances in Neural Information Processing Systems",

publisher = "Neural information processing systems foundation",

booktitle = "Advances in Neural Information Processing Systems 17 - Proceedings of the 2004 Conference, NIPS 2004",

address = "ארצות הברית",

note = "18th Annual Conference on Neural Information Processing Systems, NIPS 2004 ; Conference date: 13-12-2004 Through 16-12-2004",

}

Rosset, S, Zhu, J, Zou, H & Hastie, T 2005, A method for inferring label sampling mechanisms in semi-supervised learning. in Advances in Neural Information Processing Systems 17 - Proceedings of the 2004 Conference, NIPS 2004. Advances in Neural Information Processing Systems, Neural information processing systems foundation, 18th Annual Conference on Neural Information Processing Systems, NIPS 2004, Vancouver, BC, Canada, 13/12/04.

A method for inferring label sampling mechanisms in semi-supervised learning. / Rosset, Saharon; Zhu, Ji; Zou, Hui et al.
Advances in Neural Information Processing Systems 17 - Proceedings of the 2004 Conference, NIPS 2004. Neural information processing systems foundation, 2005. (Advances in Neural Information Processing Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A method for inferring label sampling mechanisms in semi-supervised learning

AU - Rosset, Saharon

AU - Zhu, Ji

AU - Zou, Hui

AU - Hastie, Trevor

PY - 2005

Y1 - 2005

N2 - We consider the situation in semi-supervised learning, where the "label sampling" mechanism stochastically depends on the true response (as well as potentially on the features). We suggest a method of moments for estimating this stochastic dependence using the unlabeled data. This is potentially useful for two distinct purposes: A. As an input to a supervised learning procedure which can be used to "de-bias" its results using labeled data only and b. As a potentially interesting learning task in itself. We present several examples to illustrate the practical usefulness of our method.

AB - We consider the situation in semi-supervised learning, where the "label sampling" mechanism stochastically depends on the true response (as well as potentially on the features). We suggest a method of moments for estimating this stochastic dependence using the unlabeled data. This is potentially useful for two distinct purposes: A. As an input to a supervised learning procedure which can be used to "de-bias" its results using labeled data only and b. As a potentially interesting learning task in itself. We present several examples to illustrate the practical usefulness of our method.

UR - http://www.scopus.com/inward/record.url?scp=33749554765&partnerID=8YFLogxK

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:33749554765

SN - 0262195348

SN - 9780262195348

T3 - Advances in Neural Information Processing Systems

BT - Advances in Neural Information Processing Systems 17 - Proceedings of the 2004 Conference, NIPS 2004

PB - Neural information processing systems foundation

T2 - 18th Annual Conference on Neural Information Processing Systems, NIPS 2004

Y2 - 13 December 2004 through 16 December 2004

ER -

A method for inferring label sampling mechanisms in semi-supervised learning

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this