|
Solutions to Instability Problems with Sequential Wrapper-based Approaches to Feature Selection |
Dunne, Kevin; Cunningham, Padraig; Azuaje, Francisco
|
|
|
|
TCD-CS-2002-28 It is generally accepted that Wrapper approaches will outperform
Filter-based approaches to feature selection, particularly in situations
where an adequate amount of data is available. What is often overlooked
is that Wrapper approaches can be unstable. For instance, different
partitionings of the training data can result in di#11;erent routes
through the search space and thus in di#11;erent feature subsets being
selected. In this paper we illustrate examples of this problem and a
solution based on the aggregation of several runs of a sequential search
is suggested. This is essentially an ensemble solution to instability in
feature subset selection and it does seem to stabilise the process.
|
|
Keyword(s):
|
Computer Science |
Publication Date:
|
2002 |
|
Type:
|
Report |
|
Peer-Reviewed:
|
Unknown |
|
Language(s):
|
English |
|
Institution:
|
Trinity College Dublin |
|
Citation(s):
|
Dunne, Kevin; Cunningham, Padraig; Azuaje, Francisco. 'Solutions to Instability Problems with Sequential Wrapper-based Approaches to Feature Selection'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2002-28, 2002, pp22 |
|
Publisher(s):
|
Trinity College Dublin, Department of Computer Science |
|
File Format(s):
|
application/pdf |
|
First Indexed:
2014-05-13 05:31:21 Last Updated:
2015-04-10 05:14:02 |