Skip to contents

Selects the smallest feature set within one standard error of the best as the result. If there are multiple feature sets with the same performance and number of features, the first one is selected.

Source

Kuhn, Max, Johnson, Kjell (2013). “Applied Predictive Modeling.” In chapter Over-Fitting and Model Tuning, 61--92. Springer New York, New York, NY. ISBN 978-1-4614-6849-3, https://doi.org/10.1007/978-1-4614-6849-3_4.

Examples

clbk("mlr3fselect.one_se_rule")
#> <CallbackFSelect:mlr3fselect.one_se_rule>: One Standard Error Rule Callback
#> * Active Stages: on_result

# Run feature selection on the pima data set with the callback
instance = fselect(
  fselector = fs("random_search"),
  task = tsk("pima"),
  learner = lrn("classif.rpart"),
  resampling = rsmp ("cv", folds = 3),
  measures = msr("classif.ce"),
  term_evals = 10,
  callbacks = clbk("mlr3fselect.one_se_rule"))
# Smallest feature set within one standard error of the best
instance$result
#>       age glucose insulin   mass pedigree pregnant pressure triceps
#>    <lgcl>  <lgcl>  <lgcl> <lgcl>   <lgcl>   <lgcl>   <lgcl>  <lgcl>
#> 1:  FALSE    TRUE    TRUE   TRUE    FALSE    FALSE    FALSE   FALSE
#>                features n_features classif.ce
#>                  <list>     <list>      <num>
#> 1: glucose,insulin,mass          3  0.2513021