Class HoldOutSubsetEvaluator

    • Constructor Detail

      • HoldOutSubsetEvaluator

        public HoldOutSubsetEvaluator()
    • Method Detail

      • evaluateSubset

        public abstract double evaluateSubset​(java.util.BitSet subset,
                                              Instances holdOut)
                                       throws java.lang.Exception
        Evaluates a subset of attributes with respect to a set of instances.
        Parameters:
        subset - a bitset representing the attribute subset to be evaluated
        holdOut - a set of instances (possibly seperate and distinct from those use to build/train the evaluator) with which to evaluate the merit of the subset
        Returns:
        the "merit" of the subset on the holdOut data
        Throws:
        java.lang.Exception - if the subset cannot be evaluated
      • evaluateSubset

        public abstract double evaluateSubset​(java.util.BitSet subset,
                                              Instance holdOut,
                                              boolean retrain)
                                       throws java.lang.Exception
        Evaluates a subset of attributes with respect to a single instance.
        Parameters:
        subset - a bitset representing the attribute subset to be evaluated
        holdOut - a single instance (possibly not one of those used to build/train the evaluator) with which to evaluate the merit of the subset
        retrain - true if the classifier should be retrained with respect to the new subset before testing on the holdOut instance.
        Returns:
        the "merit" of the subset on the holdOut instance
        Throws:
        java.lang.Exception - if the subset cannot be evaluated