This option requires that features within a subset of predictors are maximally dissimilar to each other while still exceeding a specified level of mutual information with the target phenotype .See Ding and Peng (2005) 1 for more information.
Ding, C and Peng, H. (2005) Minimum redundancy feature selection from microarray gene expression data. J Bioinformatics and Computational Biology 3: 185-205.
Make sure that the Optimize the continuous predictor set check box is checked.