This paper discusses an important bias in evaluation of methods using cross-validation. A method that makes decisions based of cross validation can appear to increase overall performance by simply dealing with the bias of cross-validation and not the real problem.