New feature selection method for text categorization maximizes max-difference criterion

Higher Education Press

For text categorization, it is necessary to select a set of features(terms) with high discrimination by using feature selection. In text feature selection, Accuracy2(ACC2)treats terms with same absolute document rate difference but different discrimination equally, which is unreasonable. Existing improved methods (normalized difference measure(NDM), max-min ratio(MMR)and trigonometric comparison measure(TCM)) based on ACC2 may confuse the importance of rare and sparse terms on account of challenge for parameter selection.

To solve the problems, a research team led by Li Zhang published their new research on 15 February 2023 in Frontiers of Computer Science co-published by Higher Education Press and Springer Nature.

The team proposed max-difference maximization criterion(MDMC), which introduces a new weight based on class information occupacity and combines it with ACC2 to estimate the importance of terms. As a result, MDMC can avoid overestimate of sparse terms.

In the research, they analyze the weight distributions of methods (ACC2, NDM, MMR, TCM and MDMC) and intuitively show the mechanism of MDMC to estimate the importance of terms, which is shown in online resources. Experiments demonstrate that MDMC is capable of catching more discriminant terms without any parameter than other filter ones regardless of classifier, and shows its superiority over other dimensionality reduction methods (improved sine cosine algorithm(ISCA), principal component analysis(PCA)and non-negative matrix factorization(NMF)).

/Public Release. This material from the originating organization/author(s) might be of the point-in-time nature, and edited for clarity, style and length. Mirage.News does not take institutional positions or sides, and all views, positions, and conclusions expressed herein are solely those of the author(s).View in full here.