Scientists revisit multi-dimensional classification from a dimension-wise perspective

Revisiting multi-dimensional classification from a dimension-wise perspective
Figure 1.The imbalance shift from one LD to another. The color map counts the number of instances over two LDs on Zappos. The numerical values annotated on the colored blocks in the figure represent values post logarithmic transformation. Many major class instances become minor ones when the LD changes. In other words, the major/minor class property of an instance is difficult to be kept across LDs. Credit: Frontiers of Computer Science (2024). DOI: 10.1007/s11704-023-3272-9. https://journal.hep.com.cn/fcs/EN/10.1007/s11704-023-3272-9

While the class imbalance issue has been extensively investigated within the multi-class paradigm, its study in the multi-dimensional classification (MDC) context has been limited due to the imbalance shift phenomenon. A sample’s classification as a minor or major class instance becomes ambiguous when it belongs to a minor class in one labeling dimension (LD) and a major class in another.

Previous MDC methodologies predominantly emphasized instance-wise criteria, neglecting prediction capabilities from a dimension aspect, i.e., the average classification performance across LDs.

Addressing these problems, a research team led by De-Chuan Zhan from LAMDA, Nanjing University has published their new study, titled “Revisiting Multidimensional Classification from a Dimension-wise Perspective,” in Frontiers of Computer Science.

The team asserts the significance of dimension-wise metrics in real-world MDC applications and introduce two such metrics. Furthermore, the team observes imbalanced class distributions within each LD and propose a novel Imbalance-Aware fusion Model (IMAM) for addressing the MDC problem.

Revisiting multi-dimensional classification from a dimension-wise perspective
Figure 2. An illustration of our proposed IMAM approach based on an MDC problem with two LDs. In the decomposition step (a), we construct imbalance-aware deep models for each LD. In the fusion step (b), we use the models in the former step as fixed teachers and fuse their knowledge into a compact student. Both embedding (green) and classifier (red) distillations help in matching knowledge between models. Subscript “T” denote the component of teacher. “CE” means the cross-entropy. Credit: Frontiers of Computer Science (2024). DOI: 10.1007/s11704-023-3272-9. https://journal.hep.com.cn/fcs/EN/10.1007/s11704-023-3272-9

In the research, IMAM first decomposes the task into multiple multi-class classification problems, creating imbalance-aware deep models for each LD separately. This straightforward method performs well across LDs without sacrificing performance in instance-wise criteria. Subsequently, IMAM employs LD-wise models as multiple teachers and transfer their knowledge across all LDs to a unified student model.

Extensive experiments are conducted on various MDC datasets. The results indicate that the proposed IMAM is superior to others in a big gap.

More information:
Yi Shi et al, Revisiting Multidimensional Classification from a Dimension-wise Perspective, Frontiers of Computer Science (2024). DOI: 10.1007/s11704-023-3272-9. journal.hep.com.cn/fcs/EN/10.1 … 07/s11704-023-3272-9

Provided by
Frontiers Journals

Citation:
Scientists revisit multi-dimensional classification from a dimension-wise perspective (2024, April 23)
retrieved 23 April 2024
from https://techxplore.com/news/2024-04-scientists-revisit-multi-dimensional-classification.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.
Please follow and like us:
error0
fb-share-icon20
Tweet 20
fb-share-icon20
Leave a Reply

Your email address will not be published. Required fields are marked *

Free Worldwide shipping

On all orders above $10

Easy 30 days returns

30 days money back guarantee

International Warranty

Offered in the country of usage

100% Secure Checkout

PayPal / MasterCard / Visa