WorksComputer Science
Multimodal Decoupling for Diversified Recommendation through Semantic and Structural Shaping
Abstract
Recommender systems often suffer from over-concentrated results when optimized for accuracy, limiting recommendation diversity. While diversity has become an important objective, existing methods still face fundamental limitations from both semantic and structural perspectives. On the one hand, multimodal recommender systems provide rich semantic signals, yet are often treated as auxiliary to ID embeddings, leading to ineffective semantic utilization for diversity. On the other hand, the accuracy–diversity trade-off persists during training, where accuracy gains often come at the cost of diversity. We show that this phenomenon is fundamentally governed by both the structural properties of learned representations and the dynamics of optimization. To address these challenges, we propose MOSS, a unified framework for multimodal decoupling through semantic and structural shaping. Specifically, we first introduce an MLLM-based Decoupled Feature Extraction module to disentangle multimodal content into informative representations. To enhance semantic utilization, we design a Category-aware Embedding Selection module that extracts compact, category-aware semantic features. To address structural limitations, we propose two complementary modules: Alternating Dual-Graph Propagation, which alleviates representation collapse by integrating collaborative and multimodal propagation, and Entropy-based Diversity Regularization, which mitigates optimization bias by promoting balanced category exposure. Extensive experiments on real-world datasets demonstrate that MOSS consistently achieves a superior accuracy–diversity trade-off over strong baselines.
This work is licensed under a Creative Commons Attribution 4.0 International License. MM ’26, Rio de Janeiro, Brazil. © 2026 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-2213-4/2026/11. https://doi.org/10.1145/3767308.3835957
CCS Concepts
• Information systems → Recommender systems.
Keywords
Multimodal Recommendation, Graph Neural Networks, Diversity
ACM Reference Format: Changran He, Jiaming Wei, Jianghong Ma, Tianjun Wei, Haijun Zhang, and Xiaofeng Zhang. 2026. Multimodal Decoupling for Diversified Recommendation through Semantic and Structural Shaping. In Proceedings of the 34th ACM International Conference on Multimedia (MM ’26), November 10–14, 2026, Rio de Janeiro, Brazil. ACM, New York, NY, USA, 10 pages. https://doi.org/10.1145/3767308.3835957
Introduction
In the era of information overload, recommender systems play a crucial role in helping users efficiently discover relevant content [7, 22, 29]. However, optimizing recommendation mainly for accuracy often leads to over-concentrated results, where similar items are repeatedly exposed and users’ broader interests are insufficiently explored [1, 11, 39]. To improve user experience, recommendation diversity, usually reflected by the coverage of different item attributes such as categories, has become an important objective, as it benefits novelty, long-tail exposure, and balanced discovery.
Despite its importance, existing methods still face fundamental limitations. In particular, these limitations can be understood from two complementary perspectives: semantic utilization and structural modeling.
C1: Semantic limitation in multimodal utilization for diversity-oriented recommendation. Multimodal recommender systems introduce rich semantic signals from item content, such as textual and visual information, enabling items to be characterized by their intrinsic properties [15, 16, 20, 29]. This provides a more expressive and semantically grounded representation of items.
However, most existing methods remain centered on item identity (ID) embeddings, treating multimodal information as an auxiliary signal through concatenation [8, 28], addition [6, 32, 43], or related fusion operations. Under this paradigm, multimodal content mainly enhances ID-driven representations, rather than being exploited as a primary source of semantic signals.
In principle, directly modeling items from multimodal content is particularly appealing for diversity-oriented recommendation. Unlike ID embeddings, which are largely shaped by historical user–item interactions and thus easily dominated by collaborative patterns such as popularity and exposure bias, multimodal information is grounded in the intrinsic characteristics of items themselves. It therefore provides richer semantic cues for distinguishing items from different perspectives, offering a more natural basis for diversified recommendation.
Nevertheless, directly exploiting multimodal features remains highly nontrivial. Recent studies attempt to learn item representations directly from multimodal features [35, 36, 42], yet prior works show that using pre-trained multimodal representations does not necessarily improve recommendation performance and may even degrade it [33, 42], as further analyzed in § 2.1. These observations indicate that the key challenge lies not in the availability of multimodal semantics, but in how to effectively organize and utilize them for diversity.
C2: Structural limitation in balancing accuracy and diversity during training. In collaborative recommendation, achieving high accuracy and high diversity simultaneously remains challenging. As illustrated in Figure 1, this trade-off is observed in most GNN-based models, such as LightGCN [10], where Recall@10 steadily improves during training, while Coverage@10 consistently declines. This indicates that accuracy gains are often achieved by concentrating recommendations on a narrower set of items, reflecting an increasing structural concentration in the learned representation space. As this pattern persistently emerges throughout training, it suggests that the accuracy–diversity trade-off is not merely an empirical phenomenon, but is closely related to the structural properties of learned representations and the optimization dynamics.

Figure 1. Training dynamics and the accuracy–diversity trade-off of LightGCN on Anime, with Recall@10 for accuracy and Coverage@10 for diversity. The left figure shows Recall@10 and Coverage@10 over the first 50 epochs, and the right figure shows the corresponding Coverage@10–Recall@10 trajectory, colored by epoch and labeled every five epochs.
(1) Dimensional Collapse as a Representation-Level Bias. From the representation perspective, we relate this trade-off to dimensional collapse [14] observed in GNN-based collaborative filtering [3, 18, 38], where item representations are confined to a narrow subspace. Such structural compression reduces the effective capacity of the representation space, making items more similar and less distinguishable. As a result, the model becomes less capable of retrieving semantically diverse items, leading to homogeneous ranking outputs and reduced structural diversity. A more detailed analysis is provided in § 2.2.
(2) Accuracy-Oriented Objective as an Optimization-Level Bias. From the optimization perspective, the conventional recommendation objectives, such as BPR [24], further reinforce this structural concentration. By prioritizing ranking accuracy without explicit diversity constraints, these objectives favor items that consistently contribute to the optimization signal, typically popular items and dominant categories. Consequently, the representation space becomes increasingly biased toward a limited subset of items, resulting in improved accuracy but diminished diversity.
To address the above limitations, we propose a unified framework, termed Multimodal Decoupling for Diversified Recommendation through Semantic and Structural Shaping (MOSS), which consists of four complementary modules. First, we propose the MLLM-based Decoupled Feature Extraction module, which leverages the reasoning capability of MLLMs to disentangle multimodal content and extract informative representations for the subsequent modules. To address the first challenge (C1), we propose the semantic shaping module Category-aware Embedding Selection module, which is introduced to tackle the underutilization of multimodal semantics in diversity-oriented recommendation. Instead of simply fusing modality information with ID embeddings or directly propagating raw multimodal features, it scores each embedding dimension from two complementary perspectives, namely global variance and category-level response balance, and retains a compact subset of informative and category-aware dimensions as the propagation input, thereby providing a stronger semantic basis for diversified recommendation. To address the second challenge (C2), we propose two structural shaping modules. (1) Alternating Dual-Graph Propagation module is designed to mitigate dimensional collapse, a representation-level bias that leads to diversity degradation in collaborative propagation. Specifically, it interleaves user–item collaborative propagation with multimodal semantic propagation over the item–item graph. This graph structural design alleviates dimensional collapse by enriching item representations with complementary multimodal signals, thereby preserving more expressive item relationships. Moreover, we theoretically show that this propagation scheme mitigates the tendency toward dimensional collapse. (2) Entropy-based Diversity Regularization is designed to mitigate the optimization-level bias induced by accuracy-oriented objectives. Specifically, it imposes an entropy regularization term on the category distribution of high-ranked items, thereby reshaping the ranking structure toward a more balanced category distribution, thereby promoting category-level diversity while maintaining recommendation accuracy.
In summary, our main contributions are listed as follows:
To the best of our knowledge, this work presents the first unified framework that integrates multimodal recommendation and diversity modeling from both semantic and structural perspectives.
From the semantic perspective, we identify the underutilization of multimodal semantics in diversity-oriented recommendation. To address this limitation, we propose a Category-aware Embedding Selection module, which extracts compact, category-aware, and semantically informative dimensions from decoupled multimodal representations, serving as a stable semantic anchor for downstream recommendation.
From the structural perspective, we analyze the accuracy–diversity trade-off as a consequence of both representation collapse and optimization bias, and propose a unified structural solution. Specifically, Alternating Dual-Graph Propagation alleviates dimensional collapse through collaborative and multimodal propagation, enriching the structural expressiveness of item relationships. Furthermore, Entropy-based Diversity Regularization mitigates optimization-induced bias by enforcing balanced category exposure, thereby improving diversity while preserving accuracy.
Extensive experiments on two real-world datasets demonstrate that the proposed method consistently achieves a better accuracy–diversity trade-off than baselines.
Analysis of Obstacles in Semantic and Structural Diversity Modeling
To understand the limitations of existing methods in diversity-oriented recommendation, we analyze the problem from two complementary perspectives: semantic utilization and structural representation. The former focuses on how multimodal semantics are extracted and organized, while the latter examines how representations are distributed and evolved during training.
Semantic Limitation: Ineffective Utilization of Multimodal Semantics
We begin by analyzing the role of multimodal semantics in recommendation. A natural approach is to directly initialize item representations with pre-trained multimodal features to enrich semantic information [33]. However, such direct utilization does not necessarily improve recommendation performance.
As shown in Table 1, replacing ID embeddings with visual or textual features under the same LightGCN backbone leads to a clear drop in Recall@10 (R@10), while Coverage@10 (C@10) does not show consistent improvement.
| Features | Norm. | Eff.Rank | ||
| ID embedding | 0.99 | 0.1924 | 0.4074 | |
| Visual embedding | 0.65 | 0.1710 | 0.4032 | |
| Textual embedding | 0.68 | 0.1698 | 0.4096 |
Table 1. Effect of different item initialization strategies on representation quality and recommendation performance on Anime dataset.
To further investigate this phenomenon, we analyze the normalized effective rank (Norm. Eff. Rank) [25]. Compared with ID-based initialization, multimodal initialization yields significantly lower effective rank, indicating that semantic information is unevenly distributed across embedding dimensions. This suggests that multimodal semantics are not effectively organized into discriminative representations, and may exhibit an early tendency toward representation collapse. To better understand this tendency, we further examine dimensional collapse in the following subsection.
As a result, although multimodal features contain rich semantic information, their effectiveness is not fully realized, limiting their contribution to diversity. These findings indicate that the key challenge lies not in the availability of multimodal semantics, but in how to organize them into compact and informative representations. This motivates the need for semantic shaping to extract stable and category-aware features for downstream recommendation.
Structural Limitation: Dimensional Collapse and Diversity Degradation
Building upon the above observations, we further examine how structural properties of representations affect diversity. Specifically, we analyze the distribution of item embeddings in the latent space [9, 17, 27, 37].
As illustrated in Figure 2, item embeddings exhibit a clear dimensional collapse phenomenon, where representations are highly concentrated within each category with limited intra-category variation. While some degree of clustering is expected, the observed distributions reveal an excessive concentration tendency. Such structural compression reduces the discriminability among items and restricts the model’s ability to retrieve diverse candidates.

Figure 2. Category-wise density visualization of item embeddings for four representative genres on Anime dataset. Embeddings are projected into 2D by t-SNE and normalized onto the unit circle, with filled contours represent density.
Consequently, recommendation results become increasingly homogeneous. For instance, users located near a dense region in the latent space are likely to receive recommendations from a narrow subset of items within the same category, while other categories remain underexplored.
From this perspective, the accuracy–diversity trade-off can be understood as a consequence of structural bias. Dimensional collapse reduces representation diversity, while accuracy-oriented objectives further reinforce concentration on dominant items and categories. Together, these effects lead to improved accuracy at the cost of diminished diversity.
This analysis highlights the necessity of structural shaping to alleviate dimensional collapse while preserving meaningful semantic relationships, thereby enabling a better balance between accuracy and diversity.
Methods
Preliminaries
Let and denote the sets of users and items, respectively. The interactions can be denoted by a matrix , where if user interacts with item , and 0 otherwise.
In addition, each item may be associated with one or more category labels. Let denote the category set. For each item , its category information is represented by a multi-hot category vector , where the -th entry equals 1 if item belongs to category , and 0 otherwise.
Overview
Figure 4 illustrates the overall architecture of MOSS, comprising of four core modules. For each item, we first employ an MLLM-based Decoupled Feature Extraction to disentangle multimodal information into three complementary descriptions, namely shared, visual-specific, and textual-specific representations.

Figure 4. An illustration of the proposed MOSS model. The MLLM-based Decoupled Feature Extraction module disentangles multimodal content into informative representations. The Category-aware Embedding Selection module selects compact, category-aware features to enhance semantic utilization. The Alternating Dual-Graph Propagation module alleviates dimensional collapse via collaborative and multimodal propagation. The Entropy-based Diversity Regularization module promotes balanced category exposure while preserving accuracy.
Among them, the shared embedding is further refined by the proposed Category-aware Embedding Selection, while the visual-specific and textual-specific embeddings are used to construct modality-specific item graphs.
Based on these representations, we design an Alternating Dual-Graph Propagation module with two modality-specific branches. In each branch, propagation alternates between the user–item interaction graph and the corresponding category-modulated item graph, thereby progressively integrating collaborative, multimodal, and category-aware neighborhood information.
Finally, we introduce an Entropy-based Diversity Regularization term to explicitly encourage category-level diversity in the optimization level.
MLLM-based Decoupled Feature Extraction
In multimodal recommendation, items are often accompanied by visual and textual content, which offers rich and complementary semantic information beyond interaction signals.
To better exploit such multimodal semantics, we employ a Multimodal Large Language Model (MLLM), implemented with Qwen2.5-VL-72B [2], to decompose the content of item into three complementary components: a shared description , a visual-specific description , and a textual-specific description .
These descriptions are then fed into the encoder, implemented by Sentence-BERT [23], to obtain the shared, visual-specific, and textual-specific item representations , and . We denote the corresponding embeddings for all items by , where denotes the original embedding dimension.
The shared embedding captures the common and dominant semantics of each item, and is used as the semantic anchor for graph propagation. By contrast, the modality-specific embeddings preserve view-specific semantic cues and are used to construct modality-specific item graphs, enabling the model to explore broader yet semantically related neighborhoods from different views.
Category-aware Embedding Selection
As illustrated in Figure 3, given the rich semantics encoded in multimodal item embeddings, we expect the initialized embeddings for graph propagation to preserve informative multimodal cues for recommendation accuracy while promoting cross-category semantic sharing rather than overemphasizing category-exclusive patterns.

Figure 3. Category-aware Embedding Selection.
As the shared embedding serves as the propagation input, this module is applied to the shared embedding matrix .
We first estimate the informativeness of each dimension by its global variance across all items:
where denotes the -th dimension of the embedding of item , and is the corresponding dataset-level mean. We then normalize the resulting variances into by min–max scaling.
Variance serves as a simple indicator of how actively a dimension is utilized in the embedding space. Dimensions with larger variance better capture inter-item differences and are thus more likely to preserve informative multimodal semantics, whereas low-variance dimensions tend to be weakly activated across items, reflecting underutilized or partially collapsed dimensions.
Beyond variance, to quantify whether a feature dimension is shared across categories or dominated by only a few of them, we compute the average response magnitude of dimension within each category:
where denote the set of items belonging to category , with reflects how strongly the -th dimension responds to category on average.
Based on , we construct a category-wise response distribution for dimension :
A more concentrated indicates stronger category dominance, whereas a flatter distribution suggests more balanced cross-category responses.
We use the normalized entropy to measure the category-level balance of dimension :
A larger indicates that the responses of this dimension are distributed more evenly across categories, and are more likely to capture shared semantics rather than category-specific bias.
Finally, we combine global informativeness and category response balance to score the -th dimension, with balancing informativeness and category response balance:
We then retain the top- dimensions with the highest scores. For each item , the selected shared embedding is defined as
where denotes the -th entry of the shared embedding for item . By stacking for all items, we obtain the selected shared embedding matrix , which is used as the initialized item-side input for subsequent graph propagation.
Alternating Dual-Graph Propagation
Starting from the selected shared embeddings , we perform graph propagation to jointly exploit collaborative structure and modality-specific semantic relations. Specifically, the selected shared embeddings serve as the item-side initialization for propagation, providing a stable semantic anchor shared across branches, while the modality-specific embeddings are used to identify semantically related neighbors from the perspective of each modality. In addition, category information is incorporated to further refine the graph structure, enabling the model to capture more informative and diverse item relations.
Let denote the trainable user embedding matrix, and let be the initial embedding of user . For each modality branch , the initial representations are defined as
For each modality , we construct a category-modulated item graph from corresponding modality-specific features. Given the modality-specific feature and the category vector of item , we compute the modality similarity and category similarity as
and define the fused similarity by
For each item , we first retain the top- items under to form a candidate pool , and then randomly sample neighbors at each propagation layer:
Here, and denote the candidate pool size and the number of sampled neighbors, and denotes the sampled neighbor set used in the current propagation layer. In this way, preserves the most relevant modality-aware neighbors, while random sampling enables different yet relevant local structures to be explored across layers and training iterations, thereby enhancing structural diversity and representation learning.
The corresponding weighted adjacency matrix is then defined as
We then normalize it as . For simplicity, let denote the normalized edge weight between items and in branch .
To incorporate collaborative signal and enrich structural diversity, we adopt an alternating propagation mechanism over the user–item graph and the modality-specific item graph. At layer , let and denote the representations of user and item in branch , respectively. and represent the set of items or users connected to user or item in the user–item graph. For even-numbered layers, collaborative propagation is performed on the normalized user–item graph:
For odd-numbered layers, the user representations remain unchanged, while the item representations are updated on the current modality-specific item graph:
Collaborative propagation captures user preference from interaction signal while item-graph propagation introduces related neighbors from modality-specific perspectives, leading to more informative and diversity-aware item representations.
After propagation layers, we obtain the final representations by mean pooling over all layers:
This layer-wise aggregation helps preserve information from different propagation depths, and thus mitigates the loss of useful signals caused by excessive smoothing. Thus, we obtain two propagated outputs, i.e., and . We then fuse the two modality branches by simple concatenation:
where denotes concatenation, with and represents the user and item representations produced by the propagation module.
Entropy-based Diversity Regularization
To further encourage recommendation diversity, we introduce an entropy-based regularizer to encourage category-level diversity.
For each user , given the predicted score for item , we normalize the category vector as , where denotes the normalized category distribution of item , and is the number of category labels of item . We then define a soft importance distribution:
where denotes the relative contribution of item to the recommendation distribution of user . For efficiency, this soft distribution is approximated over the top-20 scored items in practice.
Using these score-aware weights, we construct the user-specific category distribution as
Here, can be regarded as the expected category composition induced by the predicted ranking scores of user , and its -th entry is denoted by .
To encourage the recommendation results to cover a broader range of categories, we maximize the entropy of . Equivalently, we minimize its negative entropy:
where is the user mini-batch.
This regularizer assigns a larger penalty when the predicted recommendation distribution is overly concentrated on only a few categories, and a smaller penalty when the category distribution is more balanced. Therefore, it complements the ranking objective by explicitly promoting category-level diversity in the final recommendation outputs. The overall training objective is defined as
where is the pairwise ranking loss, is the set of learned user and item embeddings, controls the strength of entropy-based diversity regularization and is the regularization coefficient.
Theoretical Analysis of the Mitigation of Dimensional Collapse
To theoretically show how Alternating Dual-Graph Propagation may mitigate the issue of dimensional collapse. We analyze dimensional collapse from the perspective of spectral concentration after propagation. Let the two-layer propagated representation be
where is the initial representation matrix and denotes the corresponding two-layer propagation operator.
Dimensional collapse means that the propagated representation becomes increasingly dominated by only a few principal directions, while the remaining directions are severely compressed. To characterize this phenomenon, we consider the Gram matrix of the propagated representation:
A more concentrated spectrum of implies that most representation energy lies in only a few dominant directions, indicating a stronger dimensional collapse tendency.
Equation 22 shows that the spectral concentration of the propagated representation is primarily governed by the operator . Since is positive semidefinite, its eigenvalues satisfy
where denotes the -th singular value of . Therefore, the singular value spectrum of directly determines how propagation redistributes representation energy across different directions.
Following the above spectral characterization, we specifically consider two two-layer propagation operators for comparison:
where
Here, denotes the normalized user–item biadjacency matrix, denotes the normalized item–item propagation matrix, and is the identity matrix on the user side. The construction of is consistent with § 3.5. For theoretical and empirical simplicity, we adopt a static top-10 item–item graph, ignoring the dynamic update strategy used in the full model. corresponds to pure U–I propagation, while incorporates item–item propagation. As shown in Figure 5, the normalized singular value ratio curve of is consistently flatter than that of , with higher for most non-leading components. Therefore, the energy redistribution induced by is less concentrated on only a few principal directions, leading to a weaker concentration tendency in the propagated Gram matrix . This indicates that alternating UI–II propagation preserves substantially stronger non-leading components, whereas pure two-layer collaborative propagation over the user–item graph suppresses them much more aggressively. Consequently, from the operator perspective, introducing item–item propagation helps alleviate the dimensional collapse tendency inherent in collaborative propagation.

Figure 5. Comparison of the top-50 normalized singular value of two two-layer propagation operators on Anime. The curves show the normalized singular value ratios for and , sorted by singular value magnitude.
Experiments
Experimental Setup
5.1.1 Datasets. Experiments are conducted on two datasets, Anime 3 and Game 4, using a 5-core setting that retains users and items with a minimum of five interactions. Summary statistics are provided in Table 2.
| (a) Game Dataset | |
| # Players | 195,184 |
| # Games | 10,125 |
| # Interactions | 2,294,883 |
| # Categories | 22 |
| (b) Anime Dataset | |
| # Players | 66,870 |
| # Animes | 8,519 |
| # Interactions | 7,793,920 |
| # Categories | 45 |
Table 2. Statistics of datasets.
5.1.2 Baselines and Evaluation Metrics. We benchmark MOSS against two categories of baselines. For accuracy evaluation, we include classical graph collaborative filtering models, LightGCN [10] and SimGCL [31], as well as the multimodal recommendation model Freedom [41]. To assess diversity, we compare MOSS with several modality-agnostic diversity-enhanced methods, including DGCN [40], DGRec [30], DRGame [13], and DivGCL [5]. Top-K recommendation performance is evaluated using four standard metrics: Coverage and Entropy for diversity, Recall and Normalized Discounted Cumulative Gain for accuracy, and K is set to 10. To further quantify the balance between accuracy and diversity, we compute the geometric mean (GM) [34] of Recall@K and Coverage@K:
Overall Performance
Performance Evaluation
We compare the proposed model MOSS with several representative baselines. The results are reported in Table 3, where the best and second-best results are highlighted in bold and _underlined_, respectively. Based on these results, we draw the following observations: (1) Superior diversity. MOSS achieves the best diversity performance on both datasets, improving Coverage@10 / Entropy@10 by 13.2% / 12.8% on Anime and 30.3% / 19.2% on Game over the strongest diversity-oriented baseline. (2) Strong accuracy under accuracy-oriented settings. Admittedly, the diversity-oriented version of MOSS is not always the most accurate, since it explicitly favors broader category coverage. However, when we tuning the relevant hyperparameters toward more accuracy-oriented settings, can also achieve the best accuracy on Anime and Game. This suggests that Modules Alternating Dual–Graph Propagation and Category-aware Embedding Selection are not only beneficial for diversity, but also improve recommendation accuracy by better exploiting multimodal semantics and structural signals. (3) Best accuracy–diversity trade-off. As shown in Figure 6, MOSS achieves a more favorable accuracy–diversity balance than all baselines. Improving GM@10 by 5.7% and 21.1% on Anime and Game.
| Dataset | Metric | Accuracy-based Methods | Diversity-based Methods | Our Method | ||||||
| LightGCN | SimGCL | Freedom | DGCN | DGRec | DRGame | DivGCL | MOSS | |||
| Anime | Recall@10 | 0.1924 | 0.2100 | 0.1985 | 0.1106 | 0.2024 | 0.0569 | 0.2132 | 0.1860 | 0.2211 |
| NDCG@10 | 0.2124 | 0.2248 | 0.2014 | 0.1169 | 0.1868 | 0.0975 | 0.2329 | 0.1756 | 0.2374 | |
| Coverage@10 | 0.4074 | 0.4387 | 0.4345 | 0.4890 | 0.4428 | 0.4279 | 0.4197 | 0.5536 | 0.4417 | |
| Entropy@10 | 5.0054 | 5.7738 | 5.3682 | 6.1741 | 5.5891 | 5.6576 | 5.1921 | 6.9645 | 6.0342 | |
| GM@10 | 0.2800 | 0.3035 | 0.2937 | 0.2326 | 0.2994 | 0.1560 | 0.2991 | 0.3209 | 0.3125 | |
| Game | Recall@10 | 0.1080 | _0.1109_ | 0.1095 | 0.0803 | 0.1079 | 0.0193 | 0.1108 | 0.0907 | 0.1114 |
| NDCG@10 | 0.0604 | 0.0614 | 0.0615 | 0.0452 | 0.0602 | 0.0069 | _0.0617_ | 0.0391 | 0.0621 | |
| Coverage@10 | 0.3371 | 0.3431 | 0.3298 | 0.3636 | _0.3552_ | 0.4872 | 0.3544 | 0.6348 | 0.3580 | |
| Entropy@10 | 2.0726 | 2.2041 | 2.2450 | 2.3932 | 2.2190 | 3.3367 | 2.1703 | 3.9764 | 2.8757 | |
| GM@10 | 0.1908 | 0.1951 | 0.1900 | 0.1709 | 0.1958 | 0.0970 | 0.1981 | 0.2400 | _0.1997_ |
Table 3. Comparison of models on the Anime and Game datasets.

Figure 6. Comparison of the geometric mean (GM) between MOSS and baseline methods.
Ablation Study
To evaluate the contribution of each key component, we perform ablation studies on both datasets. As shown in Table 4, “w/o CAES”, “w/o ADGP”, and “w/o EBDR” denote the removal of Category-aware Embedding Selection, Alternating Dual–Graph Propagation, and Entropy-based Diversity Regularization, respectively. The results confirm that each component provides measurable gains. Specifically, EBDR primarily promotes diversity, while both ADGP and CAES contribute to improvements in both accuracy and diversity.
| Model | Anime | Game | ||||||||
| Recall@10 | NDCG@10 | Coverage@10 | Entropy@10 | GM@10 | Recall@10 | NDCG@10 | Coverage@10 | Entropy@10 | GM@10 | |
| EBDR | 0.2172 | 0.2306 | 0.4577 | 6.0258 | 0.3153 | 0.1092 | 0.0607 | 0.3642 | 2.9347 | 0.1994 |
| ADGP | 0.1730 | 0.1619 | 0.5498 | 6.5569 | 0.3084 | 0.0863 | 0.0384 | 0.6127 | 3.8642 | 0.2299 |
| CAES | 0.1722 | 0.1591 | 0.5187 | 6.5487 | 0.2989 | 0.0852 | 0.0372 | 0.5932 | 3.8533 | 0.2248 |
| MOSS | 0.1860 | 0.1756 | 0.5536 | 6.9645 | 0.3209 | 0.0907 | 0.0391 | 0.6348 | 3.9764 | 0.2400 |
Table 4. Ablation study on the Anime and Game datasets.
Conclusion
In this paper, we study diversified recommendation from both semantic and structural perspectives, showing that multimodal semantics are underutilized and that the accuracy–diversity trade-off is driven by representation collapse and optimization bias. We propose MOSS, a unified framework combining multimodal decoupling with semantic and structural shaping, including feature extraction, category-aware selection, and dual-graph propagation with entropy regularization. Experiments demonstrate that MOSS achieves a superior accuracy–diversity trade-off over strong baselines.
Acknowledgments
This work was partially supported by the National Natural Science Foundation of China under Project No. 62073272; the Guangdong Basic and Applied Basic Research Foundation under Grant No. 2024A1515011949 and 2026A1515011672; the Shenzhen Science and Technology Program under Grant No. GXWD20231130110308001, JCYJ20250604145617023, JCYJ20240813104843058, JCYJ20240813104837050, and SYSPG20241211173609009; the Guangdong Province Higher Education Research and Reform Project under Grant No. YueJiaoGaoHan (2024) No. 9 (1227); and the Guangdong Province General Colleges and Universities Innovation Team Project under No. 2022KCXTD038.
References
References
- [1]Qazi Mohammad Areeb, Mohammad Nadeem, Shahab Saquib Sohail, Raza Imam, Faiyaz Doctor, Yassine Himeur, Amir Hussain, and Abbas Amira. 2023. Filter bubbles in recommender systems: Fact or fallacy—A systematic review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 13, 6 (2023), e1512.arxiv.org/abs/2307.01221
- [2]Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, Humen Zhong, Yuanzhi Zhu, Mingkun Yang, Zhaohai Li, Jianqiang Wan, Pengfei Wang, Wei Ding, Zheren Fu, Yiheng Xu, Jibo Ye, Xi Zhang, Tianbao Xie, Zesen Cheng, Hang Zhang, Zhibo Yang, Haiyang Xu, and Junyang Lin. 2025. Qwen2.5-VL Technical Report. arXiv:2502.13923 [cs.CV] https://arxiv.org/abs/2502.13923
- [3]Huiyuan Chen, Vivian Lai, Hongye Jin, Zhimeng Jiang, Mahashweta Das, and Xia Hu. 2024. Towards mitigating dimensional collapse of representations in collaborative filtering. In Proceedings of the 17th ACM international conference on web search and data mining. 106–115.DOI
- [5]Wenwen Gong, Yangliao Geng, Dan Zhang, Yifan Zhu, Xiaolong Xu, Haolong Xiang, Amin Beheshti, Xuyun Zhang, and Lianyong Qiu. 2025. DiVGCL: a graph contrastive learning model for diverse recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39. 16853–16861.DOI
- [6]Zhiqiang Guo, Jianjun Li, Guohui Li, Chaoyang Wang, Si Shi, and Bin Ruan. 2024. Lgmrec: Local and global graph learning for multimodal recommendation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 38. 8454–8462.arxiv.org/abs/2312.16400
- [7]Emrul Hasan, Mizanur Rahman, Chen Ding, Jimmy Xiangji Huang, and Shaina Raza. 2025. Based recommender systems: a survey of approaches, challenges and future perspectives. Comput. Surveys 58, 1 (2025), 1–41.arxiv.org/abs/2405.05562
- [8]Ruining He and Julian McAuley. 2016. VBPR: visual Bayesian Personalized Ranking from implicit feedback. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (Phoenix, Arizona) (AAAI’16). AAAI Press, 144–150.arxiv.org/abs/1510.01784
- [9]Wei He, Guohao Sun, Jinhua Lu, and Xiu Susie Fang. 2023. Candidate-aware Graph Contrastive Learning for Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (Taipei, Taiwan) (SIGIR ’23). Association for Computing Machinery, New York, NY, USA, 1670–1679. doi:10.1145/3539618.3591647DOI
- [10]Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval. 639–648.
- [11]Mubashir Imran, Hongzhi Yin, Tong Chen, Quoc Viet Hung Nguyen, Alexander Zhou, and Kai Zheng. 2023. FeRRS: Resource-efficient federated recommender system for dynamic and diversified user preferences. ACM Transactions on Information Systems 41, 3 (2023), 1–30.arxiv.org/abs/2207.13897
- [13]Kenghua Liu, Jianhong Ma, Shanshan Feng, Haijun Zhang, and Zhao Zhang. 2024. DRGame: Diversified Recommendation for Multi-category Video Games with Balanced Implicit Preferences. In International Conference on Database Systems for Advanced Applications. Springer, 254–263.
- [14]Kanglin Liu, Guoping Qiu, Wenming Tang, and Fei Zhou. 2019. Spectral Regularization for Combating Mode Collapse in GANs. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 6381–6389. doi:10.1109/ICCV.2019.00648DOI
- [15]Qidong Liu, Jiaxi Hu, Yutian Xiao, Xiangyu Zhao, Jingtong Gao, Wanyu Wang, Qing Li, and Jiliang Tang. 2024. Multimodal recommender systems: A survey. Comput. Surveys 57, 2 (2024), 1–17.arxiv.org/abs/2302.03883
- [16]Alejo Lopez-Avila and Jinhua Du. 2025. A survey on large language models in multimodal recommender systems. arXiv preprint arXiv:2505.05977 (2025).
- [17]Jianghong Ma, Changran He, Dezhao Yang, Tianjun Wei, Haijun Zhang, and Xiaofeng Zhang. 2026. SGMT: Social Generating with Multiview-Guided Tuning in Recommender Systems. Proceedings of the AAAI Conference on Artificial Intelligence 40, 18 (Mar. 2026), 15501–15509.
- [18]Yao Ma, Xiaorui Liu, Tong Zhao, Yozen Liu, Jiliang Tang, and Neil Shah. 2021. A unified view on graph neural networks as graph signal denoising. In Proceedings of the 30th ACM international conference on information & knowledge management. 1202–1211.arxiv.org/abs/2010.01777
- [20]Claudio Pomo, Matteo Attimonelli, Danilo Danese, Fedelucio Narducci, and Tommaso Di Noia. 2025. Do recommender systems really leverage multimodal content? a comprehensive analysis on multimodal representations for recommendation. In Proceedings of the 34th ACM International Conference on Information and Knowledge Management. 2377–2387.arxiv.org/abs/2508.04571
- [22]Shaina Raza, Mizanur Rahman, Safiullah Kamawal, Armin Toroghi, Ananya Raval, Farshad Navah, and Amirmohammad Kazemeini. 2026. A comprehensive review of recommender systems: Transitioning from theory to practice. Computer Science Review 59 (2026), 100849.arxiv.org/abs/2407.13699
- [23]Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). 3982–3992.arxiv.org/abs/1908.10084
- [24]Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (Montreal, Quebec, Canada) (UAI ’09). AUAI Press, Arlington, Virginia, USA, 452–461.
- [25]Olivier Roy and Martin Vetterli. 2007. The effective rank: A measure of effective dimensionality. In 2007 15th European Signal Processing Conference. 606–610.DOI
- [27]Tongzhou Wang and Phillip Isola. 2020. Understanding contrastive representation learning through alignment and uniformity on the hypersphere. In Proceedings of the 37th International Conference on Machine Learning (ICML ’20). JMLR.org, Article 921, 11 pages.arxiv.org/abs/2005.10242
- [28]Yinwei Wei, Xiang Wang, Liqiang Nie, Xiangnan He, and Tat-Seng Chua. 2020. Graph-refined convolutional network for multimedia recommendation with implicit feedback. In Proceedings of the 28th ACM international conference on multimedia. 3541–3549.DOI
- [29]Jinfeng Xu, Zhey u Chen, Shuo Yang, Jinze Li, Wei Wang, Xiping Hu, Steven Hoi, and Edith Ngai. 2026. A survey on multimodal recommender systems: Recent advances and future directions. IEEE Transactions on Multimedia (2026).
- [30]Liangwei Yang, Shengjie Wang, Yunzhe Tao, Jiankai Sun, Xiaolong Liu, Philip S Yu, and Taiqing Wang. 2023. Dgrec: Graph neural network for recommendation with diversified embedding generation. In Proceedings of the sixteenth ACM international conference on web search and data mining. 661–669.DOI
- [31]Junliang Yu, Hongzhi Yin, Xin Xia, Tong Chen, Lichen Cui, and Quoc Viet Hung Nguyen. 2022. Are Graph Augmentations Necessary? Simple Graph Contrastive&Learning for Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (Madrid, Spain) (SIGIR ’22). Association for Computing Machinery, New York, NY, USA, 1294–1303. doi:10.1145/3477495.3531937
- [32]Penghang Yu, Zhiyi Tan, Guoming Lu, and Bing-Kun Bao. 2023. Multi-view graph convolutional network for multimedia recommendation. In Proceedings of the 31st ACM international conference on multimedia. 6576–6585.DOI
- [33]Zheng Yuan, Fajie Yuan, You Song, Youhua Li, Junchen Fu, Fei Yang, Yunzhu Pan, and Yongxin Ni. 2023. Where to Go Next for Recommender Systems? 1D-vs. Modality-based Recommender Models Revisited. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (Taipei, Taiwan) (SIGIR ’23). Association for Computing Machinery, New York, NY, USA, 2639–2649. doi:10.1145/3539618.3591932
- [34]Jianghao Zhang, Zhitong Zhao, Yunqi Jin, Jianghong Ma, Tianjun Wei, Haijun Zhang, and Xiaofeng Zhang. 2025. Dual-Phase Playtime-guided Recommendation: Interest Intensity Exploration and Multimodal Random Walks. In Proceedings of the 33rd ACM International Conference on Multimedia. 6232–6241.
- [35]Lingzi Zhang, Xin Zhou, Zhiwei Zeng, and Zhiqi Shen. 2024. Dual-view whitening on pre-trained text embeddings for sequential recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38. 9332–9340.DOI
- [36]Weizhi Zhang, Liangwei Yang, Wooseong Yang, Henry Peng Zou, Yuqing Liu, Ke Xu, Sourav Medya, and Philip S Yu. 2025. LImit: A free lunch from large language models for selective initialization of recommendation. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track. 2016–2024.
- [37]Yifei Zhao, Hao Zhu, yankai Chen, Zixing Song, Piotr Koniusz, and Irwin King. 2023. Mitigating the Popularity Bias of Graph Collaborative Filtering: A Dimensional Collapse Perspective. In Advances in Neural Information Processing Systems, A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (Eds.), Vol. 36. Curran Associates, Inc., 67533–67550. https://proceedings.neurips.cc/paper_files/paper/2023/file/d5753be6f71fbefaf47aa27ec41279c-Paper-Conference.pdf
- [38]Yifei Zhang, Hao Zhu, Menglin Yang, Jiaohong Liu, Rex Ying, Irwin King, and Piotr Koniusz. 2025. Understanding and mitigating hyperbolic dimensional collapse in graph contrastive learning. In Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V. 1. 1984–1995.
- [39]Yunying Zhao, Yu Wang, Yunchao Liu, Xueqi Cheng, Charu C Aggarwal, and Tyler Derr. 2025. Fairness and diversity in recommender systems: a survey. ACM Transactions on Intelligent Systems and Technology 16 (1), 2025, 1–28.arxiv.org/abs/2307.04644
- [40]Yu Zheng, Chen Gao, Liang Chen, Depeng Jin, and Yong Li. 2021. DCGN: Diversified recommendation with graph convolutional networks. In Proceedings of the web conference 2021. 401–412.DOI
- [41]Xin Zhou and Zhiqi Shen. 2023. A tale of two graphs: Freezing and denoising graph structures for multimodal recommendation. In Proceedings of the 31st ACM international conference on multimedia. 935–943.DOI
- [42]Xin Zhou, Xiaoxiong Zhang, Dusituo, and Zhiqi Shen. 2025. Learning Item Representations Directly from Multimodal Features for Effective Recommendation. arXiv:2505.04960 [cs.IR] https://arxiv.org/abs/2505.04960
- [43]Yan Zhou, Jie Guo, Hao Sun, Bin Song, and Fei Richard Yu. 2023. Attention-guided Multi-step Fusion: A Hierarchical Fusion Network for Multimodal Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (Taipei, Taiwan) (SIGIR ’23). Association for Computing Machinery, New York, NY, USA, 1816–1820. doi:10.1145/3539618.3591950DOI