WorksComputer Science
LSNR: Learned Sparse News Recommendations with Attentive User Modeling
Abstract
Current learned sparse approaches for recommender systems, such as STAR, represent a user by concatenating their interaction history into a single query string. For news, this creates two bottlenecks: concatenation collapses a user's distinct reading interests into one flat query, and, because news articles are long-form text, concatenating several news articles quickly overruns the context window of the language model used as backbone and forces quality-degrading truncation. To address both bottlenecks, we introduce learned sparse news recommendations (LSNR). LSNR encodes each article independently and constructs a sparse user vector by combining learned, attention-based weighting of the per-article sparse representations with a dense-projected expansion at the user level. Experiments on the MIND and EBNeRD datasets show that LSNR significantly outperforms STAR, with these gains holding even in short-history settings where truncation is not a factor. Compared to state-of-the-art dense recommenders, LSNR is competitive in standard settings and it outperforms them when the user history is short. An ablation of the user encoder confirms that learned attention-based aggregation outperforms simpler pooling alternatives. Beyond effectiveness, an additional advantage of LSNR is that it serves from an index an order of magnitude smaller than an uncompressed dense baseline.
CCS Concepts
• Information systems → Recommender systems; Evaluation of retrieval results.
This work is licensed under a Creative Commons Attribution 4.0 International License.
SIGIR-AP 2026, Singapore, Singapore
© 2026 Copyright held by the owner/author(s).
ACM ISBN 979-8-4007-3033-7/2026/12
https://doi.org/10.1145/3848000.3850180
Introduction
News consumption is increasingly shifting toward digital platforms [37]. News recommender systems [14, 31] help users navigate this landscape by providing personalized article suggestions. Modern approaches are dominated by deep learning methods that learn dense representations for users and news, achieving state-of-the-art performance on large-scale benchmarks [43, 47].
Learned sparse retrieval (LSR) has emerged as an alternative to dense retrieval. By using pre-trained language models to predict term importance and expand documents with latent terms, LSR produces sparse, lexical representations. Much like classical lexical models such as BM25, these representations can be indexed and retrieved with inverted-index machinery [3, 16, 35], with every dimension mapping directly to a vocabulary term. In ad hoc retrieval, LSR methods have demonstrated strong in-domain and out-of-domain effectiveness [16, 29].
Despite this success, the application of LSR to the news domain remains unexplored. The primary existing sparse recommender, STAR [34], represents a user by concatenating their interaction history into a single query string. For news recommendation, this formulation is insufficient due to two critical bottlenecks. First, concatenation collapses a user’s distinct reading interests into one undifferentiated query, leaving the model unable to weigh some articles as more relevant than others. Second, news articles are long-form text, so concatenating several of them quickly exceeds the context window of the underlying language model, forcing truncation that severely degrades recommendation quality. Both bottlenecks stem from the same root cause: STAR has no dedicated mechanism for representing a user from a collection of articles, and instead flattens the history into one document.
Our approach. We propose learned sparse news recommendations (LSNR), the first learned sparse recommender designed for the news domain. Our central contribution is a user encoder that operates over independently encoded articles. Rather than flattening a user’s history into a single string, LSNR encodes each article on its own and aggregates the resulting per-article sparse vectors with a learned, attention-based user encoder, fused with a dense-projected expansion at the user level. This design directly resolves both bottlenecks. It represents the user at the granularity of individual articles, learning which interactions matter rather than blending them together, and by encoding articles independently, it eliminates the context-window bottleneck. Because articles are encoded independently of the user, their sparse representations can be precomputed offline, leaving only user-side aggregation at inference time.
Our findings. On the MIND and EBNeRD benchmarks, LSNR significantly outperforms the leading sparse baseline STAR, improving NDCG@10 by 11% on MIND. These gains hold even in short-history settings where truncation is not a factor. This demonstrates the importance of per-article modeling. Against state-of-the-art dense recommenders, the picture depends on the history length. In the standard full-history setting, LSNR performs very close to the strongest dense recommenders on MIND, within roughly half a percent on every metric, and trails them by 2 to 3% on EBNeRD, while surpassing every dense baseline when the user history is short.
This short-history advantage is especially consequential for news, where a large fraction of served users are new, infrequent, or sparsely tracked, so the regime in which LSNR overtakes dense models is one that news platforms encounter routinely.
Beyond effectiveness, the sparse formulation gives LSNR a compact footprint: it serves from an index that is an order of magnitude smaller than an uncompressed dense baseline. Because every dimension of the user vector maps to a vocabulary term, the vector can also be inspected directly.
Our contributions. (i) We introduce LSNR, the first learned sparse news recommender. We diagnose why STAR, the existing learned sparse recommender, fails to transfer to the news domain, and resolve it by replacing history concatenation with independent article encoding and a user encoder that aggregates the per-article representations with learned attention. (ii) We show that LSNR significantly outperforms the STAR baseline on MIND and EBNeRD, maintaining this advantage even in short-history settings where truncation is absent. (iii) We show that LSNR is competitive with dense models in the full-history setting, on par with the strongest dense recommenders on MIND and trailing them modestly on EBNeRD, while surpassing every dense baseline in short-history scenarios, the regime most characteristic of news. (iv) An ablation of the user encoder shows that learned attention-based aggregation outperforms simpler pooling strategies, and that both pathways contribute to performance. (v) We release our code to facilitate reproducibility.2
Background
Two areas are particularly relevant to the work in this paper: news recommendation and learned sparse representations.
News recommendation
News recommendation poses unique challenges. Article content is short-lived, rapidly updated, and highly time-sensitive. This high turnover makes standard ID-based collaborative filtering approaches infeasible [14]. Sequential recommenders such as SAS-Rec [12] and its successors [7, 32] are effective in domains with stable catalogs, but are generally considered suboptimal for news due to the rapid obsolescence of articles [4]. Even hybrid methods that combine sequential and content-based features are rarely applied to the news domain [17]. Consequently, content-based neural news recommendation prevails. The standard architecture is a dual encoder that uses dense representations to model users and news [31, 42, 47]. Early approaches relied on sparse lexical features [4], while pretrained embeddings shifted the focus to dense text encoders [38, 41, 43, 47], sometimes enhanced with auxiliary signals [1, 11, 40]. Large language models have also been explored [10, 18, 21], but their inference latency currently makes them infeasible for the retrieval stage focused on in this work [47].
On the user side, dense dual encoders typically aggregate the history with attention, weighting interactions by their estimated importance. NRMS [41], for instance, builds the user representation with multi-head self-attention over clicked articles. LSNR adopts a similar attention-based aggregation, but instead, the user representation is constructed in a sparse lexical space rather than a dense one. This yields a compact user representation whose dimensions correspond to vocabulary terms, whose properties we discuss next.
Learned sparse representations
Learned sparse representations (LSR) are commonly used in ad hoc retrieval to bridge the gap between exact lexical matching and semantic dense retrieval [6, 8, 19, 20, 22, 26, 46, 48, 49]. State-of-the-art LSR methods, e.g., SPLADE [9, 16], use masked language modeling heads to predict term importance and to expand documents with relevant latent terms [30]. These methods allow for flexible efficiency and effectiveness trade-offs via techniques such as block-max pruning and quantized inverted indices [3, 5, 23, 27]. Because every dimension corresponds to a vocabulary term, these representations are often described as interpretable, though recent analyses show that SPLADE can route ranking signals through terms only loosely related to the input, or even through irrelevant tokens [24].
News recommendation differs fundamentally from ad hoc retrieval. The input is not a text string but a history of previously read articles, from which a user representation must be constructed. The pioneering learned sparse recommender, STAR [34], adapts LSR by concatenating the interaction history into a single text string. As discussed in § 1, this is ill-suited to news: it collapses a user’s distinct interests into one undifferentiated representation and quickly exceeds the language model’s context window, forcing quality-degrading truncation. We instead encode each article independently and aggregate the resulting sparse representations with a learned user encoder, representing the user at the granularity of individual articles rather than as a single concatenated string.
Methodology
We propose learned sparse news recommendations (LSNR). See Figure 1. The news encoder independently encodes each news article as a sparse lexical representation, based on SPLADE [9], and produces an auxiliary dense representation that guides aggregation in the user encoder. The latter constructs a sparse user vector via an attention-weighted aggregation of the per-article sparse representations and a dense-projected expansion at the user level. The news encoder is applied to history and candidate articles, so candidate representations can be precomputed once and indexed offline.

Figure 1. LSNR architecture. A shared news encoder maps each article to a sparse representation and, for history items, a dense representation . Additive attention over the dense history vectors produces weights . The sparse user vector is the sum of two pathways: a lexical pathway that aggregates per-article sparse vectors using attention weights, and a semantic pathway that applies a SPLADE projection to the attention-weighted dense user representation. A candidate article is scored using the sparse inner product .
News encoder
Given a news article consisting of tokens , we use a pre-trained language model (e.g., BERT) to obtain contextualized hidden states , where denotes the hidden state of token . Following common practice for adapting pre-trained backbones to news recommendation tasks [43], we pass these hidden states through an additional trainable transformer layer before projecting to the sparse vocabulary space. We project each token to the sparse vocabulary space using the SPLADE log-saturation activation. The importance of vocabulary term for token is computed as:
where is initialized from, and tied to, the input word embeddings of the backbone, following standard SPLADE practice [9]. The final sparse article representation is obtained via max-pooling over the sequence length: . Simultaneously, we extract a dense representation via mean-pooling over the transformer-layer outputs. The dense representation is used only for history articles, where it guides aggregation in the user encoder.
Candidate articles are represented by their sparse vector alone (§ 4.2). Table 1 illustrates a learned representation, showing how LSNR captures both exact keywords and semantic expansions (e.g., shop buying) while avoiding the semantic collapse that can be observed in sparse methods [28].
| Title | The Brands Queen Elizabeth, Prince Charles, and Prince Philip Swear By. Shop the notebooks, jackets, and more that the royals can’t live without. |
| Top tokens | royal, liberal, marine, conservative, imperial, victoria, fan, wedding, fans, diplomatic, buying, york, brand, elizabeth, setting |
Table 1. Title representation and LSNR representation of MIND article N88753. Bold tokens indicate exact lexical matches with the title text, while others are semantic expansions.
User encoder
The main contribution of LSNR is to produce a sparse user vector from a set of independently encoded articles. The encoder uses dense representations to determine which articles matter, and combines two pathways for content: a direct aggregation of the per-article sparse representations and a SPLADE projection from the aggregated dense vector.
Given a user history of articles with dense representations and sparse representations , we first contextualize the dense vectors using a single transformer layer [36]. This allows each article to be represented in the context of the others, yielding contextualized dense vectors . We omit positional encodings, as we find empirically that they do not improve performance (§ 6.6). This is consistent with prior findings that strict temporal order is a weak signal for news recommendation [44].
To determine the importance of each interaction, we apply an additive attention mechanism over the contextualized dense vectors. For each history item, we compute an attention score and normalize it across the history:
where , , and the attention-query vector are learned parameters.
Two-pathway aggregation. We construct the sparse user vector from two complementary pathways: a lexical pathway that aggregates the per-article sparse representations directly, and a semantic pathway that projects the aggregated dense representation into sparse space. The lexical pathway combines the per-article sparse vectors using the attention weights
producing a vector whose non-zero entries are inherited from the SPLADE expansions of individual history articles. The semantic pathway applies the SPLADE activation to a projection from the attention-weighted dense user representation
where is the same vocabulary projection used in the news encoder Eq. (1). The final user vector is the sum of the two pathways:
The two pathways play complementary roles. carries a direct lexical signal: each non-zero entry can be traced to a weighted combination of the SPLADE expansions of specific history articles. allows the model to activate terms that are not present in any single article’s expansion but that the aggregate dense interest profile points toward, providing user-level semantic expansion beyond what per-article expansion can capture. Both pathways depend on the same attention weights and the same vocabulary projection , so the hybrid user encoder introduces no additional learnable parameters beyond what a single-pathway variant would require. We ablate the contribution of each pathway, and of the aggregation function within , in § 6.6. Because every dimension of corresponds to a vocabulary term, the user vector can be read at the term level, as illustrated in Table 2 (though SPLADE weights need not be strictly semantic [24]).
| User | |||
| User A | idx 737 | • | 34 articles • 50% Finance |
| Clicks | America’s largest auto retailer sells customers defective used cars, report says. My husband and I saved $36,000 in 2 years to quit our jobs and travel the world. ‘SOS’ picked up on CCTV saves Aussie woman lost in bush. Clear your browser before booking a flight to get a better deal. | | | ||
| Profile | bank (0.16), rich (0.16), buying (0.15), architect (0.14), china (0.12), my (0.11), banking (0.10), jet (0.09), animal (0.07), me (0.07), forbes (0.07), demolished (0.07), picture (0.06), stock (0.06), cat (0.06), american (0.06), tour (0.06), cars (0.05), on (0.05), poker (0.05) | ||
| User B | idx 1252 | • | 37 articles • 57% Entertainment |
| Clicks | Chrissy Teigen Predicts The Office’s Jim and Pam Are Divorced Now. Millie Bobby Brown Reveals Her Style Inspo, Celebrity Crush & More. ‘Wheel of Fortune’ Guest Delivers Hilarious, Off the Rails Introduction. Daughter Arrested After Calling 911 When Mom Collapses at Concert. | ||
| Profile | stars (0.31), talent (0.23), artists (0.22), picture (0.14), mall (0.12), beauty (0.11), rich (0.11), city (0.11), web (0.11), styles (0.10), ball (0.08), studios (0.08), revolution (0.07), music (0.07), urban (0.06), designed (0.06), children (0.05), design (0.05), photographer (0.05), cool (0.05) | ||
| User C | idx 94 | • | 24 articles • 54% Food & Drink |
| Clicks | Lay’s newest flavor is grilled cheese and tomato soup. Burger King’s new ‘Ghost Whopper’ is here to haunt your Halloween order. Kelly Ripa jokes son Michael is experiencing ‘extreme poverty’ in Brooklyn. Popeyes quietly launched a new pumpkin pie. | ||
| Profile | librarian (0.24), kitchen (0.22), demolished (0.16), pupils (0.15), coffee (0.13), tour (0.11), chicken (0.11), removed (0.11), beach (0.10), sulfur (0.09), pizza (0.08), studios (0.08), better (0.08), long (0.07), pie (0.07), intervention (0.07), short (0.07), mall (0.06), me (0.06), rolled (0.06) |
Table 2. Sparse user vectors produced by LSNR’s user encoder on three MIND validation users. Each vector shows the top-20 active tokens with their activation weights. Bold tokens are exact lexical matches with the user’s clicked article texts. The remaining tokens are semantic expansions (e.g., talent, artists, music for an entertainment reader and kitchen, coffee, pizza for a food reader), illustrating how the learned representation captures interests beyond the literal click history. These tokens reflect the combined contributions of both pathways in the hybrid user encoder. These users were selected from validation for having clear single-category dominance.
Overall, the user encoder defines an aggregation that decomposes into three components: (i) cross-article contextualization of the dense vectors, (ii) learned importance weighting via additive attention, and (iii) a two-pathway sparse construction that combines direct sparse aggregation with dense-projected expansion. As parameter-free alternatives, we also experiment with temporal-decay weighted, mean, and max pooling over (replacing the pathway while keeping unchanged) in § 6.6.
Scoring
At retrieval time, a candidate article is scored against the user vector using the inner product of their sparse representations,
Because both vectors are sparse, this is computed efficiently over an inverted index. Furthermore, because candidate representations are user-independent, they are precomputed at indexing time (§ 6.4).
Regularization
To regularize the sparsity of LSNR representations, we apply an regularizer during training [16], with distinct coefficients for candidate news articles and for the final aggregated user vector , which combines both pathways via Eq. (5). We fix and , tuned on the validation set. LSNR news representations have an average of 22.8 (MIND) and 31.6 (EBNeRD) non-zero dimensions, and user vectors average 722 (MIND) and 563 (EBNeRD) non-zero dimensions before retrieval-time pruning. User vectors are naturally denser than news vectors, but still use less than 3% of the vocabulary space of the underlying BERT-based language models. We return to the implications of this sparsity for retrieval efficiency in § 6.4.
Experimental setup
We describe the datasets that we use for evaluation, the baselines that we compare against, optimization details, and our evaluation protocols.
Datasets
We evaluate LSNR on two public news recommendation benchmarks: the Microsoft News Dataset (MIND) [45] in English, and the Ekstra Bladet News Recommendation Dataset (EBNeRD) [15] in Danish. Following standard practice [13, 47], we use the “small” versions of both datasets. Since the official test sets lack public labels, we adopt the convention of using the official validation split for testing and sample the last 10% of the training split for hyperparameter tuning [47]. Table 3 summarizes the statistics. The two datasets are complementary: MIND consists of short articles (title and abstract) with moderate user histories, whereas EBNeRD features substantially longer articles (including full body text) and longer histories.
| Dataset | Split | #Users | #Art. | #Int. | ||
| MIND | Train | 48,052 | 49,476 | 212,481 | 39.2 | |
| Val | 11,995 | 51,282 | 15,697 | 33.0 | 45.0 | |
| Test | 50,000 | 65,238 | 73,152 | 32.3 | ||
| EBNeRD | Train | 14,834 | 7,317 | 210,402 | 47.2 | |
| Val | 6,637 | 7,527 | 23,289 | 47.4 | 465.9 | |
| Test | 15,342 | 9,985 | 244,647 | 46.5 |
Table 3. MIND and EBNeRD dataset statistics. #Users, #Art., and #Int. give the number of users, articles, and interactions respectively. is average user history length and is average words per article.
Baseline methods
To validate the effectiveness of LSNR, we compare it against both sparse and dense content-based recommender systems. We first test our hypothesis that learned, attention-based aggregation is superior to concatenation by comparing against BM25 and STAR [34], the state-of-the-art learned sparse recommender. We adapt STAR for the news domain by concatenating the most recent interactions, as we found recency-based selection more effective than the original IDF-based selection. We concatenate historical interactions into STAR’s input until the 512-token context window is filled. For the user-encoder ablation, we additionally implement several aggregation variants and pathway configurations in place of our default hybrid user encoder, described in § 6.6.
We benchmark LSNR against three leading dense architectures, NRMS [41], NAML [39], and LSTUR [2], each implemented with a pre-trained language model backbone to align with modern standards [43, 47]. Recent work has shown that BERT-based variants of these models perform on par with much larger LLM-based encoders [47], justifying our use of BERT-scale backbones. LSNR, STAR, and NRMS use only article texts. NAML and LSTUR additionally include article categories and user IDs. We exclude generative LLMs due to their prohibitive inference costs at the retrieval stage [47].
Optimization details
We initialize English models with the bert-base-uncased checkpoint and Danish models with the Maltehb/danish-bert-botxo checkpoint. For STAR on MIND, we use the naver/splade-cocondenser-ensembledistil checkpoint to match the original implementation. As no Danish SPLADE checkpoint is available, we train STAR on EBNeRD from the same danish-bert-botxo backbone as LSNR, so both sparse models start from identical initialization. On MIND, this initialization asymmetry favors STAR, which begins from a retrieval-pretrained checkpoint while LSNR begins from vanilla BERT. The additional transformer layer in the news encoder and the contextualization layer in the user encoder each use a single layer with 16 attention heads. Following [47] in freezing the lower backbone layers to balance performance and efficiency, we freeze the first 9 of the 12 backbone layers across all methods. We optimize using AdamW on a single NVIDIA H100 GPU, grid-searching the learning rate over with early stopping on validation NDCG@10.
We tune the negative sampling strategy per model to give each its strongest configuration. For dense models, we sample 4 negatives from the candidate pool. Increasing this yielded no improvement, consistent with prior work [43]. For sparse models (LSNR and STAR), we sample 16 negatives, as we found learned sparse models benefit from a larger negative pool.
Evaluation protocols
We structure our evaluation in five stages, each targeting a distinct question. We report NDCG@10, NDCG@5, and MRR, and assess statistical significance using a two-tailed paired -test over the per-user metric distributions, where * denotes a significant improvement over the second-best method (). Following the standard MIND and EBNeRD protocol, all NDCG and MRR metrics throughout the paper are computed by ranking the candidate articles recorded in each impression log, treating clicked articles as positives and co-displayed non-clicked articles as negatives, and averaging over impressions. The full-catalog retrieval used for the efficiency measurements in § 6.4 applies only to index footprint and latency, not to accuracy.
Sparse baselines. We first assess recommendation performance on the full test set against the sparse baselines BM25 and STAR. This stage tests our core hypothesis that learned aggregation over independently encoded articles outperforms STAR’s concatenation.
Short-history robustness. A natural concern is that LSNR may outperform STAR only because STAR is forced to truncate long histories. To isolate the effect of our aggregation mechanism from the avoidance of truncation, we simulate short-history users by training on the complete training set but truncating test-set histories to the most recent interactions, . At small , and especially at , STAR processes the exact same input as LSNR with no truncation, so any remaining gap is attributable to how each model represents the user rather than to lost input.
Dense baselines. We benchmark LSNR against the state-of-the-art dense recommenders NRMS, NAML, and LSTUR, on both the full dataset and the short-history setting, to assess whether learned sparse representations can match dense embeddings.
Efficiency. We report the index footprint of LSNR against the dense NRMS baseline. Because LSNR user vectors are sparse, we also examine the effect of retrieval-time pruning: we sweep a threshold that retains only the top- highest-scoring terms of each user vector, and trace recommendation accuracy against user-vector sparsity (non-zero entries, NNZ). We report user-vector and document sparsity and on-disk index size, comparing LSNR against the uncompressed dense NRMS baseline on identical hardware, and report end-to-end retrieval latency.
User aggregation. Finally, to justify the design choices in the user encoder, we run two complementary ablations. The first isolates the contribution of each pathway in the hybrid construction (Eq. (5)), training variants that disable , disable , or include both. The second varies the aggregation function within , comparing our additive attention against four alternatives: attention with positional encodings, mean pooling, max pooling, and a recency-weighted temporal decay. A comparison against the parameter-free pooling variants isolates the contribution of learned weighting, while the positional-encoding and temporal-decay variants test whether interaction order carries signal beyond article content. In all variants except the pathway ablation, the pathway is held constant. We report NDCG@10 in both the full-history and short-history () settings.
Results
We evaluate the performance of LSNR across several key dimensions: effectiveness against sparse and dense baselines, retrieval efficiency, and the contribution of its individual components. We show that LSNR consistently outperforms sparse models and remains highly competitive with state-of-the-art dense recommenders while offering a more compact index.
Benchmarking LSNR against sparse baselines
We first evaluate LSNR against sparse baselines to test our core hypothesis that learned aggregation over independently encoded articles is superior to naive history concatenation. Table 4 reports the performance on the full MIND and EBNeRD test sets.
| MIND | EBNeRD | |||||
| Method | N@10 | N@5 | MRR | N@10 | N@5 | MRR |
| BM25 | 0.3142 | 0.2541 | 0.2480 | 0.4639 | 0.3868 | 0.3503 |
| STAR | 0.3815 | 0.3191 | 0.2973 | 0.4704 | 0.3925 | 0.3459 |
| LSNR (Ours) | 0.4234* | 0.3620* | 0.3310* | 0.5200* | 0.4547* | 0.4027* |
Table 4. Performance of LSNR compared to BM25 and learned sparse baseline STAR across the full MIND and EBNeRD benchmarks. Bold denotes the highest score, * denotes a significant improvement over the second-best method ().
Across both datasets, LSNR significantly outperforms both BM25 and the state-of-the-art sparse baseline STAR. On MIND, LSNR achieves a gain of 11% over STAR in NDCG@10, and over 10% on EBNeRD. The contrast is sharpest on EBNeRD, where STAR’s advantage over the unsupervised BM25 baseline nearly vanishes:
STAR edges BM25 by less than a point on NDCG@10 (0.4704 vs. 0.4639) and trails it on MRR (0.3459 vs. 0.3503). On these long-article histories (Table 3), concatenation improves STAR almost nothing over a purely lexical baseline, consistent with the context-window bottlenecks it suffers. These results empirically demonstrate that replacing concatenation with independent article encoding and learned, two-pathway aggregation allows LSNR to better capture distinct user interests at the per-article granularity.
LSNR in short-history settings
A potential counter-argument against the main finding from Subsection 5.1 is that LSNR outperforms STAR only because STAR is forced to truncate long histories. To control for this, we evaluate both models in a simulated short-history setting (), where STAR suffers no truncation and processes the exact same input as LSNR.
As reported in Table 5, LSNR consistently outperforms STAR even when history is limited to a single interaction, by 3.6% in NDCG@10 on MIND and by over 7% on EBNeRD, with both gains statistically significant. We attribute this to a difference in training signal. STAR optimizes the representation of a single concatenated string per user, whereas LSNR optimizes each article’s representation against per-user-vector gradients, producing per-article representations that generalize better when interaction data is scarce. Figure 2 visualizes performance as history length grows from 1 to 5. LSNR improves rapidly, whereas STAR yields diminishing returns. This divergence confirms that concatenating text is an ineffective mechanism for aggregating user interactions in news recommendation, compared to the learned attention-based weighting employed by LSNR.
| MIND () | EBNeRD () | |||||
| Method | N@10 | N@5 | MRR | N@10 | N@5 | MRR |
| BM25 | 0.3109 | 0.2505 | 0.2445 | 0.4359 | 0.3519 | 0.3203 |
| STAR | 0.3500 | 0.2880 | 0.2742 | 0.4656 | 0.3866 | 0.3408 |
| LSNR (Ours) | 0.3626* | 0.3015* | 0.2819* | 0.5022* | 0.4317* | 0.3824* |
Table 5. Short-history () performance of LSNR compared to BM25 and learned sparse baseline STAR. Bold denotes the highest score, * denotes a significant improvement over the second-best method ().
Figure 2. NDCG@10 of LSNR, STAR, and the dense baselines as user history length increases from 1 to 5 on MIND (left) and EBNeRD (right).
Comparing LSNR with dense baselines
Next, we benchmark LSNR against state-of-the-art dense recommenders (pre-trained language model variants of NRMS, NAML and LSTUR) to assess whether learned sparse representations can match dense embeddings. Table 6 presents the performance on both full and short-history settings.
| Method | Full-history users | Short-history users () | ||||||||||
| MIND | EBNeRD | MIND | EBNeRD | |||||||||
| N@10 | N@5 | MRR | N@10 | N@5 | MRR | N@10 | N@5 | MRR | N@10 | N@5 | MRR | |
| NRMS | 0.4256 | 0.3641 | 0.3322 | 0.5290 | 0.4629 | 0.4119 | 0.3536 | 0.2927 | 0.2748 | 0.4880 | 0.4127 | 0.3679 |
| NAML | 0.4247 | 0.3633 | 0.3320 | 0.5312 | 0.4649 | 0.4134 | 0.3301 | 0.2908 | 0.2723 | 0.4889 | 0.4134 | 0.3690 |
| LSTUR | 0.3794 | 0.3183 | 0.2943 | 0.5114 | 0.4407 | 0.3909 | 0.2806 | 0.2205 | 0.2168 | 0.4496 | 0.3655 | 0.3305 |
| LSNR | 0.4234 | 0.3620 | 0.3310 | 0.5200 | 0.4547 | 0.4027 | 0.3626{sup}*` | 0.3015{sup}*` | 0.2819{sup}*` | 0.5022{sup}*` | 0.4317{sup}*` | 0.3824{sup}*` |
Table 6. Comparison of LSNR against state-of-the-art dense news recommenders. Bold denotes the highest score, ∗ denotes a significant improvement over the second-best method ().
In the standard full-history setting, LSNR is a competitive alternative to dense baselines. On MIND, LSNR performs on par with the strongest dense models, sitting within half a percent of both NRMS and NAML on every metric while clearly outperforming LSTUR. On EBNeRD the picture is slightly different: LSNR trails the strongest dense models, NRMS and NAML by 2 to 3% on NDCG@10 while remaining well ahead of LSTUR. These experiments show that LSNR captures semantic matching close to that of dense models.
Importantly, LSNR excels for users with short histories. As shown in the short-history columns of Table 6, LSNR significantly outperforms all dense baselines when history is scarce (). On MIND, LSNR surpasses the strongest dense baseline, NRMS, by 2.5%. On EBNeRD, the gap is larger, with LSNR exceeding the strongest dense baseline, NAML, by 2.7%. This trend is confirmed in Figure 2: LSNR leads the dense methods at small , with all methods converging around . We attribute this to the stability of sparse lexical signals. While dense vectors can suffer from semantic drift when interaction data is limited [33], LSNR’s explicit term matching enables precise retrieval even from a single interaction.
These findings establish LSNR as a reliable alternative to dense models: competitive in standard settings and significantly superior in short-history scenarios.
Efficiency analysis
We characterize LSNR’s index footprint and retrieval cost, and analyze the effect of user-vector pruning on accuracy. The footprint and latency measurements use full-catalog retrieval, scoring each user vector against the entire article catalog through the index to reflect deployment-time cost. Accuracy, including the pruning curves in Figure 3, remains the impression-based NDCG@10 used throughout the paper. Because the inner product is dominated by the user vector’s non-zero entries, we sweep a pruning threshold that restricts each user vector to its top-

Figure 3. Accuracy-sparsity trade-off under user-vector pruning. Each curve sweeps the pruning threshold ; each point is one value of , with smaller (sparser user vectors) toward the left. We plot NDCG@10 against average user-vector NNZ for MIND (left) and EBNeRD (right). NDCG@10 here is the impression-based metric, recomputed as the user vector is pruned to its top- terms.
highest-scoring terms. Figure 3 plots NDCG@10 against the user-vector number of non-zeros (NNZ). All sparse measurements use a Seismic index [3] on a single CPU thread. We index dense NRMS embeddings with HNSW [25] on the same hardware.
Pruning the user vector
As Figure 3 shows, LSNR exhibits a clear accuracy-sparsity trade-off on MIND. Tightening the pruning threshold reduces accuracy. However, even under the most aggressive pruning, LSNR substantially outperforms STAR’s best result. STAR’s accuracy is flat across thresholds, because its user vectors on MIND are already extremely sparse (Table 7, 15.6 NNZ on average).
| Model | MIND NNZ | MIND NNZ | MIND Size | MIND Lat. | EBNeRD NNZ | EBNeRD NNZ | EBNeRD Size | EBNeRD Lat. |
| NRMS | 768.0 | 768.0 | 208.06 | 1.46 | 768.0 | 768.0 | 31.84 | 1.16 |
| STAR | 17.6 | 15.6 | 8.78 | 7.25 | 440.4 | 30.0 | 33.55 | 26.78 |
| LSNR | 22.8 | 30.0 | 11.33 | 3.09 | 31.6 | 30.0 | 2.41 | 2.61 |
Table 7. Indexing and retrieval efficiency on the MIND and EBNeRD validation sets. NNZ/NNZ are average non-zero entries per document and user vector (for NRMS, the dense embedding dimension). User vectors are reported at , our default pruning threshold. Size is on-disk index size in MB, and Lat. is mean end-to-end latency in ms (user encoding plus index retrieval), reported for characterization rather than as a comparative advantage.
On EBNeRD, the pattern reverses: tighter pruning improves LSNR’s accuracy. This divergence stems from dataset characteristics. EBNeRD features longer histories and substantially longer articles, so aggregating sparse representations across the entire history accumulates a broader vocabulary. Here, aggressive pruning may act as a denoising filter that retains only the user’s core interests. STAR’s user vectors on EBNeRD are denser (30.0 NNZ, Table 7), yet its accuracy still does not benefit from pruning. This suggests that concatenation produces a flat, undifferentiated user vector in which all terms contribute roughly equally, so trimming any of them is as likely to hurt as to help.
Index footprint
The two sparse methods, LSNR and STAR, reach very different document-sparsity operating points, and the contrast is dataset-dependent. On MIND, both produce highly sparse documents (LSNR 22.8 vs. STAR 17.6 NNZ, Table 7), so their index sizes are comparable (11.33 vs. 8.78 MB). On EBNeRD, however, STAR’s documents are roughly 14× denser than LSNR’s (440.4 vs. 31.6 NNZ), despite both methods using the same SPLADE document encoder and the same FLOPS regularization . We attribute this asymmetry to a difference in the training signal rather than the encoder or regularizer. STAR’s document encoder is optimized against a single concatenated user vector covering the entire history, which itself spans a broad vocabulary, pushing the document encoder toward dense, broad representations. Instead, LSNR optimizes each article representation against per-article gradients during user-vector aggregation, encouraging more focused encodings.
LSNR’s approach leads to a compact index that is an order of magnitude smaller than the uncompressed NRMS dense index on both datasets (11.33 vs. 208.06 MB on MIND, 2.41 vs. 31.84 MB on EBNeRD). Relative to STAR, LSNR’s index is comparable on MIND but roughly 14× smaller on EBNeRD (2.41 vs. 33.55 MB), where STAR’s dense documents inflate its index. We note that the dense baseline is uncompressed. Quantization would reduce its footprint, trading index size against retrieval accuracy; a fully quantized comparison is left to future work.
Retrieval cost
Table 7 reports end-to-end latency (user encoding plus index retrieval) at our default pruning threshold . Decomposing this on MIND, LSNR’s user-encoding step takes 0.97 ms, roughly 7× faster than STAR’s 6.86 ms and on par with the dense NRMS encoder (0.89 ms), because LSNR aggregates precomputed article representations rather than encoding the concatenated history at retrieval time. This also makes LSNR substantially faster end-to-end than STAR (2.3× on MIND, 10× on EBNeRD). Relative to the dense HNSW baseline, LSNR’s inverted-index retrieval is slower in absolute terms, reflecting the state of dense ANN infrastructure. LSNR’s end-to-end latency remains within a few milliseconds per query at this corpus scale.
Pathway ablation
The hybrid user encoder constructs from two pathways: a lexical pathway that aggregates per-article sparse vectors with attention weights, and a semantic pathway that projects the attention-weighted dense user representation into sparse space (§ 4.1). We test whether each pathway contributes to performance by training variants that activate one pathway in isolation and comparing them against the full hybrid.
Table 8 reports NDCG@10 for the three configurations on MIND and EBNeRD, in full-history and short-history () settings. The full hybrid outperforms both single-pathway variants in all four cells. The two pathways perform almost identically when used in isolation, differing by at most 0.014 NDCG@10 across the four settings, indicating that neither pathway is strictly more informative than the other. Yet combining them yields substantial gains over either alone: 11.9% over -only and 11.3% over -only on MIND full-history, 9.8% and 6.8% on EBNeRD full-history. The pathways thus encode complementary signals rather than redundant information.
| Configuration | MIND Full | MIND Short | EBNeRD Full | EBNeRD Short |
| only | 0.3784 | 0.3565 | 0.4734 | 0.4717 |
| only | 0.3805 | 0.3578 | 0.4868 | 0.4848 |
| Both (hybrid) | 0.4234 | 0.3626 | 0.5200 | 0.5022 |
Table 8. Pathway ablation. We train variants of LSNR with only the lexical pathway , only the semantic pathway , or both (hybrid). Performance is NDCG@10 for full-history and short-history () scenarios. Bold denotes the best configuration per column.
The hybrid’s advantage is most pronounced in full-history settings, where there is more interaction data for the two pathways to capture distinct patterns from. At , where the user is represented by a single article, the gap narrows on MIND (1.7% and 1.3% over the single-pathway variants) but remains substantial on EBNeRD (6.5% and 3.6%). This is consistent with the dataset characteristics: EBNeRD’s longer articles provide more text per interaction for both pathways to draw on, so even a single article supports meaningful per-article aggregation and dense-projected expansion.
This result shows the advantage of LSNR’s two-pathway design. provides direct lexical signal from individual articles, while supplies user-level semantic expansion. The two are roughly equivalent in standalone capacity but encode different aspects of the user’s interests, and combining them captures both.
User aggregation methods
Having established that both user encoding pathways contribute, we next ablate the aggregation function within the lexical pathway , keeping the semantic pathway unchanged. We compare our additive attention against four alternatives: attention with positional encodings, mean pooling, temporal decay, and max pooling. We report NDCG@10 in full- and short-history () settings.
The results in Table 9 show that our additive attention is the strongest aggregation across both benchmarks, justifying its use in the final architecture. Adding positional encodings degrades performance on both datasets. That order information actively hurts supports our decision to omit it, and it matches prior findings that strict temporal order is a weak signal for news recommendation [44]. The parameter-free pooling strategies fall further behind, and do so unevenly across datasets: max pooling is the strongest alternative on MIND but the weakest on EBNeRD, while mean pooling and temporal decay are weakest on MIND and slightly stronger on EBNeRD. No single parameter-free strategy is robust across both the short title-and-abstract articles of MIND and the long-form articles of EBNeRD, whereas learned attention is consistently strongest in every setting, which is what motivates its use in LSNR.
| Method | MIND | EBNeRD | ||
| Full | Short | Full | Short | |
| Attention | 0.4234 | 0.3626 | 0.5200 | 0.5022 |
| Attention + PE | 0.4086 | 0.3582 | 0.5120 | 0.4917 |
| Average pooling | 0.4020 | 0.3513 | 0.5082 | 0.4895 |
| Temporal decay | 0.3990 | 0.3516 | 0.5048 | 0.4920 |
| Max pooling | 0.4138 | 0.3575 | 0.4996 | 0.4843 |
Table 9. Aggregation-function ablation on MIND and EBNeRD, holding the semantic pathway constant. Performance is NDCG@10 for both full-history and short-history () scenarios. Bold denotes the best method per column.
Conclusion
We have introduced learned sparse news recommendations (LSNR), a framework that adapts learned sparse retrieval to the long-form text and user histories of the news domain. By encoding each article independently and aggregating them via a learned, attention-based user encoder, LSNR eliminates the context-window bottleneck and the interest collapse that concatenation induces in prior learned sparse methods such as STAR.
Our evaluation on the MIND and EBNeRD benchmarks yields three findings. First, LSNR significantly outperforms both BM25 and STAR by representing users at the granularity of individual articles. Second, this advantage persists in short-history settings () where STAR processes the same input without truncation, showing that LSNR’s gains stem from improved per-article learning rather than from avoiding truncation. Third, LSNR performs competitively with state-of-the-art dense recommenders (NRMS, NAML) in standard settings and significantly outperforms them when user history is short, while serving from an index an order of magnitude smaller than the uncompressed dense baseline on both datasets.
We identify several limitations of our work. First, LSNR’s advantage over dense models is concentrated in the short-history setting: in the full-history setting, it matches the strongest dense recommenders on MIND but trails them by 2 to 3% on EBNeRD. Second, on the recall-latency frontier, a well-tuned dense HNSW index matches or exceeds LSNR’s retrieval accuracy at lower query latency, so LSNR’s efficiency benefit is its compact index rather than retrieval speed. Third, our evidence comes from two benchmarks in two languages, and the datasets are the “small” versions. Generalization to larger corpora and other domains remains for future work. Fourth, on MIND, the two sparse models start from different checkpoints, an asymmetry that favors STAR and that we therefore read as making LSNR’s gain conservative, though it leaves the comparison short of fully controlled.
Beyond textual signals, auxiliary features such as article categories or user demographics could further sharpen the sparse user vector. Because each dimension of the user vector maps to a vocabulary term, the representation could in principle support term-level inspection or editing of user interests. We leave a direct evaluation of such controls to future work.
Resources
At https://github.com/davidyovs/learned-sparse-news-recs we share the following resources, under an MIT license, to facilitate reproducibility:
Our proposed model, LSNR, with its attentive user and news encoders, and all baselines: STAR and the dense recommenders NRMS, NAML, and LSTUR.
Preprocessing and pre-tokenization pipelines for the MIND and EBNeRD datasets.
Training and evaluation scripts reporting performance metrics and sparsity, plus an efficiency benchmark for index size and retrieval latency.
A central configuration file with all hyperparameters, fixed seeds, and chronological splits, and documentation to reproduce the reported results.
Acknowledgments
This research was (partially) supported by the Dutch Research Council (NWO), under project numbers 024.004.022, NWA.1389.20.183, KICH3.LTP.20.006, and VI.Vidi.223.166, and the European Union under grant agreement No. 101201510 (UNITE). Views and opinions expressed are those of the author(s) only and do not necessarily reflect those of their respective employers, funders and/or granting authorities.
References
References
- [1]Abdullah, Rasheed Abubakar Rasheed, Mohd Hairul Nizam Md. Nasir, and Mujibur Rahman. 2021. Eliciting Auxiliary Information for Cold Start User Recommendation: A Survey. Applied Sciences 11, 20, Article 9608 (2021).
- [2]Mingxiao An, Fangzhao Wu, Chuhan Wu, Kun Zhang, Zheng Liu, and Xing Xie. 2019. Neural News Recommendation with Long- and Short-term User Representations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Anna Korhonen, David Traum, and Luís Márquez (Eds.). Association for Computational Linguistics, Stroudsburg, PA, USA, 336–345.DOI
- [3]Sebastian Bruch, Franco Maria Nardini, Cosimo Rulli, and Rossano Venturini. 2024. Efficient Inverted Indexes for Approximate Retrieval over Learned Sparse Representations. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM.DOI
- [4]Michel Capelle, Flavius Fransincar, Marnix Moerland, and Frederik Hogenboom. 2012. Semantics-based News Recommendation. In Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics. ACM, New York, NY, USA.DOI
- [5]Parker Carlson, Wentai Xie, Shanxiu He, and Tao Yang. 2025. Dynamic Superblock Pruning for Fast Learned Sparse Retrieval. In Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (Padua, Italy) (SIGIR ’25). Association for Computing Machinery, New York, NY, USA, 3004–3009. doi:10.1145/3726302.3730183DOI
- [6]Zhuyuan Dai and Jamie Callan. 2020. Context-Aware Term Weighting For First Stage Passage Retrieval. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’20). Association for Computing Machinery, 1533–1536.DOI
- [7]Hao Ding, Anoop Deoras, Yuyang (Bernie) Wang, and Hao Wang. 2022. Zero-Shot Recommender Systems. In ICLR 2022 Workshop on Deep Generative Models for Highly Structured Data (DGM4HSD). https://www.amazon.science/publications/zero-shot-recommender-systemsarxiv.org/abs/2105.08318
- [8]Meet Doshi, Vishwajeet Kumar, Rudra Murthy, Vignesh P, and Jaydeep Sen. 2024. Mistral-SPLADE: LLMs for better Learned Sparse Retrieval. arXiv preprint arXiv:2408.11119 (2024).arxiv.org/abs/2408.11119
- [9]Thibault Formal, Benjamin Piwowarski, and Stéphane Clinchant. 2021. SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, New York, NY, USA, 2288–2292.
- [10]Shen Gao, Jiabao Fang, Quan Tu, Zhitao Yao, Zhuming Chen, Pengjie Ren, and Zhaochun Ren. 2024. Personalized News Recommendation. In Proceedings of the ACM Web Conference 2024. ACM, New York, NY, USA, 3444–3453.
- [11]Linmei Hu, Siyong Xu, Chen Li, Cheng Yang, Chuan Shi, Nan Duan, Xing Xie, and Ming Zhou. 2020. Graph Neural News Recommendation with Unsupervised Preference Disentanglement. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel Tetreault (Eds.). Association for Computational Linguistics, Stroudsburg, PA, USA, 4255–4264.
- [12]Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive Sequential Recommendation. In 2018 IEEE international conference on data mining (ICDM). IEEE, 197–206.
- [13]Nishat Kannen, Yao Ma, Gerrit J. J. van den Burg, and Jean Baptiste Faddoul. 2024. Efficient Pointwise-Pairwise Learning-to-Rank for News Recommendation. In Findings of the Association for Computational Linguistics: EMNLP 2024, Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen (Eds.). Association for Computational Linguistics, Miami, Florida, USA, 12403–12418. doi:10.18653/v1/2024.findings-emnlp.723
- [14]Mozhgan Karsani, Dietmar Jannach, and Michael Jugovac. 2018. News Recommender Systems – Survey and Roads Ahead. Information Processing & Management 54, 6 (2018), 1203–1227.DOI
- [15]Jan Kaspers, Kasper Lindskow, Saikishore Kalloori, Marco Polignano, Claudio Pomo, Abhishek Srivastava, Anshuk Uppal, Michael Riis Andersen, and Jes Frellsen. 2024. BE-NeRD: A large-scale dataset for news recommendation. In Proceedings of the Recommender Systems Challenge 2024 (Bari, Italy) (RecSysChallenge ’24). Association for Computing Machinery, New York, NY, USA, 1–11. doi:10.1145/3687151.3687152
- [16]Carlos Lasance, Hervé Déjean, Thibault Formal, and Stéphane Clinchant. 2024. SPLADE-v3: New Baselines for SPLADE. arXiv preprint arXiv:2403.06789 (2024).
- [17]Jiacheng Li, Ming Wang, Jin Limiao Fu, Xin Shen, Jingbo Shang, and Julian McAuley. 2023. Text is All You Need: Learning Language Representations for Sequential Recommendation. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1258–1267.arxiv.org/abs/2305.13731
- [18]Xinyi Li, Yongfeng Zhang, and Edward C. Malthouse. 2023. A Preliminary Study of ChatGPT on News Recommendation: Personalization, Provider Fairness, Fake News. arXiv preprint arXiv:2306.10702 (2023).arxiv.org/abs/2306.10702
- [19]Jimmy Lin and Xueguang Ma. 2021. A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniques. arXiv preprint arXiv:2106.14807 (2021).arxiv.org/abs/2106.14807
- [20]Cheng-Chieh Lin and Jimmy Lin. 2023. A Dense Representation Framework for Lexical and Semantic Matching. ACM Trans. Inf. Syst. 41, 4, Article 110 (2023).
- [21]Dairui Liu, Boming Yang, Honghui Du, Derek Greene, Neil Hurley, Anghus Lawlor, Ruihai Dong, and Irene Li. 2024. Prompt: A self-tuning Prompting Framework for News Recommendation Using Large Language Models. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. ACM, New York, NY, USA, 3902–3906.DOI
- [22]Sean MacAvaney, Franco Maria Nardini, Raffaele Perego, Nicola Tonellotto, Nazli Goharian, and Ophir Frieder. 2020. Expansion via Prediction of Importance with Contextualization. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, China) (SIGIR ’20). Association for Computing Machinery, 1573–1576.DOI
- [23]Joel Mackenzie, Antonio Mallia, Alistair Moffat, and Matthias Petri. 2022. Accelerating Learned Sparse Indexes via Term Impact Decomposition. In Findings of the Association for Computational Linguistics: EMNLP 2022. Association for Computational Linguistics, 2830–2842. doi:10.18653/v1/2022.findings-emnlp.205DOI
- [24]Joel Mackenzie, Shengyao Zhuang, and Guido Zuccon. 2023. Exploring the Representation Power of SPLADE Models. In Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval. 143–147.arxiv.org/abs/2306.16680
- [25]Yu A. Malkov and Dmitry A. Yashunin. 2020. Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs. IEEE Transactions on Pattern Analysis and Machine Intelligence 42, 4 (2020), 824–836.
- [26]Antonio Mallia, Omar Khattab, Torsten Suel, and Nicola Tonellotto. 2021. Learning Sparse Impacts for Inverted Indexes. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’21). Association for Computing Machinery, 1723–1727.arxiv.org/abs/2104.12016
- [27]Antonio Mallia, Torsten Suel, and Nicola Tonellotto. 2024. Faster Learned Sparse Retrieval with Block-Max Pruning. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM.arxiv.org/abs/2405.01117
- [28]Thong Nguyen, Mariya Hendriksen, Andrew Yates, and Maarten de Rijke. 2024. Multimodal Learned Sparse Retrieval with Probabilistic Expansion Control. In Advances in Information Retrieval: 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24–28, 2024, Proceedings, Part II (Glasgow, United Kingdom). Springer-Verlag, 448–464.arxiv.org/abs/2402.17535
- [29]Thong Nguyen, Yibin Lei, Dylan Ju, Eugene Yang, and Andrew Yates. 2026. MILCO: Learned sparse retrieval across languages via a multilingual connector. In International Conference on Learning Representations.arxiv.org/abs/2510.00671
- [30]Thong Nguyen, Sean MacAvaney, and Andrew Yates. 2023. A Unified Framework for Learned Sparse Retrieval. In Advances in Information Retrieval: 45th European Conference on Information Retrieval, ECIR 2023, Dublin, Ireland, April 2–6, 2023, Proceedings, Part III (Dublin, Ireland). Springer-Verlag, 101–116.arxiv.org/abs/2303.13416
- [31]Shaina Raza and Chen Ding. 2022. News Recommender System: A Review of Recent Progress, Challenges, and Opportunities. Artif. Intell. Rev. 55, 1 (2022), 749–800.DOI
- [32]Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (Beijing, China) (CIKM ’19). ACM, New York, NY, USA, 1441–1450. doi:10.1145/3357384.3357895DOI
- [33]Nandan Thakur, Nils Reimers, Andreas Rücklé, Abhishek Srivastava, and Iryna Gurevych. 2021. BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2). https://openreview.net/forum?id=wCu6T5xFJe
- [34]Anna Tigunova, Ghazaleh Haratinezhad Torbati, Andrew Yates, and Gerhard Weikum. 2024. STAR: Sparse Text Approach for Recommendation. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. ACM, New York, NY, USA, 4086–4090.DOI
- [35]Nicola Tonellotto, Craig Macdonald, and Iadh Ounis. 2018. Efficient Query Processing for Scalable Web Search. Foundations and Trends® in Information Retrieval 12, 4–5 (2018), 319–500.DOI
- [36]Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All You Need. In Advances in Neural Information Processing Systems, Vol. 30.arxiv.org/abs/1706.03762
- [37]Susan Vermeer, Damian Trilling, Sanne Kruikemeier, and Claes de Vreese. 2020. Online News User Journeys: The Role of Social Media, News Websites, and Topics. Digital Journalism 8, 9 (2020), 1114–1141.DOI
- [38]Hongwei Wang, Fuzheng Zhang, Xing Xie, and Minyi Guo. 2018. DKN: Deep Knowledge-aware Network for News Recommendation. In Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW ’18. ACM Press, New York, NY, USA, 1835–1844.
- [39]Chuhan Wu, Fangzhao Wu, Mingxiao An, Jianqiang Huang, Yongfeng Huang, and Xing Xie. 2019. Neural News Recommendation with Attentive Multi-view Learning. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19). International Joint Conferences on Artificial Intelligence Organization, 3863–3869.arxiv.org/abs/1907.05576
- [40]Chuhan Wu, Fangzhao Wu, Mingxiao An, Yongfeng Huang, and Xing Xie. 2019. Neural News Recommendation with Topic-aware News Representation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Anna Korhonen, David Traum, and Lluís Màrquez (Eds.). Association for Computational Linguistics, Stroudsburg, PA, USA, 1154–1159.DOI
- [41]Chuhan Wu, Fangzhao Wu, Suyu Ge, Tao Qi, Yongfeng Huang, and Xing Xie. 2019. Neural News Recommendation with Multi-head Self-attention. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Stroudsburg, PA, USA, 6389–6394.DOI
- [42]Chuhan Wu, Fangzhao Wu, Yongfeng Huang, and Xing Xie. 2023. Personalized News Recommendation: Methods and Challenges. ACM Trans. Inf. Syst. 41, 1 (Jan. 2023), 1–50.arxiv.org/abs/2106.08934
- [43]Chuhan Wu, Fangzhao Wu, Tao Qi, and Yongfeng Huang. 2021. Empowering News Recommendation with Pre-trained Language Models. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1652–1656.arxiv.org/abs/2104.07413
- [44]Chuhan Wu, Fangzhao Wu, Tao Qi, Chenliang Li, and Yongfeng Huang. 2022. Is News Recommendation a Sequential Recommendation Task?. In Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval. 2382–2386.arxiv.org/abs/2108.08984
- [45]Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, and Ming Zhou. 2020. MIND: A Large-scale Dataset for News Recommendation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel Tetreault (Eds.). Association for Computational Linguistics, Stroudsburg, PA, USA, 3597–3606.DOI
- [46]Tiancheng Zhao, Xiaopeng Lu, and Kyusong Lee. 2021. SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Online, 565–575.arxiv.org/abs/2009.13013
- [47]Yuyue Zhao, Jin Huang, David Vos, and Maarten de Rijke. 2025. Revisiting Language Models in Neural News Recommender Systems: A Reproducibility Study. In ECIR 2025: 47th European Conference on Information Retrieval (Part IV). Springer, 161–176.arxiv.org/abs/2501.11391
- [48]Shengyao Zhuang and Guido Zuccon. 2021. Fast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage Expansion. arXiv preprint arXiv:2108.08513 (2021).arxiv.org/abs/2108.08513
- [49]Shengyao Zhuang and Guido Zuccon. 2021. TILDE: Term Independent Likelihood moDEl for Passage Re-ranking. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, Canada) (SIGIR ’21). Association for Computing Machinery, 1483–1492.DOI
