WorksMathematics
Classification of -distinguished representations
Abstract
Let be a quaternion division algebra over a non-Archimedean local field of characteristic zero. We prove the conjecture of Dagar, Sharma, and Verma classifying irreducible smooth representations of distinguished by for . These are precisely the trivial representation and the irreducible normalized parabolic inductions \one_{n-2}\timesτ, where is an infinite-dimensional irreducible representation of distinguished by . The proof combines a choice of cuspidal inducing factor with orbit conditions and multisegment methods.
Introduction
Distinction problems study the existence of invariant linear forms on representations under the action of a subgroup. For reductive groups and their symmetric subgroups, these questions are closely related to harmonic analysis on homogeneous spaces. Linear periods provide an important example of this connection. In this paper, we classify representations of general linear groups over a quaternion division algebra admitting a linear period with respect to a block-diagonal subgroup of type .
Let be a non-Archimedean local field of characteristic zero, and let be a quaternion division algebra over . For , set . Given nonnegative integers , with , let
An irreducible smooth complex representation of is called -distinguished if . The elements of this space are called linear periods. Our concern is the subgroup .
The theory of linear periods involves both uniqueness and classification questions. For split general linear groups, Jacquet and Rallis [8] established the uniqueness of linear periods for block-diagonal subgroups. Chen and Sun [5] studied twisted linear periods for the pair and their relation to twisted Shalika periods. On the classification side, Yang [16] characterized the irreducible unitary representations of admitting linear periods with respect to . These results illustrate the interaction between distinction, parabolic induction, and the structure of the irreducible dual.
For quaternionic general linear groups, the rank-two problem was studied by Raghuram [12] and Gan–Takeda [7]. Their results describe the representations of admitting an -period. In higher ranks, Anandavardhanan, Lu, Matringe, Sécherre, and Yang [1] established results on multiplicities and vanishing of linear periods. In particular, their results exclude -distinction for essentially square-integrable representations of when . This makes the analysis of parabolically induced representations central to the classification problem.
Dagar, Sharma, and Verma [6] proposed that -distinction in every rank is governed by distinguished representations of . They proved their conjecture for and . We recall its statement, writing for the trivial representation of and for normalized parabolic induction.
Conjecture 1.1 ([6 Conjecture 1.1]). Let , and let . Then is -distinguished if and only if either or
where is an infinite-dimensional irreducible -distinguished representation of .
The induction in the second alternative is necessarily irreducible, since it is isomorphic to . Thus the conjecture describes every nontrivial irreducible -distinguished representation by adjoining a trivial factor to distinguished data of rank two.
The main result of this paper establishes the conjecture for all .
Theorem A. Conjecture holds for every .
Outline of the proof
Our proof combines the orbit conditions of [6] with the structure of representations described by multisegments. The relevant classification originates in the work of Zelevinsky [17] for split general linear groups. For general linear groups over division algebras, we use the results of Tadić [15] and Mínguez–Sécherre [10]. We also use the Mœglin–Waldspurger algorithm [11], extended to by Badulescu and Renard [3], to pass between the Zelevinsky and Langlands parametrizations.
A key step is the choice of a cuspidal inducing factor. For , we prove that every irreducible non-cuspidal representation , after replacement by if necessary, admits a quotient presentation , where is cuspidal, is irreducible, and as a representation of . This follows by comparing the endpoints of the segments parametrizing and . The resulting choice excludes one closed-orbit condition and permits a uniform argument in higher ranks.
Suppose that is distinguished. Its period pulls back to , so the orbit conditions apply to this induced representation. If has rank at least two, cuspidality excludes the open orbit, while the remaining closed-orbit condition and the vanishing results of [1] force its rank to be exactly two. This leads to the representations predicted by Conjecture .
For a rank-one factor, the analysis reduces to the open orbit. Frobenius reciprocity then gives an embedding , so that is an irreducible constituent of . We determine the possible distinguished constituents of this family by separating the boundary values from the remaining cases. At the boundary, the Mœglin–Waldspurger algorithm and a vanishing statement for inductions involving exclude every nontrivial constituent. Away from the boundary, linked-segment arguments and the irreducibility of unitary parabolic induction [13] reduce the problem to distinction in rank two. The converse follows from the sufficient closed-orbit condition of [6].
Organization of the paper
Section 2 fixes the notation and recalls the necessary background on representations and linear periods. Section 3 constructs quotient presentations with suitable cuspidal first factors. Section 4 analyzes the distinguished constituents of the induced representations arising from the orbit conditions, including the boundary cases. Section 5 combines these results to complete the proof of Theorem A.
Acknowledgements
Quanyong Chen expresses his gratitude to Kei Yuen Chan for valuable discussions and comments. The authors acknowledge the assistance of ChatGPT in preparing this manuscript. The authors have reviewed and verified the AI-assisted content and take full responsibility for the mathematical arguments, results.
Conventions and preliminaries
Fix a non-Archimedean local field of characteristic zero, and let be a quaternion division algebra over , so that . For each , write
Let denote the reduced norm map, and define
For with , let be the block-diagonal subgroup
This subgroup is the fixed-point group of the involution
We equip with the family of characters defined by
Equivalently, if is given by , then is the composition of with the homomorphism
Representations of
In this subsection, as in [4], we review the requisite facts on the representation theory of . Let denote the category of smooth complex representations of of finite length. We denote by the set of equivalence classes of irreducible representations, and by the subset consisting of cuspidal representations. In this paper, all representations are smooth. For , we denote its contragredient by .
In this paper, whenever the value of is clear from the context, we write for . Let be a parabolic subgroup of with Levi decomposition , where is a Levi subgroup and the unipotent radical. Let be a representation of . By inflation, we regard as a representation of , with the unipotent radical acting trivially. The normalized parabolic induction of to is defined by , where denotes the modular character of . Let be a partition of , and let be the corresponding Levi subgroup of . Every representation of can be written in the form
We use the notation for the normalized parabolic induction . Parabolic induction is exact and preserves finite length. Permuting inducing factors preserves their Jordan–Hölder constituents, but does not in general preserve which constituent is a subrepresentation or a quotient.
We next recall the Jacquet functor. Let be a representation of , and let be the unipotent radical of . Define , and set . The group acts by
Since is trivial on , this action factors through the quotient . Hence may be viewed as a representation of the Levi subgroup . The resulting representation is called the normalized Jacquet module of . For the Levi subgroup , we denote the corresponding Jacquet module by .
Segments and multisegments
For a cuspidal representation of , write for its reducibility character. For with , a segment is a set
Its degree is .
Following [6 Section 2], we denote by the unique irreducible subrepresentation of the ascending cuspidal induction attached to , and by its unique irreducible quotient. On the trivial cuspidal line of , one has . To distinguish ordinary -exponents from -exponents, we write
where . In particular,
Let and be two segments. We say that precedes if, after concatenating the terms of and in this order, one can select a subsequence which forms a segment of length strictly larger than both and . The segments and are called linked if precedes or precedes .
Let denote the set of segments and the set of finite multisegments. Let be a multisegment, and define , where does not precede for . Then has a unique irreducible subrepresentation . This representation depends only on the multisegment . Similarly, set . The unique irreducible quotient of is denoted by .
We shall use the following consequences of the multisegment classification; see [6 Section 2] and [3, 10, 15]. The following lemma provides a realization of as the unique irreducible quotient of a suitably ordered parabolic induction.
Lemma 2.1. [9 Theorem 2.4] Let be a multisegment, ordered so that does not precede whenever . Then the normalized parabolic induction
has as its unique irreducible quotient. In particular, for , there is a surjection
We will also use the following compatibility between the multisegment parametrization and contragredients.
We next recall the standard exact sequences associated with a pair of linked segments.
Lemma 2.3. [10 Lemma 5.12] Let be linked segments and set , . If , we agree that is the trivial representation of , which may be omitted in inductions. Then there are short exact sequences
and
For , write if there is a finite chain such that each is obtained from by replacing two linked segments by their union and intersection, with an empty omitted. Such a replacement is called an elementary operation. This relation defines a partial order on . We recall the following properties of the multisegment classification from [10].
Lemma 2.4. Let , and set
where the factors may be taken in any order. For a multisegment , denote by the multiplicity of as a composition factor of . Then the following statements hold:
(i) if and only if .
(ii) .
(iii) If the segments of are pairwise unlinked, then is irreducible.
(iv) If and are supported on two distinct cuspidal lines, then
is irreducible.
Mœglin–Waldspurger algorithm
The Mœglin–Waldspurger algorithm provides a combinatorial description of the correspondence between the Zelevinsky and Langlands parametrizations. Originally established in [11], it was extended to by Badulescu and Renard [3]. An additional account of the algorithm and its applications to Speh representations can be found in [2]. The algorithm associates to each multisegment a multisegment satisfying and . We recall the recursive construction below.
First suppose that all segments of lie on a single cuspidal line, with endpoints expressed in powers of . For a segment , set , interpreting as empty when . Let be the largest right endpoint occurring in . Among the segments ending at , choose with the largest left endpoint. Having chosen , choose with the largest left endpoint among those segments that end at and precede . Stop when no such segment exists. If the resulting chain is , record the segment .
Form a new multisegment by replacing each selected occurrence of by , discarding empty segments and leaving all other occurrences unchanged. The construction is then repeated on . Equivalently, , where denotes segments addition. The total length decreases at each step, so the procedure terminates. For a multisegment supported on several cuspidal lines, the construction is carried out separately on each line, and the resulting multisegments are combined.
Finite-length arguments
In this subsection, we record two elementary facts about finite-length representations. These allow us to extract irreducible inducing factors while retaining a given irreducible quotient, and concerns the irreducible quotients of a representation with a unique irreducible quotient up to isomorphism.
Proposition 2.5. Let be irreducible, let have finite length, and let be irreducible. If , then there is an irreducible constituent of such that .
Proof. Choose a composition series . For a fixed surjection , take the least such that is nonzero on . That restriction is surjective because is irreducible, and it vanishes on . Exactness of induction gives the required surjection from . □
Proposition 2.6. Suppose a finite-length representation has a unique irreducible quotient up to isomorphism, equal to . Every nonzero quotient of has an irreducible quotient isomorphic to .
Proof. Every nonzero finite-length representation has an irreducible quotient. Any irreducible quotient of a quotient of is itself a quotient of . □
Results about distinction
The external period results needed here are the following.
(P1) If an irreducible is -distinguished, so is [6 Lemma 2.6].
(P2) An essentially square-integrable representation of , , has no -period against any character [1 Theorem 3.8].
(P3) For an infinite-dimensional ,
We use the formulation of [6 Remark 3.1]. The rank-two period theory is developed in [12, 7].
(P4) Normalized induction of an irreducible unitary representation of a Levi subgroup of is irreducible [13].
Let and . The necessary orbit conditions of [6 Lemma 2.8] say that can be -distinguished only if at least one of the following holds:
(a) , and is -distinguished.
(b) is -distinguished, and .
(c) Define , Then one has
where . The two closed conditions also give sufficient conditions for distinction [6 Lemma 2.9].
Proposition 2.7. Let , , and . If the open orbit contributes to , then
Proof. Denote by and the spaces of and , respectively, and set
Denote the action of on by . For a rank-one first factor, the open-orbit condition gives a nonzero linear functional
such that
for all , , , and .
Every irreducible smooth representation of is finite-dimensional, so its smooth dual equals its algebraic dual. Define
The invariance of implies
Thus is a homomorphism
Moreover, since would imply .
We now make the Frobenius reciprocity map explicit. Let and let
Write , where is the block-diagonal Levi subgroup and is the unipotent radical. Let be the natural quotient map. By the normalization of the Jacquet module,
Define
Then
which is precisely the transformation law for the normalized induction . If an open compact subgroup fixes , it also fixes under right translation, so is smooth. Furthermore,
hence is a -homomorphism. It is nonzero. Indeed, since is surjective and , some satisfies
Since and is an irreducible representation, we have .
Distinguished constituents of induced representations
In this section, we study the distinguished irreducible constituents of . A vanishing result for inductions involving a Steinberg twist allows us to treat the boundary cases.
Choosing the first cuspidal factor
For an irreducible non-supercuspidal representation of , define
Proposition 3.1. Let be non-cuspidal. On any cuspidal line occurring in , choose a segment with minimal ending. Then .
Proof. Let . Any segment preceding must lie on the same cuspidal line and have a strictly smaller ending. Thus no segment of precedes .
We may therefore order the segments as , with endings nondecreasing on each cuspidal line. No later segment precedes an earlier one. By Lemma 2.1, the quotient form of the multisegment classification gives
Using the surjection
and exactness of induction, we obtain
where
with empty lists omitted. This is a finite-length representation of , since normalized parabolic induction preserves finite length.
Choose a composition series
and let be minimal such that . Irreducibility of implies that this image is all of , while minimality gives . Exactness of induction therefore yields a surjection
The constituent is irreducible. Finally, . otherwise would consist of a single segment of length one, making cuspidal. Since is cuspidal, the displayed surjection proves .
Proposition 3.2. Let , and let be non-cuspidal. For at least one of and , there is a presentation
with cuspidal, irreducible, and as a representation of .
Proof. We argue by contradiction and assume that the conclusion fails. Proposition 3.1 shows that both sets of possible first factors are nonempty, and hence
Apply Proposition 3.1 separately to each cuspidal line of the multisegment for . Every such line must contain . Thus all segments lie on the single step-two line containing this character. Set , and write in ordinary -exponents. Minimal endings for , followed by minimal endings for , give
Every segment therefore contains , and has degree at least . Since , there is only one segment. Its endpoints must then be exactly , giving total degree , a contradiction.
Remark 3.3. Lemma 3.2 is independent of distinction and of the central character. Its role is to eliminate orbit (a) for a suitable cuspidal first factor. This is why the proof below does not require an inductive classification of twisted periods in smaller ranks.
Vanishing and the boundary configuration
In this subsection, we establish a vanishing result for inductions involving . Combining this with the orbit conditions and the Mœglin–Waldspurger algorithm, we show that the trivial representation is the only -distinguished irreducible constituent of .
Proposition 3.4. Let and . Then
Proof. Let . Suppose that is -distinguished. The three-orbit criterion with then requires at least one of the following conditions.
Closed orbit (a) requires
which is impossible because is infinite-dimensional.
Closed orbit (b) requires
However, for ,
since has trivial central character. As , these central characters differ, so this Hom space vanishes.
For the open orbit, by [10 Proposition 4.10], the normalized Jacquet module is
Consequently, the first -factor of acts on the source by , whereas the target character restricts to . These characters are distinct, so the open-orbit Hom space is trivial.
Thus none of the three necessary conditions holds, we complete the proof.
We now apply the preceding vanishing result to determine the distinguished irreducible constituents in the following boundary case.
Proposition 3.5. Let and , , and set
The only -distinguished irreducible constituent of is .
Proof. The elementary operations starting from can attach the left endpoint, the right endpoint, or both endpoints to the middle segment. The possible constituents are therefore precisely
No multiplicity assertion is needed here.
Excluding and . Set , an irreducible representation of . The Mœglin–Waldspurger algorithm gives
To see the algorithm explicitly, remove the right endpoints of the long segment one at a time. Each step produces a singleton until the final remaining endpoint is combined with to form . The two computations differ only by the initial singleton .
Let
The factors are in Langlands order. Equations (8)–(9) say that has unique irreducible quotient , while has unique irreducible quotient . Exactness gives a nonzero quotient . According to Proposition 2.6, we have
If were distinguished, so would be the representation on the left of (10). Since the first inducing factor is , neither closed-orbit condition can hold, as they require this factor to be and , respectively. By Proposition 2.7, the open-orbit embedding would require
The induction on the right has length two and unique irreducible socle , by the linked-segment rule. Its other constituent is , a different irreducible representation. Hence (11) is impossible. This excludes , and property (P1) excludes .
Excluding . The algorithm gives
The first step joins to the right endpoint of the middle segment. Subsequent steps remove singletons, and the final step joins the left endpoint to . When , the list of middle singletons in (12) is empty.
Thus is a quotient of an induction with of finite length. From Proposition 2.5, replaces by an irreducible representation . But
so Proposition 3.4 excludes distinction of . Only remains.
Example 3.6 (The boundary formulas in rank five). For , the boundary cuspidal exponents are , and
In particular is a quotient of , to which Lemma 3.4 applies after extracting an irreducible tail.
The rank-one open-orbit family
We study distinction for in terms of -periods on . Together with the boundary case treated above, this criterion allows us to determine the distinguished irreducible constituents of .
Proposition 3.7. For and ,
if and only if is infinite dimensional and -distinguished.
Proof. Apply the orbit conditions with and . Orbit (b) would require
which is false. For orbit (c), by the definition of the normalized Jacquet functor [14 Definition 1.22], we have
The first factor would have to be . The characters are different since . Hence only orbit (a) can contribute, and it requires . Every finite-dimensional irreducible smooth representation of is a character. Such a character restricts to with the same character on both factors, so it cannot equal . Thus is infinite dimensional, and (4) gives its -distinction. Conversely, (4) and the sufficiency of closed orbit (a) give the desired period on .
The following proposition describes the possible distinguished constituents of .
Proposition 3.8. Let , and let . Every -distinguished irreducible constituent of
is either , or an irreducible induction with infinite dimensional and -distinguished.
Proof. Set , and write
If , invariance of semisimplified parabolic induction under permutation of the factors shows that has the same irreducible constituents as . The assertion then follows from Proposition 3.5.
Assume henceforth that . A singleton is linked to only when it is immediately adjacent to one of its endpoints, namely or . Consequently, neither nor is linked to . The corresponding factors can therefore be interchanged, giving
If is irreducible, the three segments , , and are pairwise unlinked. Thus is irreducible, and the assertion follows from Proposition 3.7 with .
Suppose now that is reducible. The reducibility criterion gives
Set . Then
Twisting does not change the reducibility step, so , and therefore
Moreover, has length two; write its composition series as
If , the cuspidal line containing and is disjoint from the line supporting . Indeed, an intersection would imply for some . Self-duality would then give , forcing , contrary to . Since both have cuspidal support , disjointness of cuspidal lines implies that each is irreducible.
If , then and . In this case
Both and are irreducible by the irreducibility of normalized induction of irreducible unitary representations.
Thus, in either case, exactness of normalized parabolic induction gives
with irreducible outer terms. These are therefore precisely the irreducible constituents of . Finally, by Proposition 3.7, a constituent is distinguished only if is infinite-dimensional and -distinguished.
proof of the conjecture
In this section, we combine the preceding results to prove Conjecture 1.1. A suitable choice of cuspidal first factor allows us to apply the orbit conditions and reduce necessity to the cases already treated. The sufficiency follows from the closed-orbit criterion.
Theorem 4.1. Let , and let be -distinguished. Then belongs to the list in Conjecture 1.1.
Proof. For , use [6 Theorems 3.3 and 4.3]. Assume . Property (P2) implies that is not cuspidal. By Proposition 3.2, and after replacing by if necessary, we have
The replacement preserves distinction by (P1). The period on pulls back through (13), so the orbit conditions apply to .
First case: . Orbit (a) is impossible because is cuspidal and is not a character. Orbit (c) is impossible because . Thus orbit (b) gives
By (P2), this forces . Then , and (2.4) shows that the cuspidal is distinguished. The induction is irreducible, since its two factors have disjoint cuspidal lines. Therefore , as required.
Second case: . The choice in (13) excludes orbit (a). If orbit (b) held, then
In the notation of Proposition 3.5, this gives
Its unique irreducible quotient is , by the linked-segment rule. Hence , contradicting Proposition 3.5. Thus orbit (b) is also impossible.
The open orbit must therefore contribute. By Proposition 2.7, we have , and exact induction gives
Since is a quotient of the left-hand side, it is an irreducible constituent of the right-hand side. It follows from Proposition 3.8 that belongs to the required list.
Finally, the list is stable under contragredients. The dual of is , and
The representation is again infinite dimensional and -distinguished by (P1). Thus the same conclusion holds for the original if we made a contragredient replacement.
We now prove the sufficiency. The trivial representation is distinguished by definition. Suppose is irreducible, with infinite dimensional and -distinguished. By (4),
Apply the sufficient closed-orbit condition [6 Lemma 2.9(1)] with . Its first inducing factor is , and its remaining period is exactly the one just displayed. Hence . □
Remark 4.2 (Quotient directions used in the argument). Throughout the proof, we pull periods back along surjective homomorphisms without assuming that they descend from an induced representation to each of its irreducible quotients.
The University of Hong Kong, China
Email address: [email protected]
Harbin Engineering University, Harbin, China
Email address: [email protected]
References
- [1]U. K. Anandavardhanan, H. Lu, N. Matringe, V. Sécherre, and C. Yang, The sign of linear periods, preprint, arXiv:2402.12106v3 (2024). https://arxiv.org/abs/2402.12106.
- [2]A. I. Badulescu, On p-adic Speh representations, Bull. Soc. Math. France 142 (2014), no. 2, 255–267.arxiv.org/abs/1110.5080
- [3]A. I. Badulescu and D. Renard, Zelevinsky involution and Mœglin–Waldspurger algorithm for GLₙ(D), in Functional Analysis IX, Various Publications Series (Aarhus), vol. 48, Aarhus University, Aarhus, 2007, pp. 9–15.
- [4]I. N. Bernstein and A. V. Zelevinsky, Representations of the group GL(n, F), where F is a local nonarchimedean field, Russian Math. Surveys 31 (1976), no. 3, 1–68.
- [5]F. Chen and B. Sun, Uniqueness of twisted linear periods and twisted Shalika periods, Sci. China Math. 63 (2020), no. 1, 1–22. https://doi.org/10.1007/s11425-018-9502-y.
- [6]P. Dagar, H. Sharma, and M. K. Verma, On representations of GLₙ distinguished by GL₁ × GLₙ₋₁ over a quaternion division algebra, J. Algebra 711 (2027), 405–420. https://doi.org/10.1016/j.jalgebra.2026.07.003.
- [7]W. T. Gan and S. Takeda, On Shalika periods and a theorem of Jacquet–Martin, Amer. J. Math. 132 (2010), no. 2, 475–528.arxiv.org/abs/0705.1576
- [8]H. Jacquet and S. Rallis, Uniqueness of linear periods, Compositio Math. 102 (1996), no. 1, 65–123.
- [9]E. Lapid and A. Mínguez, On parabolic induction on inner forms of the general linear group over a non-archimedean local field, Selecta Math. (N.S.) 22 (2016), no. 4, 2347–2400. https://doi.org/10.1007/s00029-016-0281-7.
- [10]A. Mínguez and V. Sécherre, Représentations banales de GLₘ(D), Compos. Math. 149 (2013), no. 4, 679–704. https://doi.org/10.1112/S0010437X12000590.
- [11]C. Mœglin and J.-L. Waldspurger, Sur l’involution de Zelevinski, J. Reine Angew. Math. 372 (1986), 136–177.DOI
- [12]A. Raghuram, On the restriction to D× × D× of representations of p-adic GL₂(D), Canad. J. Math. 59 (2007), no. 5, 1050–1068.
- [13]V. Sécherre, Proof of the Tadić conjecture (UO) on the unitary dual of GL_m(D), J. Reine Angew. Math. 626 (2009), 187–203. https://doi.org/10.1515/CRELLE.2009.007.
- [14]M. Solleveld, Group algebras of reductive p-adic groups, their representations and their noncommutative geometry, preprint, arXiv:2510.17260 (2025). https://arxiv.org/abs/2510.17260.
- [15]M. Tadić, Induced representations of GL(n, A) for p-adic division algebras A, J. Reine Angew. Math. 405 (1990), 48–77. https://doi.org/10.1515/crll.1990.405.48.
- [16]C. Yang, Linear periods for unitary representations, Math. Z. 302 (2022), no. 4, 2253–2284. https://doi.org/10.1007/s00209-022-03136-y.
- [17]A. V. Zelevinsky, Induced representations of reductive p-adic groups. II. On irreducible representations of GL(n), Ann. Sci. École Norm. Sup. (4) 13 (1980), no. 2, 165–210. https://doi.org/10.24033/asens.1379.