Free energy of non-convex multi-species spin glasses with centered Ising spins


Abstract

We identify the limit free energy of all multi-species spin glasses with centered \(\pm 1\) spins. The result was previously known only under a convexity assumption on the covariance function of the Hamiltonian. We also obtain a one-species reduction of the formula for balanced multi-species models.

1 Introduction↩︎

The main goal of this paper is to identify the limit free energy of multi-species models with centered \(\pm 1\) spins. We start by defining the class of models we consider precisely. Let \(\mathscr{S}\) be the finite set of species labels. For each \(N\in\mathbb{N}\), let \((I_{N,s})_{s\in\mathscr{S}}\) be a partition of \(\{1,\dots,N\}\), where \(I_{N,s}\) denotes the set of indices belonging to the \(s\)-th species. For two configurations \(\sigma,\sigma' \in \{-1,1\}^N\) and \(s \in \mathscr{S}\), the overlap associated with the \(s\)-th species is defined by \[\label{e46R95N44s61} R_{N,s}(\sigma,\sigma') = \frac{1}{N} \sum_{n \in I_{N,s}} \sigma_n \sigma'_{n}.\tag{1}\] We also set \[\label{e46sigma95bullet44I} R_N(\sigma,\sigma') = (R_{N,s}(\sigma,\sigma'))_{s\in \mathscr{S}}.\tag{2}\] Let \(\xi : \mathbb{R}^\mathscr{S}\to \mathbb{R}\) be a function that admits an absolutely convergent power-series expansion, and let \((H_N(\sigma))_{\sigma\in \{-1,1\}^N}\) be a centered Gaussian field with covariance \[\begin{align} \label{e46def32H95N} \mathbb{E}\left[ H_N(\sigma)H_N(\sigma')\right] = N\xi\left(R_N(\sigma,\sigma')\right). \end{align}\tag{3}\] We stress that we do not assume any convexity property of \(\xi\). The proportion of spins in the \(s\)-th species is denoted by \[\label{e46def46lambda95Nd} \lambda_{N,s} = |I_{N,s}|/N, \quad \text{ and we set } \lambda_N=\left(\lambda_{N,s}\right)_{s\in\mathscr{S}}.\tag{4}\] We assume that these proportions converge: for some \(\lambda_\infty = (\lambda_{\infty,s})_{s\in \mathscr{S}} \in (0,1)^\mathscr{S}\), \[\label{e46lambda95infty} \lim_{N\to\infty} \lambda_N =\lambda_\infty.\tag{5}\] The main object considered here is the limiting free energy as \(N\to+\infty\). For every \(t\geqslant 0\), we define \[\label{e46def46FN46delta0} \overline{F}_N(t,0) = - \frac{1}{N} \mathbb{E}\log \sum_{\sigma\in\{-1,1\}^N} 2^{-N}\exp \left( \sqrt{2t} H_N(\sigma) - Nt\xi \left( \lambda_N \right) \right)\tag{6}\] where \(- Nt\xi \left( \lambda_N \right)\) is included for convenience, as it simplifies the expression when differentiating the free energy in \(t\). We let \(\mathcal{Q}\) denote the set of right-continuous increasing paths \(q:[0,1)\to\mathbb{R}_+\) (here and throughout, we say that a path \(q\) is increasing provided that \(q(r')\geqslant q(r)\) for every \(0\leqslant r\leqslant r'<1\)). For \(p\in [1,\infty)\), we write \(\mathcal{Q}_p = \mathcal{Q} \cap L^p[0,1)\). Below we will extend \(\overline{F}_N(t,\cdot)\) so that its second argument is any element of the set \(\mathcal{Q}_2^\mathscr{S}\); the \(0\) appearing as the second argument of \(\overline{F}_N(t,0)\) on the left side of 6 is the collection of paths in \(\mathcal{Q}^\mathscr{S}\) that are constant equal to zero. We denote by \(\psi_\circ : \mathcal{Q}_1 \to \mathbb{R}\) the cascade transform of the measure \(\frac{1}{2} \delta_1 + \frac{1}{2} \delta_{-1}\) (see the beginning of Section 2 for a precise definition), and for every \(q = (q_s)_{s \in \mathscr{S}} \in \mathcal{Q}_1^\mathscr{S}\), we set \[\label{e46decomp46psi} \psi(q) = \sum_{s \in \mathscr{S}} \lambda_{\infty,s} \, \psi_\circ(q_s).\tag{7}\] For every \(t \geqslant 0\) and \(p,q,q' \in \mathcal{Q}_2^\mathscr{S}\), we write \[\mathcal{J}_{t,q}(q',p) = \psi(q') + \left\langle q - q', p\right\rangle_{L^2}+t\int_0^1\xi(p(s))\mathrm{d}s.\] One may call this quantity the Hamilton–Jacobi functional, as it is closely related to the Hamilton–Jacobi equation appearing below in 141 . When the covariance function \(\xi\) is convex over \(\mathbb{R}_+^\mathscr{S}\), the free energy is known to converge, with a limit given by the Parisi formula [1][7]. This formula can be written as \[\label{e46parisi} \lim_{N \to +\infty} \overline{F}_N(t,q) = \sup_{q' \in \mathcal{Q}_\infty^\mathscr{S}} \inf_{p \in \mathcal{Q}_\infty^\mathscr{S}} \mathcal{J}_{t,q}(q',p).\tag{8}\] As was shown in [8], this formula does not hold in general if one does not assume the function \(\xi\) to be convex over \(\mathbb{R}_+^\mathscr{S}\). Yet, even when \(\xi\) is not convex, we know from [3] that if the limit free energy exists, then it can be represented as \(\mathcal{J}_{t,q}(q',p)\) for some \((q',p) \in (\mathcal{Q}_\infty^\mathscr{S})^2\) that is a critical point of \(\mathcal{J}_{t,q}\). A pair \((q',p)\) is said to be a critical point of \(\mathcal{J}_{t,q}\) if it is such that \[\label{e46def46crit46point} p = \partial_q \psi(q') \quad \text{ and } \quad q' = q + t \nabla \xi(p).\tag{9}\] In this paper, we prove that the limit free energy indeed exists for all \(\xi\), and we identify the limit free energy unambiguously as a modified variational formula.

Theorem 1. For every \(t \geqslant 0\) and \(q \in \mathcal{Q}_2^\mathscr{S}\), we have \[\label{e46main461} \lim_{N \to +\infty} \overline{F}_N(t,q) = \sup_{p \in \mathcal{Q}_\infty^\mathscr{S}}\inf_{q' \in \mathcal{Q}_\infty^\mathscr{S}} \mathcal{J}_{t,q}(q',p).\tag{10}\] Moreover, denoting this limit by \(f(t,q)\), the function \(f\) is the Lipschitz viscosity solution to \[\begin{align} \label{e46main46hj} \begin{cases} \partial_t f - \int_0^1 \xi(\partial_q f)=0 ,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_2, \\ f(0,\cdot) = \psi ,\qquad &\text{on }\mathcal{Q}^\mathscr{S}_2. \end{cases} \end{align}\tag{11}\]

We refer to Definition 2 for a precise definition of the notion of viscosity solution to 11 .

Remark 1 (Balanced models). Theorem 1 also gives a simple reduction for balanced models. In Section 9, we introduce a comparison structure that includes the balanced multi-species models in [9] and is closely related to the permutation-invariant reductions and Hamilton–Jacobi comparisons in [10]. Proposition 21 shows that, for such models, the multi-species formula is squeezed between one-species formulas, and in particular its value at \(q=0\) agrees with the free energy of an associated one-species model; see also Corollary 2 and Remark 22. In Appendix 11, we also sketch an alternative Hamilton–Jacobi comparison proof of this balanced reduction, which does not rely on Theorem 1.

To the best of our knowledge, Theorem 1 is the first identification of the limiting free energy for a model with \(\pm 1\) spins and non-convex \(\xi\), and also the first such identification for a model with non-convex \(\xi\) and potentially more than one level of replica symmetry breaking. We stress however that our results are restricted to the case of centered spins; in other words, we have not allowed for the presence of a deterministic external field. Indeed, as was explained in [8], the statement 10 implies that the function \(\psi\) is convex; however, if the reference measure for one of the species were \(p \delta_1 + (1-p) \delta_{-1}\) with \(\max(p,1-p) > (3+\sqrt 3)/6 \simeq 0.79\) (in place of \(p = 1/2\)), then this property would be demonstrably false (see also [11]).

Let us also mention that the restriction to centered Ising spins is not inherent to the Hamilton–Jacobi approach. In the forthcoming work [12], we extend the results of the present paper, through similar arguments, to non-convex multi-species spherical spin glasses. The spherical setting requires additional technical inputs, in particular to handle the geometry of the sphere and the corresponding form of the cascade transform.

Roughly speaking, we build the proof of Theorem 1 along the following lines.

(1) We borrow from [8], [13] the fact that \(\liminf_{N \to +\infty} \overline{F}_N(t,q)\) is bounded from below by the solution \(f\) to 11 .

(2) We show that \(\psi\) is convex, and use [14] to deduce that the solution \(f\) to 11 can be written as the variational formula on the right side of 10 .

(3) At this stage, if we were to assume the existence of the limit free energy (the left side of 10 ), then we could appeal to the result of [3] that ensures the existence of some \((q'_*,p_*)\) that is a critical point of \(\mathcal{J}_{t,q}\) and is such that \[\lim_{N \to +\infty} \overline{F}_N(t,q) = \mathcal{J}_{t,q}(q_*', p_*).\] Using the first identity in 9 and the convexity of \(\psi\), we have that \[\mathcal{J}_{t,q}(q',p_*) - \mathcal{J}_{t,q}(q'_*,p_*) = \psi(q') - \psi(q'_*) - \left\langle\partial_q\psi(q'_*), q'-q'_* \right\rangle_{L^2}\geqslant 0,\] and we would thus have \[\lim_{N \to +\infty} \overline{F}_N(t,q) =\mathcal{J}_{t,q}(q'_*,p_*) = \inf_{q' \in \mathcal{Q}_\infty^\mathscr{S}} \mathcal{J}_{t,q}(q',p_*) \leqslant\sup_{p \in \mathcal{Q}_\infty^\mathscr{S}} \inf_{q' \in \mathcal{Q}_\infty^\mathscr{S}} \mathcal{J}_{t,q}(q',p),\] thereby completing the proof.

The main problem with this sketch of proof is that we do not know in advance that the limit free energy exists. This assumption was used in [3] in order to assert that, in a suitably weak sense, \(\partial_q \overline{F}_N\) stabilizes to some fixed quantity as \(N\) tends to infinity, since we represent \(\overline{F}_N\) itself as a sum of contributions involving \(\partial_q \overline{F}_k\) for all \(k \leqslant N\). Here we revisit this argument, and show that one can always find critical points \((q'_-, p_-)\) and \((q'_+, p_+)\) of \(\mathcal{J}_{t,q}\) such that \[\label{e46crit46up46low46intro} \mathcal{J}_{t,q}(q'_-, p_-) \leqslant\liminf_{N \to +\infty} \overline{F}_N(t,q) \leqslant\limsup_{N \to +\infty} \overline{F}_N(t,q) \leqslant\mathcal{J}_{t,q}(q'_+, p_+);\tag{12}\] see Theorem 3 for a precise statement. This statement is interesting on its own, and usefully complements the conditional results of [3]. It can be stated in greater generality than our present assumptions (see Theorem 7), in particular allowing for a bias in the reference measure (or equivalently, for the presence of an external field).

Another technical difficulty that we face is that in order to show 12 , it is more convenient to encode models in the form of vector spin glasses, as opposed to multi-species, as one can then perform cavity calculations one vector spin at a time. Under the assumption that all the entries of \(\lambda_\infty\) are rational, we can go back and forth between the two settings, which we shall do. We then obtain the final result, for \(\lambda_\infty\) that may have irrational coordinates, by an approximation argument.

Related works. We now give a brief overview of related works.

The Parisi formula was first proposed in the physics literature [15], [16]. Its rigorous proof, through Guerra’s interpolation bound and then through the matching lower bound, was obtained in [4], [7]. The argument was later revisited and extended in [5], [17], with ultrametricity and the cavity computation of [18] playing central roles. The multi-species version of the problem was introduced and studied in [1], and the limit free energy for these models was proved in [6]; related developments include [2], [3], [19], [20]. Comparable results were obtained for spherical models in [21][23].

A common feature of the Parisi-formula results mentioned above is the convexity of the covariance function \(\xi\) on the relevant overlap domain, here \(\mathbb{R}_+^\mathscr{S}\). In the multi-species setting, this condition is restrictive, and when it is dropped the usual Parisi formula 8 is no longer valid in general; see [8]. Models with non-convex \(\xi\) are in general less well understood. Yet, under the assumption that the limit free energy exists, its value has been identified in [24], [25] for all spherical models in the case when \(\xi\) is a monomial. Still for spherical models, the case of \(|\mathscr{S}| = 2\) and \(\xi(x,y) = xy\) has been obtained unconditionally in [26], [27], and the cases of \(\xi(x,y) = x^p y^q\) and \(\xi(x_1,\ldots, x_D) = x_1 \cdots \, x_D\) have also been obtained unconditionally for special choices of the parameter \(\lambda_\infty\) in [9], [28]. In the latter works, the parameter \(\lambda_\infty\) needs to be specific in order to enforce additional symmetries, in which case the model is said to be balanced. In this theme, a Parisi formula for the constrained balanced Potts spin glass was proved in [29], by relating the free energy of the full model to that of a single-species model. Related reductions for vector spin glasses were obtained in [10].

Outside of these cases, even the formulation of a conjecture for the limit free energy of spin-glass models with non-convex \(\xi\) is a non-trivial task. Physicists usually only state that the limit free energy can be written in the form of \(\mathcal{J}_{t,0}(q',p)\) for some \((q',p)\) that is a critical point of \(\mathcal{J}_{t,0}\), but do not specify how to choose the critical point if it turns out that there are several (see for instance [30][33] in the case of the bipartite model). A precise version of the physicists’ statement was proved rigorously in [3] (see also [34] for corresponding results in the multi-species setting), but because of the ambiguity in the choice of the critical point, this result does not completely settle the question. A precise conjecture for the limit free energy was formulated in [8], [13], [14], [35], [36] in terms of the solution to a Hamilton–Jacobi equation; see also [11].

We stress again that the variational formula in 10 is invalid in general if we allow for a sufficiently strong external field, as was explained in [8]. Another conjecture, based on a very different “un-inverted” formula, has been explored in [37][40], but has so far only been verified for models with convex covariance function \(\xi\).

Let us stress that the convexity of \(\psi\) proved in Section 2 should be distinguished from another convexity property of the Parisi functional due to Auffinger and Chen [41]. The convexity needed in the present paper is a convexity of the cascade transform as a function of the path variable: for \(q_0,q_1\in\mathcal{Q}_1\) and \(\theta\in[0,1]\), it concerns the interpolation \((1-\theta)q_0+\theta q_1\). If one identifies a path \(q\) with the law of \(q(U)\), where \(U\) is a uniform random variable on \([0,1]\), then this interpolation corresponds to the optimal-transport interpolation between the two laws. In this sense, the result proved here is a transport (or displacement) convexity property of the centered Ising cascade transform. This is the convexity that is compatible with the Hamilton–Jacobi formulation: it allows the solution of 11 to be represented by the Hopf formula, and it is also what turns critical points of \(\mathcal{J}_{t,q}\) into minimizers in the \(q'\) variable. This transport convexity is different from the affine concavity shown in [41] and used to prove the uniqueness of the Parisi measure. There, the Parisi functional is viewed as a function of the probability measure itself, and the interpolation is the usual affine interpolation of measures. With our sign convention with a minus sign in the definition of the free energy, the result of [41] indeed states that the Parisi functional is affine concave; and unlike our transport convexity result, their affine concavity result is robust to the presence of an external field.

Organization of the paper. The rest of the paper is organized as follows. In Section 2, we define the function \(\psi_\circ\) appearing in 7 and show its convexity. In Section 3, we define the enriched free energy \(\overline{F}_N(t,q)\) for every \(q \in \mathcal{Q}_1^\mathscr{S}\) and present some regularity estimates for this function. In Section 4, when all the coordinates of \(\lambda_\infty\) are rational, we identify a vector spin-glass model whose free energy asymptotically coincides with that of the multi-species model that is our focus. In Section 5, we perform a number of cavity calculations on this vector model, which we then leverage in Section 6 in order to show Theorem 3, as announced around 12 . In Section 7, we use Hamilton–Jacobi equations in order to obtain a lower bound on the limit free energy. This is in the spirit of steps (1)-(2) of the sketch of proof above, but we first obtain such statements in the case of vector spin glasses, and we then prepare the ground for going back to the multi-species setting. In Section 8, we complete the derivation of the multi-species versions of the main results of Sections 6 and 7, and thereby also of our main result Theorem 1. In Section 9, we apply Theorem 1 to balanced models and show that, under a suitable comparison structure including the balanced multi-species models of [9], the value at \(q=0\) reduces to the free energy of an associated single-species model. In Appendix 10, we explain how to adapt the arguments and obtain the result discussed around 12 in a more general setting. Finally, Appendix 11 gives a brief alternative proof of the balanced-model reduction, based directly on Hamilton–Jacobi comparison rather than on the Hopf formula or Theorem 1.

2 Convexity of \(\psi\)↩︎

The goal of this section is to show the convexity of the function \(\psi\). Here we simply define \(\psi\) according to the formula 7 ; in the next section we will see that \(\psi\) is in fact the limit of \(\overline{F}_N(0,q)\) as \(N\) tends to infinity. So our goal here reduces to that of proving that \(\psi_\circ\) is convex. We will see a definition of \(\psi_\circ\) in terms of probability cascades in the next section, in Eq. 62 . Here we focus most of our attention on the case of paths \(q\) that take a finite number of distinct values. The advantage of doing so is that it gives us a clear algorithmic procedure for calculating \(\psi_\circ(q)\) in this case, which we can take as a definition of \(\psi_\circ\), and which is as follows. To start with, we give ourselves a Brownian motion \((B_t)_{t \geqslant 0}\), and for every \(t \geqslant 0\) and \(m \geqslant 0\), we define \[\label{e46T95m44t61} T_{m,t}f(x)= \begin{cases} \displaystyle \frac{1}{m}\log \mathbb{E}e^{m f(x+B_{2t})}, & m>0,\\[2mm] \displaystyle \mathbb{E}f(x+B_{2t}), & m=0. \end{cases}\tag{13}\] Fixing \(k \in \mathbb{N}\), we consider a path \(q\) of the form \[\label{e46def46q} q = \sum_{i = 0}^k q_i \mathbb{1}_{[m_i, m_{i+1})},\tag{14}\] where \[\label{e46m95i61} 0=m_0<m_1<\cdots<m_k<m_{k+1}=1,\tag{15}\] and \[\label{e46q95cone61} 0=q_{-1}\leqslant q_0<q_1<\cdots<q_k.\tag{16}\] For each such choice of \((m_i)\) and \((q_i)\), we define \[\label{e46f95k43161} f_{k+1}(x)=\phi(x):=\log \sum_{\sigma \in \{-1,1\}} 2^{-1} e^{\sigma x} = \log \cosh x,\tag{17}\] and then recursively \[\label{e46f95i61} f_i:=T_{m_i,q_i - q_{i-1}}f_{i+1}, \qquad \text{for}\quad i\in\{0,\dots,k\}.\tag{18}\] By definition, we set \(\psi_\circ(q)\) to be given by \[\label{eq:F-increment-form} \psi_\circ(q)=q_k-f_0(0).\tag{19}\] Naturally, the functions \((f_i)\) depend on the choice of \((m_i)\) and \((q_i)\), although we suppress it from the notation. This defines the function \(\psi_\circ\) on any element of \(\mathcal{Q}\) that takes a finite number of values. If we allow for repetitions in 16 , then there are multiple possible choices of \((m_i)\) and \((q_i)\) that yield the exact same path \(q\) through 14 . Yet, one can check that the procedure outlined above for defining \(\psi_\circ\) yields the same value regardless of the representation of the path we choose, since \(T_{m,0}\) is the identity map. This remark gives us a convenient way to compare the values of \(\psi_\circ\) at two different paths that both take finite values, since we can choose a single set of discretization points \((m_i)\) for both paths simultaneously. Using this observation, one can show the following classical result; we will give a self-contained proof below for the reader’s convenience.

Proposition 2 (Lipschitz continuity of \(\psi_\circ\)). For every \(q, q' \in \mathcal{Q}\) taking a finite number of values, we have \[|\psi_\circ(q) - \psi_\circ(q')| \leqslant|q-q'|_{L^1}.\] As a consequence, the mapping \(\psi_\circ\) can be extended to \(\mathcal{Q}_1\) by continuity.

The main result of this section is the following.

Proposition 3 (Convexity of \(\psi_\circ\)). For every \(q_0,q_1 \in \mathcal{Q}_1\) and \(\lambda\in[0,1]\), we have \[\psi_\circ((1-\lambda)q_0+\lambda q_1) \leqslant (1-\lambda)\psi_\circ(q_0)+\lambda\psi_\circ(q_1).\]

Since we simply take 7 as the definition of \(\psi\) here, an immediate consequence of the previous proposition is the following.

Corollary 1 (Convexity of \(\psi\)). For every \(q_0,q_1 \in \mathcal{Q}_1^\mathscr{S}\) and \(\lambda\in[0,1]\), we have \[\psi((1-\lambda)q_0+\lambda q_1) \leqslant (1-\lambda)\psi(q_0)+\lambda\psi(q_1).\]

The bulk of the work in this section is geared towards proving the following weaker version of Proposition 3.

Proposition 4. With \((m_i)\)’s fixed as in 15 , the map \[\label{e46convex46weak} \left\{ \begin{array}{rcl} \{(q_i) \,:\, 0<q_0<q_1<\cdots<q_k\} & \to & \mathbb{R}\\ (q_i) & \mapsto & \psi_\circ(q) = \psi_\circ \left( \sum_{i = 0}^k q_i \mathbb{1}_{[m_i, m_{i+1})} \right) \end{array} \right.\qquad{(1)}\] is convex.

For the most part, the discretization points \((m_i)\) are kept fixed, and thus we may at times think of \(q\) as being simply the vector \((q_i)\). Likewise, we at times identify the mapping \(\psi_\circ\) with that displayed in ?? ; for instance, an expression of the form \(\partial_{q_i} \psi_{\circ}\) refers to the derivative of the mapping in ?? with respect to \(q_i\).

Our strategy for proving Proposition 4 starts with the derivation of a relatively explicit expression for \(\partial_{q_i} \psi_\circ\). As will be shown, bounds on the resulting expression yield a proof of Proposition 2. Using also a monotonicity property that we borrow from [42], we will then be able to assert that the non-diagonal entries of the Hessian of \(\psi_\circ\) are nonpositive. We next show that all the row sums of the Hessian of \(\psi_\circ\) are nonnegative. These two properties imply that the Hessian of \(\psi_\circ\) is positive semidefinite, and thus yield the validity of Proposition 4. A density argument then completes the proof of Proposition 3, and thus also of Corollary 1.

2.1 Differentiating the recursion↩︎

In this subsection, we derive a convenient expression for the derivative of \(\psi_\circ\) or, more precisely, of the mapping in ?? with respect to \(q_i\). In order to state this result, we introduce some notation. Given \(t\geqslant 0\), a measurable function \(g : \mathbb{R}\to \mathbb{R}\) with at most linear growth at infinity, and a measurable function \(h : \mathbb{R}\to \mathbb{R}\) with at most exponential growth at infinity, we set \[\label{e46L95mtg61} \mathcal{L}_{g,t}h(x)= \frac{ \mathbb{E}\left[h(x+B_{2t})e^{g(x+B_{2t})}\right] }{ \mathbb{E}e^{g(x+B_{2t})} }.\tag{20}\] The operator \(\mathcal{L}_{g,t}\) is linear, it preserves the ordering of functions, and \[\label{eq:L-preserves-one} \mathcal{L}_{g,t}1=1.\tag{21}\] We introduce the shorthand \[\label{e46L95i61} \mathcal{L}_i:=\mathcal{L}_{m_i f_{i+1},\,q_i - q_{i-1}}, \qquad i\in\{0,\dots,k\},\tag{22}\] and use the following convention for compositions: \[\label{eq:L-composition-convention} \mathcal{L}_{a:b}h := \mathcal{L}_a\bigl(\mathcal{L}_{a+1}(\cdots(\mathcal{L}_bh)\cdots)\bigr), \qquad\text{if a\leqslant b,}\tag{23}\] and if \(a>b\), then \(\mathcal{L}_{a:b}\) is the identity operator. Finally, making the dependence on \(q\) explicit again, we define \[\label{eq:Ui-def-Lab} U_i(q) := \mathcal{L}_{0:i}[(f'_{i+1})^2](0), \qquad i\in\{0,\dots,k\}.\tag{24}\]

The main goal of this subsection is to show the following.

Proposition 5 (Expression for \(\partial_{q_i} \psi_\circ\)). For every \(i \in \{0, \ldots, k\}\), we have \[\partial_{q_i} \psi_\circ(q) = (m_{i+1} - m_i) U_i(q).\]

We start with the following lemma.

Lemma 1 (Cole–Hopf differentiation). Let \(g : \mathbb{R}\to \mathbb{R}\) be a twice differentiable function with \(g\) of at most linear growth and \(g'\), \(g''\) of at most exponential growth, and let \(m \geqslant 0\). For every \(t \geqslant 0\) and \(x \in \mathbb{R}\), let \(u(t,x)=T_{m,t}g(x)\). We have \[\label{eq:HC-space-derivative} \partial_x u=\mathcal{L}_{mg,t}g',\tag{25}\] \[\label{eq:HC-time-derivative} \partial_t u =\partial_x^2 u+m (\partial_x u)^2 =\mathcal{L}_{mg,t}\bigl(g''+m(g')^2\bigr),\tag{26}\] and \[\label{eq:HC-variation} \left. \frac{d}{d\varepsilon} T_{m,t}(g+\varepsilon h)(x) \right|_{\varepsilon=0} = \mathcal{L}_{mg,t}h(x).\tag{27}\]

Proof. Using the growth assumptions on \(g\), \(g'\) and \(g''\), we see that the weight \(e^{mg}\) and its products with \(g'\), \(g''\) and \((g')^2\) grow at most exponentially and are thus integrable against the Gaussian law of \(B_{2t}\), locally uniformly in \(x\). We may therefore differentiate all the expectations below under the integral sign without further comment.

We first treat the case \(m>0\), and abbreviate \(\mathcal{L}=\mathcal{L}_{mg,t}\). Set \[H(t,x)=\mathbb{E}\,e^{mg(x+B_{2t})}, \qquad\text{so that}\qquad u=\tfrac1m\log H, \quad\text{i.e.}\quad H=e^{mu}.\] Since \(B_{2t}\) has variance \(2t\), the function \(H\) is the convolution of \(e^{mg}\) with the Gaussian heat kernel, and therefore solves the heat equation \(\partial_t H=\partial_x^2 H\).

Space derivative. Differentiating \(H\) in \(x\) and recalling the definition 20 of \(\mathcal{L}\), \[\partial_x H=m\,\mathbb{E}\bigl[g'(x+B_{2t})\,e^{mg(x+B_{2t})}\bigr]=mH\,\mathcal{L} g'.\] On the other hand, \(H=e^{mu}\) gives \(\partial_x H=mH\,\partial_x u\). Comparing the two expressions yields \(\partial_x u=\mathcal{L} g'\), which is 25 .

Time derivative. By the heat equation and \(u=\tfrac1m\log H\), we have \[\partial_t u=\frac{\partial_t H}{mH}=\frac{\partial_x^2 H}{mH},\] so it remains to compute \(\partial_x^2 H\). Differentiating the relation \(\partial_x H=mH\,\partial_x u\) once more in \(x\) gives \[\partial_x^2 H=mH\bigl(\partial_x^2 u+m(\partial_x u)^2\bigr),\] whereas differentiating the expression \(\partial_x H=m\,\mathbb{E}[g'(x+B_{2t})\,e^{mg(x+B_{2t})}]\) gives \[\partial_x^2 H=m\,\mathbb{E}\bigl[\bigl(g''+m(g')^2\bigr)(x+B_{2t})\,e^{mg(x+B_{2t})}\bigr]=mH\,\mathcal{L}\bigl(g''+m(g')^2\bigr).\] Dividing each of these by \(mH\) and recalling that \(\partial_t u=\partial_x^2 H/(mH)\), we obtain \[\partial_t u=\partial_x^2 u+m(\partial_x u)^2=\mathcal{L}\bigl(g''+m(g')^2\bigr),\] which is 26 .

Variation formula. Differentiating \(\varepsilon\mapsto\tfrac1m\log\mathbb{E}\,e^{m(g+\varepsilon h)(x+B_{2t})}\) at \(\varepsilon=0\) gives \[\left.\frac{d}{d\varepsilon}T_{m,t}(g+\varepsilon h)(x)\right|_{\varepsilon=0} =\frac{\mathbb{E}\bigl[h(x+B_{2t})\,e^{mg(x+B_{2t})}\bigr]}{\mathbb{E}\,e^{mg(x+B_{2t})}} =\mathcal{L} h(x),\] which is 27 .

The case \(m=0\). Here \(u(t,x)=\mathbb{E}\,g(x+B_{2t})\), and \(\mathcal{L}_{0,t}\) is the plain Gaussian average \(h\mapsto\mathbb{E}\,h(\,\cdot\,+B_{2t})\). Differentiating under the expectation gives \(\partial_x u=\mathbb{E}\,g'(x+B_{2t})=\mathcal{L}_{0,t}g'\), which is 25 . Moreover, the function \(u\) is now the convolution of \(g\) with the heat kernel, so it solves the heat equation; this gives \(\partial_t u=\partial_x^2 u=\mathbb{E}\,g''(x+B_{2t})=\mathcal{L}_{0,t}g''\), which is 26 . Finally, \(\frac{d}{d\varepsilon}\big|_{\varepsilon=0}\mathbb{E}\,(g+\varepsilon h)(x+B_{2t})=\mathbb{E}\,h(x+B_{2t})=\mathcal{L}_{0,t}h(x)\), which is 27 . ◻

Applying the formula 25 to the recursion 18 yields the following identity, which we will use to prove Proposition 2. We recall that the operator \(\mathcal{L}_i\) is defined in 22 .

Lemma 2 (Derivative recursion). For each \(j\in\{0,\dots,k\}\), the derivatives of the recursion 18 satisfy \[\label{eq:derivative-recursion} f'_j=\mathcal{L}_jf'_{j+1}.\tag{28}\] Consequently, \(f'_j=\mathcal{L}_{j:k}f'_{k+1}=\mathcal{L}_{j:k}\phi'\), and \(|f'_j|\leqslant 1\) for all \(j\in\{0,\dots,k+1\}\).

Proof. We fix \(j\in\{0,\dots,k\}\) and apply Lemma 1 with \(u=f_j=T_{m_j,t_j}f_{j+1}\), \(g=f_{j+1}\), \(m=m_j\), \(t=t_j\). The spatial-derivative formula 25 gives \[f'_j=\partial_x u=\mathcal{L}_{m_j f_{j+1},\,t_j}f'_{j+1}\stackrel{\eqref{e46L95i61}}{=}\mathcal{L}_jf'_{j+1},\] which is 28 . Iterating 28 and using the composition convention 23 gives \(f'_j=\mathcal{L}_{j:k}f'_{k+1}\), with \(f'_{k+1}=\phi'\) by 17 .

For the bound, recall from 17 that \(f'_{k+1}=\phi'=\tanh\), so \(|f'_{k+1}|\leqslant 1\). Each \(\mathcal{L}_j\) is a positive linear operator with \(\mathcal{L}_j1=1\) by 21 ; hence it is order-preserving and \(|\mathcal{L}_jh|\leqslant\mathcal{L}_j|h|\leqslant\sup|h|\) for any bounded \(h\). Therefore \(|f'_{j+1}|\leqslant 1\) implies \(|f'_j|=|\mathcal{L}_jf'_{j+1}|\leqslant 1\), and downward induction gives \(|f'_j|\leqslant 1\) for all \(j\). ◻

Proof of Proposition 5. We decompose the proof into two steps.

Step 1. For convenience, we change variables and use \[\label{e46def46ti} t_i=q_i-q_{i-1}, \qquad i\in\{0,\dots,k\}.\tag{29}\] Again abusing notation, we write \(\partial_{t_i} \psi_\circ\) to denote the derivative of the mapping in ?? , but seen as a function of the \((t_j)\) rather than of the \((q_j)\). We also set \[\label{e46A95i61} A_i=f_i''+m_i(f_i')^2, \qquad i\in\{0,\dots,k+1\}.\tag{30}\] In this first step, we show that for every \(i \in \{0, \ldots, k\}\), we have \[\label{e46drt46psi} \frac{\partial f_0(0)}{\partial t_i}=\bigl(\mathcal{L}_{0:i-1}A_i\bigr)(0).\tag{31}\] In order to compute this derivative, we denote, for any sufficiently small \(\varepsilon\), \[t_i^\varepsilon=t_i+\varepsilon \qquad\text{and}\qquad t_r^\varepsilon=t_r\quad \text{for r\neq i},\] and we let \(f_r^\varepsilon\) be the recursion obtained from the perturbed increments: \[f_{k+1}^\varepsilon=\phi\qquad\text{and}\qquad f_r^\varepsilon = T_{m_r,t_r^\varepsilon}f_{r+1}^\varepsilon \quad\text{for r\in\{0,\dots,k\}}.\] Define \[\begin{align} \label{e46D95r61} D_r(x) = \left. \frac{d}{d\varepsilon}f_r^\varepsilon(x) \right|_{\varepsilon=0}\qquad\text{for r\in\{0,\dots,k\}}. \end{align}\tag{32}\]

First, for \(r\geqslant i+1\), the function \(f_r^\varepsilon\) is unchanged. Indeed, the recursion defining \(f_r\) uses only the interval lengths \(t_r,t_{r+1},\ldots,t_k\), and none of these equals \(t_i\). Hence, we have \(f_r^\varepsilon=f_r\) for \(r\geqslant i+1\). At level \(i\), the input function \(f_{i+1}\) is therefore fixed, so \(f_i^\varepsilon =T_{m_i,t_i+\varepsilon}f_{i+1}\), and thus \[\begin{align} \label{e46D95i61A95i} D_i = \left. \frac{d}{d\varepsilon} T_{m_i,t_i+\varepsilon}f_{i+1} \right|_{\varepsilon=0} \stackrel{\eqref{eq:HC-time-derivative}}{=} f_i''+m_i(f_i')^2 \stackrel{\eqref{e46A95i61}}{=} A_i. \end{align}\tag{33}\]

Now take \(r<i\). At this level, the time parameter \(t_r\) is fixed. The only dependence on \(\varepsilon\) comes through the input function \(f_{r+1}^\varepsilon\): \[f_r^\varepsilon = T_{m_r,t_r}f_{r+1}^\varepsilon.\] Since \(f_{r+1}^\varepsilon=f_{r+1}+\varepsilon D_{r+1}+o(\varepsilon)\), we may apply the variation formula 27 with \(g=f_{r+1}\), \(h=D_{r+1}\), \(m=m_r\), \(t=t_r\) to obtain \[D_r = \mathcal{L}_{m_r f_{r+1},\,t_r}D_{r+1} = \mathcal{L}_rD_{r+1}, \qquad r=i-1,i-2,\ldots,0.\] Iterating this and using 33 , we get \(D_0=\mathcal{L}_0\mathcal{L}_1\cdots\mathcal{L}_{i-1}A_i\stackrel{\eqref{eq:L-composition-convention}}{=}\mathcal{L}_{0:i-1}A_i\). Since \(\frac{\partial f_0(0)}{\partial t_i}=D_0(0)\) due to 32 , we can conclude \(\frac{\partial f_0(0)}{\partial t_i}=\bigl(\mathcal{L}_{0:i-1}A_i\bigr)(0)\) as desired.

Step 2. We now proceed to complete the proof of the proposition. To lighten notation, we set \[\delta_i=m_{i+1}-m_i, \qquad i\in\{0,\dots,k\}.\] By 30 and the second relation in 26 , we have \[A_i = \mathcal{L}_i\bigl(f_{i+1}''+m_i(f_{i+1}')^2\bigr),\] and thus \[f_{i+1}''+m_i(f_{i+1}')^2 = A_{i+1}-\delta_i(f_{i+1}')^2.\] Combining the above two displays, we get \[\label{eq:A-recursion} A_i = \mathcal{L}_iA_{i+1} - \delta_i\mathcal{L}_i[(f_{i+1}')^2].\tag{34}\]

The terminal condition \(\phi(x)=\log\cosh x\) satisfies \(\phi'(x)=\tanh x\) and \(\phi''(x)=\cosh^{-2} (x)\). Since \(m_{k+1}=1\) as in 15 , we have \[\label{e46A95k431611} A_{k+1} = \phi''+(\phi')^2 = \cosh^{-2}(x) +\tanh^2(x) =1.\tag{35}\] Since every \(\mathcal{L}_i\) preserves constants by 21 , iteration of 34 gives \[\label{eq:A-expansion} A_i = 1- \sum_{r=i}^k \delta_r \bigl(\mathcal{L}_{i:r}[(f_{r+1}')^2]\bigr).\tag{36}\] Using the result 31 from the previous step, we write \[\frac{\partial f_0(0)}{\partial t_i} = \bigl(\mathcal{L}_{0:i-1}A_i\bigr)(0)\stackrel{\eqref{eq:A-expansion}}{=} 1- \sum_{r=i}^k\delta_r \bigl(\mathcal{L}_{0:i-1}\mathcal{L}_{i:r}[(f_{r+1}')^2]\bigr)(0) \stackrel{\eqref{eq:Ui-def-Lab}}{=} 1- \sum_{r=i}^k\delta_r U_r(q).\] Using this and 19 , we get \[\label{eq:t-gradient-formula} \frac{\partial \psi_\circ}{\partial t_i} = \sum_{r=i}^k \delta_r U_r(q).\tag{37}\] Since \(t_i=q_i-q_{i-1}\), we have \(\frac{\partial}{\partial q_k}=\frac{\partial}{\partial t_k}\) and \(\frac{\partial}{\partial q_i}=\frac{\partial}{\partial t_i}-\frac{\partial}{\partial t_{i+1}}\) for \(i\in\{0,\dots,k-1\}\). By 37 , we get \[\frac{\partial \psi_\circ}{\partial q_k}=\frac{\partial \psi_\circ}{\partial t_k}=\delta_kU_k \qquad \text{and}\qquad \frac{\partial \psi_\circ}{\partial q_i}=\sum_{r=i}^k \delta_rU_r-\sum_{r=i+1}^k \delta_rU_r=\delta_iU_i \quad\text{for i\in\{0,\dots,k-1\}}\] as announced. ◻

Proof of Proposition 2. Let \(q,q'\in\mathcal{Q}\) take finitely many values. As explained in the paragraph below 19 , we may choose a common set of discretization points \(0=m_0<m_1<\cdots<m_{k+1}=1\) such that \[q=\sum_{i=0}^kq_i\mathbb{1}_{[m_i,m_{i+1})}, \qquad q'=\sum_{i=0}^kq'_i\mathbb{1}_{[m_i,m_{i+1})},\] with \(0\leqslant q_0\leqslant\cdots\leqslant q_k\) and \(0\leqslant q'_0\leqslant\cdots\leqslant q'_k\). We have \[\label{e46lip46psi46L1} |q-q'|_{L^1}=\sum_{i=0}^k(m_{i+1} - m_i)\,|q_i-q'_i|.\tag{38}\] Identifying a finite-valued path with the vector of its values, we regard \(\psi_\circ\) as a function on the cone \(\{0\leqslant q_0\leqslant\cdots\leqslant q_k\}\) via the recursion 1819 .

We first prove the bound when \(q\) and \(q'\) both lie in the open cone \(\{0<q_0<\cdots<q_k\}\). There, by Proposition 5, the function \(\psi_\circ\) is differentiable with \[\partial_{q_i} \psi_\circ=(m_{i+1} - m_i)\,U_i(q), \qquad i\in\{0,\dots,k\},\] where \(U_i(q)=\bigl(\mathcal{L}_{0:i}[(f'_{i+1})^2]\bigr)(0)\) as in 24 . By Lemma 2, we have \(|f'_j|\leqslant 1\) for all \(j\), so \(0\leqslant(f'_{i+1})^2\leqslant 1\). Since each \(\mathcal{L}_j\) is a positive operator with \(\mathcal{L}_j1=1\), applying \(\mathcal{L}_{0:i}\) and evaluating at \(0\) gives \[0\leqslant U_i(q)\leqslant 1, \qquad\text{so that}\qquad 0\leqslant\partial_{q_i} \psi_\circ \leqslant m_{i+1}-m_i.\] The open cone is convex, so the segment \(q_\theta:=(1-\theta)q'+\theta q\), \(\theta\in[0,1]\), remains in it. By the fundamental theorem of calculus, \[\psi_\circ(q)-\psi_\circ(q') =\int_0^1\sum_{i=0}^k\partial_{q_i} \psi_\circ(q_\theta)\,(q_i-q'_i)\,\mathrm{d}\theta,\] and therefore, using \(0\leqslant\partial_{q_i} \psi_\circ \leqslant m_{i+1}-m_i\) together with 38 , we obtain that \[|\psi_\circ(q)-\psi_\circ(q')| \leqslant\sum_{i=0}^k(m_{i+1} - m_i)\,|q_i-q'_i| =|q-q'|_{L^1}.\] Both sides above are continuous in \((q_0,\dots,q_k)\) on the closed cone; for the left-hand side this is clear from 19 and the continuity of \((q_i)\mapsto f_0(0)\), recalling that \(T_{m,0}\) is the identity map. Since the open cone is dense in the closed cone, the inequality extends to all \(q,q'\) taking finitely many values. Finally, paths taking finitely many values are dense in \(\mathcal{Q}_1\) for the \(L^1\) norm, so \(\psi_\circ\) admits a (unique, \(1\)-Lipschitz) extension to \(\mathcal{Q}_1\) satisfying the same bound. ◻

2.2 The monotonicity input↩︎

We will next appeal to some results from the finite-step analysis of the Parisi functional in [42]. We first isolate the consequence that will be used in the sequel, and then restate the result from [42] from which it follows. We define \[\begin{align} \mathcal{C}&=\left\{g:\mathbb{R}\to[0,\infty):g(-x)=g(x),\;g'(x)\geqslant 0\text{ for }x\geqslant 0\right\}, \\ \mathcal{C}'&=\left\{g:\mathbb{R}\to\mathbb{R}:g(-x)=-g(x),\;g'(x)\geqslant 0\text{ for }x\geqslant 0\right\}. \end{align}\]

Lemma 3. The following holds.

  1. For every \(i \in \{0, \ldots, k+1\}\), the function \(f_i\) is convex and even, and \(f_i'\in\mathcal{C}'\).

  2. For every \(i\in\{0,\ldots,k\}\), the operator \(\mathcal{L}_i\) sends \(\mathcal{C}\) into \(\mathcal{C}\).

  3. For every \(i,j \in \{0, \ldots, k\}\), the quantity \(U_i(q)\) (seen as a function of the \((q_l)\) and \((m_l)\)) is nondecreasing in the mass coordinate \(m_j\).

Lemma 3 is essentially a restatement of the following results from [42].

Theorem 2 ([42]). Let \[0=m_0\leqslant m_1\leqslant\cdots\leqslant m_K=1\qquad\text{and}\qquad 0=\widehat q_0\leqslant\widehat q_1\leqslant\cdots\leqslant\widehat q_K\leqslant\widehat q_{K+1}=1.\] Let \(\Phi\) and \(\xi\) be smooth, convex, even functions, with \(\Phi\) of moderate growth. Let \(z_0,\ldots,z_K\) be independent centered Gaussian random variables with \[\label{e46Ez94295r61} \mathbb{E}z_r^2=\xi'(\widehat q_{r+1})-\xi'(\widehat q_r).\tag{39}\] Define \(\Phi_{K+1}=\Phi\) and, recursively, \[\label{e46Phi95r61} \Phi_r(x) = \begin{cases} \displaystyle \frac{1}{m_r} \log \mathbb{E}_{z_r}e^{m_r\Phi_{r+1}(x+z_r)}, & m_r>0,\\[2mm] \displaystyle \mathbb{E}_{z_r}\Phi_{r+1}(x+z_r), & m_r=0. \end{cases}\tag{40}\] Here \(\mathbb{E}_{z_r}\) denotes expectation over \(z_r\) only. Put \[\label{e46V95r61} V_r(x,z_r) = e^{m_r(\Phi_{r+1}(x+z_r)-\Phi_r(x))}.\tag{41}\] For an external field \(h\in\mathbb{R}\), define \[\label{e46Z} Z=h+z_0+\cdots+z_K, \qquad Z_r=h+z_0+\cdots+z_{r-1}, \qquad\text{and}\quad W_r=V_r(Z_r,z_r).\tag{42}\] For \(1\leqslant l\leqslant K\), set \[\label{eq:panchenko-U} U_l^{\mathrm P} = \mathbb{E}\left[ W_1\cdots W_{l-1} \left( \mathbb{E}\left[W_l\cdots W_K\Phi'(Z) \mid z_0,\ldots,z_{l-1}\right] \right)^2 \right].\tag{43}\] Then \(U_l^{\mathrm P}\) is nondecreasing in each mass coordinate \(m_j\), for each \(j\in\{1,\dots,K\}\).

Moreover, each \(\Phi_r\) is convex and even, \(\Phi_r'\in\mathcal{C}'\), and the map \[\label{eq:panchenko-tilted-class-operator} g\mapsto \mathbb{E}_{z_r}V_r(x,z_r)g(x+z_r)\tag{44}\] sends \(\mathcal{C}\) into \(\mathcal{C}\) and sends \(\mathcal{C}'\) into \(\mathcal{C}'\).

The monotonicity of \(U^\mathrm{P}_l\) is the content of [42] and the last part is extracted from [42]. For the applications here, we always set \(h=0\) in 42 .

Proof of Lemma 3. Theorem 2 is normalized so that the largest endpoint is \(1\). To apply it here, we fix \(Q>q_k\) and set \[p_0=0,\qquad p_{r+1}=q_r\;\text{ for }r\in\{0,\dots,k\},\qquad \text{and}\quad p_{k+2}=Q.\] We take \(K=k+1\), set \(\widehat q_r=p_r/Q\) for \(r\in\{0,\ldots,k+2\}\), keep the masses \(m_0,\ldots,m_{k+1}\), choose \(\xi(s)=Qs^2\), and take the terminal function in Theorem 2 to be \(\Phi=\phi\). Then, by 39 , \[\label{e46compar95var} \xi'(\widehat q_{r+1})-\xi'(\widehat q_r)=2(p_{r+1}-p_r),\tag{45}\] so that, for \(r\leqslant k\), the Gaussian increment \(z_r\) has the same law as \(B_{2(q_r-q_{r-1})}\).

The only additional interval is \([q_k,Q]\), with mass \(m_{k+1}=1\). It does not change the quantities of interest, since \[\label{eq:T1-terminal-constant} T_{1,Q-q_k}\phi(x)=\log\mathbb{E}\cosh(x+B_{2(Q-q_k)})=\phi(x)+(Q-q_k).\tag{46}\] Thus the functions \(\Phi_i\) generated by 40 satisfy \[\Phi_i=f_i+Q-q_k,\qquad i\in\{0,\ldots,k+1\}.\] In particular, \(\Phi_i'=f_i'\) for these indices. The convexity and parity assertions for the \(f_i\)’s therefore follow directly from Theorem 2.

For the tilted operators, the additive constant cancels from 41 . Using 45 , we get, for \(i\in\{0,\ldots,k\}\), \[\mathbb{E}_{z_i}V_i(x,z_i)g(x+z_i) =\frac{\mathbb{E}\left[g(x+B_{2(q_i-q_{i-1})})e^{m_i f_{i+1}(x+B_{2(q_i-q_{i-1})})}\right]}{\mathbb{E}e^{m_i f_{i+1}(x+B_{2(q_i-q_{i-1})})}} =\mathcal{L}_i g(x).\] Thus each operator \(\mathcal{L}_i\), for \(i\in\{0,\ldots,k\}\), sends \(\mathcal{C}\) into \(\mathcal{C}\) by Theorem 2.

It remains to identify our \(U_i\) with the quantity \(U_i^{\mathrm P}\) from Theorem 2. Differentiating 40 gives \[\Phi_r'(x)=\mathbb{E}_{z_r}\left[V_r(x,z_r)\Phi_{r+1}'(x+z_r)\right].\] Iterating this identity from \(r=i+1\) to \(K\) gives \[\Phi_{i+1}'(Z_{i+1}) = \mathbb{E}\left[W_{i+1}\cdots W_K\Phi'(Z)\mid z_0,\ldots,z_i\right].\] Using the preceding identification of the tilted operators for the steps \(0,\ldots,i\), and recalling that \(W_0=1\) because \(m_0=0\), we obtain \[U_i(q) =\mathbb{E}\left[W_0\cdots W_i\left(\Phi_{i+1}'(Z_{i+1})\right)^2\right] =U^{\mathrm P}_{i+1}.\] The monotonicity of \(U_i(q)\) in each mass coordinate now follows from the monotonicity of \(U^{\mathrm P}_{i+1}\) in Theorem 2. ◻

2.3 Sign structure of the Hessian↩︎

For every \(q\) in the open cone \(\{0 < q_0 < \cdots < q_k\}\), we consider the Hessian \(H(q) = (H_{ij}(q))\) of \(\psi_\circ\) at \(q\), that is, \[\label{eq:Hessian-def} H_{ij} = \partial_{q_i} \partial_{q_j} \psi_\circ \stackrel{\text{P.\ref{p46drq46psi}}}{=} (m_{i+1} - m_i)\partial_{q_j} U_i \qquad (i,j \in \{0, \ldots, k\}).\tag{47}\]

Lemma 4 (Off-diagonal signs). For every \(i\ne j \in \{0,\ldots, k\}\), we have \(H_{ij}\leqslant 0\).

Proof. Being a Hessian, \(H(q)\) is symmetric, so it suffices to treat the case \(i<j\). Since \(m_{i+1}-m_i>0\), identity 47 reduces the bound \(H_{ij}\leqslant 0\) to \[\label{e46dU47dq600} \partial_{q_j} U_i\leqslant 0,\qquad i<j.\tag{48}\] Fix such a pair \(i<j\), and write \(e_j\) for the \(j\)-th standard basis vector of \(\mathbb{R}^{k+1}\). It suffices to show that \(U_i(q+\varepsilon e_j)\leqslant U_i(q)\) for all sufficiently small \(\varepsilon>0\): dividing by \(\varepsilon\) and letting \(\varepsilon\downarrow0\) then gives 48 . The mechanism is that displacing the single breakpoint \(q_j\) to the right amounts, once both paths are recorded on a common refinement, to lowering one mass coordinate, to which the monotonicity of Lemma 3 [lem:panchenko40341] applies.

Step 1: a common refinement. The recursion 18 defining the functions \(f_l\), and hence the quantities \(U_i\), depends on a path only through the mass attached to each spatial interval, and not on the particular breakpoints used to record it. Indeed, subdividing an interval into two adjacent pieces carrying the same mass \(m\) replaces a single step \(T_{m,a+b}\) of the recursion by two consecutive steps \(T_{m,a}T_{m,b}\), and these coincide: \[\label{e46semigroup46T} T_{m,a}T_{m,b}=T_{m,a+b}\qquad(m\geqslant 0),\tag{49}\] as one checks directly from 13 . We may therefore evaluate \(U_i\) at \(q\) and at \(q^\varepsilon:=q+\varepsilon e_j\) from any single list of breakpoints that represents both paths.

Assume first that \(j<k\), and take \(\varepsilon>0\) small enough that \(q_j+\varepsilon<q_{j+1}\), so that \(q^\varepsilon\) still lies in the open cone. Inserting the point \(q_j+\varepsilon\) among the breakpoints of \(q\) (or, equivalently, the point \(q_j\) among those of \(q^\varepsilon\)) produces the common list \[(q_0,\ldots,q_{j-1},\,q_j,\,q_j+\varepsilon,\,q_{j+1},\ldots,q_k),\] which represents both paths. On this list the two paths attach the same mass to every interval except \([q_j,q_j+\varepsilon]\): for \(q\) this interval is part of \([q_j,q_{j+1}]\) and carries mass \(m_{j+1}\), whereas for \(q^\varepsilon\) it is part of \([q_{j-1},q_j+\varepsilon]\) and carries mass \(m_j\). Since \(m_j<m_{j+1}\), passing from \(q\) to \(q^\varepsilon\) lowers exactly one mass coordinate—the mass on \([q_j,q_j+\varepsilon]\), from \(m_{j+1}\) down to \(m_j\)—and leaves all the others unchanged. The two representations are shown below.

Figure 1: image.

Step 2: monotonicity in the mass. Because \(i<j\), the breakpoint \(q_i\) lies strictly to the left of the modified interval \([q_j,q_j+\varepsilon]\). For a single fixed path, subdividing intervals that lie to the right of \(q_i\) leaves \(U_i=\mathcal{L}_{0:i}[(f'_{i+1})^2](0)\) unchanged: by the semigroup identity 49 it alters neither the operators \(\mathcal{L}_0,\ldots,\mathcal{L}_i\) nor the function \(f_{i+1}\) entering this expression. Consequently, we can view \(U_i(q)\) and \(U_i(q^\varepsilon)\) as two values of one and the same function, namely the quantity \(U_i\) attached to the common refined list and regarded as a function of its mass coordinates, but evaluated at the masses of \(q\) and of \(q^\varepsilon\) respectively. By Step 1 these two assignments share every coordinate but one: the mass on \([q_j,q_j+\varepsilon]\), which equals \(m_{j+1}\) for \(q\) and \(m_j\) for \(q^\varepsilon\).

Let us write \(g(\mu)\) for the value of this function when the mass on \([q_j,q_j+\varepsilon]\) is set to \(\mu\) and all the other coordinates are held fixed, so that \(g(m_{j+1})=U_i(q)\) and \(g(m_j)=U_i(q^\varepsilon)\). For \(\mu\in(m_j,m_{j+1})\) the masses of the refined list are strictly ordered, so Lemma 3 [lem:panchenko40341] applies and shows that \(g\) is nondecreasing on this interval; since \(g\) is moreover continuous (the operators \(T_{m,t}\) depend continuously on \(m\)), it follows that \(g(m_j)\leqslant g(m_{j+1})\), that is, \(U_i(q^\varepsilon)\leqslant U_i(q)\). This proves 48 when \(j<k\).

It remains to treat \(j=k\). Here \(q_k\) is the last breakpoint, so we first make room to its right. Fix \(Q>q_k+\varepsilon\) and append the terminal interval \([q_k,Q]\) with mass \(m_{k+1}=1\), exactly as in the proof of Lemma 3. By 46 this adds the constant \(Q-q_k\) to every \(f_l\), hence leaves all the derivatives \(f_l'\), and with them every \(U_i\), unchanged. With the terminal interval in place, \(q_k\) is no longer last, and Steps 1 and 2 apply verbatim to the common list \[(q_0,\ldots,q_{k-1},\,q_k,\,q_k+\varepsilon,\,Q):\] on it the interval \([q_k,q_k+\varepsilon]\) carries mass \(1\) for \(q\) and mass \(m_k\) for \(q^\varepsilon\), so moving \(q_k\) to \(q_k+\varepsilon\) again lowers a single mass coordinate, this time from \(1\) to \(m_k\). Arguing as in Step 2 then gives \(U_i(q+\varepsilon e_k)\leqslant U_i(q)\) for \(i<k\), which is 48 for \(j=k\). The proof is thus complete. ◻

Lemma 5 (Nonnegative row sums). For every \(i\in\{0,\dots,k\}\), we have \(\sum_{j=0}^k H_{ij}\geqslant 0\).

Proof. For convenience, we denote by \(P_t:=T_{0,t} = \mathcal{L}_{0,t}\) the heat semigroup with Brownian variance \(2t\), so that \[P_tf(x)=\mathbb{E}f(x+B_{2t}).\] We set \(\mathbb{1}=(1,\ldots,1)\in\mathbb{R}^{k+1}\). The \(i\)-th row sum is the directional derivative of \(\partial_{q_i} \psi_\circ\) in the direction \(\mathbb{1}\). By Proposition 5, we have \[\label{eq:row-sum-directional} \sum_{j=0}^k H_{ij} = (m_{i+1} - m_i) \left. \frac{\mathrm{d}}{\mathrm{d}\varepsilon} U_i(q+\varepsilon\mathbb{1}) \right|_{\varepsilon=0}.\tag{50}\] We set \(q^\varepsilon:=q+\varepsilon\mathbb{1}\). In the notation \((t_i)\) from 29 , we see that \[t_0^\varepsilon=t_0+\varepsilon, \qquad \text{and}\qquad t_r^\varepsilon=t_r\quad \text{for r\geqslant 1}.\] Therefore the functions \(f_r\) for \(r\geqslant 1\) are unchanged, because their recursion uses only \(t_r,t_{r+1},\ldots,t_k\). Likewise the operators \(\mathcal{L}_1,\ldots,\mathcal{L}_i\) are unchanged. Only \(\mathcal{L}_0\) changes, and since \(m_0=0\) it changes from \(P_{t_0}\) to \(P_{t_0+\varepsilon}\).

For the original value of \(q\), set \(R_i= \mathcal{L}_{1:i}[(f_{i+1}')^2]\) for \(i\in\{0,\dots,k\}\). By our convention, we have \(R_0 = (f_1')^2\). Then, in view of 24 , we have \(U_i(q)=P_{t_0}R_i(0)\). By the preceding paragraph, the same \(R_i\) is used for \(q^\varepsilon\), and thus \[U_i(q+\varepsilon\mathbb{1}) = P_{t_0+\varepsilon}R_i(0) = P_\varepsilon G_i(0), \qquad \text{where}\quad G_i:=P_{t_0}R_i.\] Here the last equality uses the heat semigroup property \(P_{t_0+\varepsilon}=P_\varepsilon P_{t_0}\).

By Lemma 3 [lem:panchenko40141], we have \(f_{i+1}'\in\mathcal{C}'\) and thus \((f_{i+1}')^2\in\mathcal{C}\). Since \(\mathcal{L}_r\) preserve \(\mathcal{C}\) by Lemma 3 [lem:panchenko40241] and the heat semigroup \(P_{t_0}\) also preserves \(\mathcal{C}\), we have \(G_i\in\mathcal{C}\). Hence \(G_i\) is even and nondecreasing in \(|x|\).

Let \(Z\) be a standard Gaussian random variable. We have \[\label{eq:heat-monotone-epsilon} P_\varepsilon G_i(0) = \mathbb{E}G_i(\sqrt{2\varepsilon}\,Z) = \mathbb{E}G_i(\sqrt{2\varepsilon}\,|Z|).\tag{51}\] Since \(G_i(r)\) is nondecreasing for \(r\geqslant 0\), the right-hand side of 51 is nondecreasing in \(\varepsilon\). Therefore, we conclude \(\left.\frac{\mathrm{d}}{\mathrm{d}\varepsilon}U_i(q+\varepsilon\mathbb{1})\right|_{\varepsilon=0}\geqslant 0\). Using also 50 , we obtain that \(\sum_{j=0}^k H_{ij}\geqslant 0\), as desired. ◻

Lemma 6. Let \(H\) be a real symmetric matrix. Suppose \(H_{ij}\leqslant 0\) for \(i\ne j\) and \(\sum_j H_{ij}\geqslant 0\) for every \(i\). Then \(H\) is positive semidefinite.

Proof. For every vector \(a=(a_i)\), we have \[a^\top Ha = \sum_i \left(\sum_jH_{ij}\right)a_i^2 + \sum_{i<j} (-H_{ij})(a_i-a_j)^2.\] Since both terms in the display are nonnegative under the assumptions, the matrix \(H\) is positive semidefinite. ◻

Proof of Proposition 4. The map in ?? is smooth, and its Hessian \(H\) is given by 47 . This Hessian is symmetric, with nonpositive off-diagonal entries by Lemma 4 and nonnegative row sums by Lemma 5. By Lemma 6, it is positive semidefinite, and thus the map is convex. ◻

We can now deduce the convexity of \(\psi_\circ\) on all of \(\mathcal{Q}_1\). The first step is to upgrade the convexity on the open cone of Proposition 4 to convexity on the closed cone, which is where the convex combinations of finitely-valued paths naturally live.

Proof of Proposition 3. We first observe that, for any fixed discretization points \(0=m_0<m_1<\cdots<m_{k+1}=1\), the map \((q_i)\mapsto\psi_\circ(q)\) is convex on the closed cone \(\{0\leqslant q_0\leqslant\cdots\leqslant q_k\}\). Indeed, it is convex on the open cone from Proposition 4; it is continuous on the closed cone; and the open cone is dense in the closed cone.

Now let \(q_0,q_1\in\mathcal{Q}_1\) and \(\lambda\in[0,1]\). By Proposition 2, \(\psi_\circ\) is continuous on \(\mathcal{Q}_1\), and paths taking finitely many values are dense in \(\mathcal{Q}_1\) for the \(L^1\) norm. It therefore suffices to prove the claimed inequality when \(q_0\) and \(q_1\) take finitely many values. As in the proof of Proposition 2, we may then choose a common set of discretization points \(0=m_0<m_1<\cdots<m_{k+1}=1\) and write \[q_0=\sum_{i=0}^k a_i\mathbb{1}_{[m_i,m_{i+1})} \qquad\text{and}\qquad q_1=\sum_{i=0}^k b_i\mathbb{1}_{[m_i,m_{i+1})},\] with \((a_i)\) and \((b_i)\) both lying in the closed cone \(\{0\leqslant q_0\leqslant\cdots\leqslant q_k\}\). The path \((1-\lambda)q_0+\lambda q_1\) has values \(\bigl((1-\lambda)a_i+\lambda b_i\bigr)_i\), which again lie in this cone. By the convexity on the closed cone established in the previous paragraph, \[\psi_\circ\bigl((1-\lambda)q_0+\lambda q_1\bigr)\leqslant(1-\lambda)\psi_\circ(q_0)+\lambda\psi_\circ(q_1),\] as desired. ◻

Proof of Corollary 1. By the decomposition 7 , the map \(\psi\) is a nonnegative linear combination of the maps \(q\mapsto\psi_\circ(q_s)\), \(s\in\mathscr{S}\), each of which is convex on \(\mathcal{Q}_1\) by Proposition 3. ◻

3 Enriched model and regularity properties↩︎

We now introduce the enriched free energy associated with the multi-species model. The additional parameter \(q\) couples the spins to an independent random field with an ultrametric structure; it is introduced so that the limiting free energy can be studied through Hamilton–Jacobi equations. The case \(q=0\) recovers the original free energy, while the dependence on general \(q\) provides the regularity and derivative information needed in the cavity and comparison arguments below. We first set up the notation for paths and admissible directions, and then recall the basic estimates for the enriched free energy. Most of these estimates are direct specializations of the multi-species vector-spin framework of [34], as explained in the following remark.

Remark 6 (Importing results from [34]). The framework of [34] treats a possibly non-convex multi-species vector spin model, in which spins belonging to different species may have different dimensions and distributions. The setting considered here is obtained as the following specialization. The index set \(\mathscr{S}\) for the species is denoted in the same way here and in [34]. For every species, we take the spin dimension \(\kappa_s\) from [34] to be equal to \(1\), and we choose the single-spin distribution \(\mu_s\) to be the uniform probability measure on \(\{-1,+1\}\), namely \(\mu_s=\frac{1}{2}(\delta_{-1}+\delta_{+1})\).

Basic notation↩︎

For \(a,b\in \mathbb{R}^{n}\) for some \(n\in\mathbb{N}\), we write \(a\cdot b= \sum_ia_ib_i\) and \(|a|=\sqrt{a\cdot a}\). More generally, for any finite set \(I\) and \(a,b\in \mathbb{R}^I\), we write \[\begin{align} \label{e46dot95product} a\cdot b=\sum_{i\in I}a_ib_i; \qquad |a|=\sqrt{a\cdot a}. \end{align}\tag{52}\] For any matrix \(A\), we denote by \(A^\intercal\) its transpose. For a square matrix \(A\), we denote by \(\mathsf{diag}(A)\) the vector consisting of its diagonal entries.

We recall that we denote by \(\mathcal{Q}\) the collection of right-continuous increasing paths \(q:[0,1)\to\mathbb{R}_+\) (and that we say that \(q\) is increasing provided that \(q(r')\geqslant q(r)\) in \(\mathbb{R}_+\) for every \(0\leqslant r\leqslant r'<1\)). For \(p\in [1,\infty)\), we write \(\mathcal{Q}_p = \mathcal{Q} \cap L^p[0,1)\). For \(q\in \mathcal{Q}_\infty\), we set \(q(1) = \lim_{s\nearrow 1} q(s)\) which exists by monotonicity.

Lemma 7 (Compact embedding of paths). Let \(r\in(1,+\infty]\), and let \((q_n)_{n\in\mathbb{N}}\) be a sequence in \(\mathcal{Q}_r^\mathscr{S}\) such that \[\begin{align} \sup_{n\in\mathbb{N}} \left|q_n\right|_{L^r}<+\infty. \end{align}\] There exists a subsequence \(\left(q_{n_k}\right)_{k\in\mathbb{N}}\) and some \(q\in\mathcal{Q}_r^\mathscr{S}\) such that, for every \(r'\in [1,r)\), this subsequence converges almost everywhere on \([0,1]\) and in \(L^{r'}\) to \(q\).

This lemma is a straightforward adaptation of [3].

For every \(c\geqslant 0\), we define \[\begin{align} \label{e46def46qinfty46lec} \mathcal{Q}_{\infty,\leqslant c} = \left\{q\in \mathcal{Q}_{\infty}:\: |q(r)|\leqslant c,\quad\forall r\in[0,1)\right\}. \end{align}\tag{53}\] For every \(\lambda = (\lambda_s) \in \mathbb{R}_+^\mathscr{S}\), we may use the notation \[\mathcal{Q}_{\infty, \leqslant\lambda}^\mathscr{S}:= \prod_{s \in \mathscr{S}} \mathcal{Q}_{\infty, \leqslant\lambda_s}.\] For every \(c > 0\), we also set \[\begin{align} \tag{54} \mathcal{Q}_{\uparrow,c}=\big\{ q\in \mathcal{Q}_1\;\big|\;q(0)=0\; \text{and} \; q(r')-q(r)\geqslant c(r'-r),\;\forall r\leqslant r'\in[0,1) \big\};\\ \mathcal{Q}_{\uparrow} = \bigcup_{c>0}\mathcal{Q}_{\uparrow,c};\qquad \mathcal{Q}_{\infty,\uparrow} = \mathcal{Q}_{\infty}\cap \mathcal{Q}_{\uparrow}.\tag{55} \end{align}\]

Cascades↩︎

We now explicitly construct the external field parametrized by any \(q =(q_s)_{s\in\mathscr{S}} \in \mathcal{Q}^\mathscr{S}_\infty\).

We denote by \(\mathfrak{R}\) a Poisson–Dirichlet cascade whose overlap is uniformly distributed over the interval \([0,1]\). This is a random probability measure on some abstract Hilbert space \(\mathfrak H\), and we denote by \(\wedge\) the scalar product on this Hilbert space. We refer for instance to [3] or [5] for more details on the construction of this object. We typically denote elements of \(\mathfrak H\) using the variable \(\alpha\).

For almost every realization of \(\mathfrak{R}\), every \(s\in\mathscr{S}\), and every \(n\in I_{N,s}\), let \((w^{q_s}_n(\alpha))_{\alpha\in\mathop{\mathrm{supp}}\mathfrak{R}}\) be the real-valued centered Gaussian process with covariance given, for every \(\alpha, \alpha' \in \mathop{\mathrm{supp}}\mathfrak{R}\), by \[\begin{align} \label{e46Ew94q95s95iw94q95s95i61} \mathbb{E}\left[ w^{q_s}_n (\alpha)w^{q_s}_n(\alpha')\right] = q_s(\alpha\wedge\alpha'). \end{align}\tag{56}\] The existence of such a process and its properties are given in [3]. Conditioned on \(\mathfrak{R}\), we assume that all these processes, indexed by \(s\) and \(n\), are independent. For each \(s\), we write \(w^{q_s}_{I_{N,s}} = \left(w^{q_s}_n\right)_{n\in I_{N,s}}\). Recall the notation in 2 . For each \(N\in\mathbb{N}\) and \(q\in \mathcal{Q}^\mathscr{S}_\infty\), we define \[\begin{align} \label{e46W94q95N40sigma44alpha4161} W^q_N(\sigma,\alpha) = \sum_{s\in \mathscr{S}}w^{q_s}_{I_{N,s}}(\alpha)\cdot \sigma_{\bullet I_{N,s}} \end{align}\tag{57}\] which, conditioned on \(\mathfrak{R}\), is a centered Gaussian process with covariance \[\begin{align} \label{e46cov95external95multi-sp} \mathbb{E}\left[ W^q_N(\sigma,\alpha) W^q_N(\sigma',\alpha')\right]\stackrel{\eqref{e46R95N44s61},\eqref{e46Ew94q95s95iw94q95s95i61}}{=} N q(\alpha\wedge\alpha')\cdot R_N(\sigma,\sigma'), \end{align}\tag{58}\] where the dot product follows the rule as in 52 .

Hamiltonian, free energy, and Gibbs measure↩︎

For \(N\in \mathbb{N}\), \(t\in\mathbb{R}_+\), and \(q \in \mathcal{Q}_\infty^\mathscr{S}\), we consider the Hamiltonian \[\begin{align} \label{e46H94t44q95N61} H^{t,q}_N(\sigma,\alpha)= \sqrt{2t}H_N(\sigma) - t N \xi \left(\lambda_N\right) + \sqrt{2}W^q_N(\sigma,\alpha) - Nq(1)\cdot \lambda_N \end{align}\tag{59}\] where \(q(1)= (q_s(1))_{s\in\mathscr{S}}\in \mathbb{R}_+^\mathscr{S}\) and \(q(1)\cdot \lambda_N=\sum_{s\in\mathscr{S}}\lambda_{N,s}q_s(1)\). Here, \(\lambda_N\) is the self-overlap vector for the normalization in 1 . The two terms in 59 involving the self-overlap are respectively the variances of \(\sqrt{t}H_N(\sigma)\) and \(W^q_N(\sigma,\alpha)\). These two terms are often called the self-overlap correction, which resembles the drift term in an exponential martingale.

We define the associated free energy and Gibbs measure \[\begin{gather} \overline{F}_N(t,q) = - \frac{1}{N}\mathbb{E}\log \sum_{\sigma\in\{-1,1\}^N}\int 2^{-N}\exp\left( H^{t,q}_N(\sigma,\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha), \tag{60} \\ \left\langle\cdot\right\rangle_N \propto \exp\left( H^{t,q}_N(\sigma,\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha) \mathrm{d}P_{\{-1,1\}^N}(\sigma)\tag{61} , \end{gather}\] where \(P_{\{-1,1\}^N}\) denotes the uniform probability measure on \(\{-1,1\}^N\). In 60 , the expectation \(\mathbb{E}\) first averages over all the Gaussian randomness in \(H_N(\sigma)\) and \(W^q_N(\sigma,\alpha)\) and then the randomness in \(\mathfrak{R}\). This particular order of integration is needed to ensure that there are no measurability issues (see [3]). Notice the additional minus sign on the right-hand side of 60 . We have omitted the dependence on \(t\) and \(q\) from the notation of \(\left\langle\cdot\right\rangle_N\), which should be clear from the context. understand We denote by \((\sigma, \alpha)\) the canonical random variable under \(\left\langle\cdot\right\rangle_N\); we will at times also denote by \((\sigma', \alpha')\) an independent copy of \((\sigma,\alpha)\) under \(\left\langle\cdot\right\rangle_N\).

We can view \(\overline{F}_N\) as a function of \((t,q)\in\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_\infty\). By the Lipschitz continuity in Proposition 7 below, we can extend \(\overline{F}_N\) to the domain \(\mathbb{R}_+\times \mathcal{Q}^\mathscr{S}_1\).

Initial condition↩︎

For \(q\in \mathcal{Q}_\infty\), define \[\begin{align} \label{e46psi95single61} \begin{aligned} \psi_\circ(q) &= - \mathbb{E}\log\sum_{\tau\in\{-1,1\}}\int 2^{-1} \exp\left(\sqrt{2}w^q(\alpha)\cdot \tau-q(1) \tau\tau\right)\mathrm{d}\mathfrak{R}(\alpha) \\ & = - \mathbb{E}\log \int \cosh\left(\sqrt{2}w^q(\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha)+q(1) \end{aligned} \end{align}\tag{62}\] where \(w^q(\alpha)\) is the real-valued centered Gaussian process with covariance \(\mathbb{E}\left[ w^q (\alpha)w^q(\alpha')\right] = q(\alpha\wedge\alpha')\) (similar to 56 ). To see that this cascade definition of \(\psi_\circ\) coincides with the finite-step definition in the previous section, we refer to [3] and [11]. By [34], we have \(\overline{F}_N(0,q)=\sum_{s\in\mathscr{S}}\lambda_{N,s}\psi_\circ(q_s)\). Therefore, we have \[\begin{align} \label{e46psi61sumlambdapsi} \lim_{N\to\infty}\overline{F}_N(0,q) = \psi(q) = \sum_{s\in\mathscr{S}}\lambda_{\infty,s}\psi_\circ(q_s). \end{align}\tag{63}\]

Continuity in \(\lambda_N\)↩︎

Recall from 4 the definition of \(\lambda_N\). So far, we have fixed \(\lambda_N\) and omitted it from the notation. Later, we will need approximations in terms of \(\lambda_N\), in which case, we display the dependence by writing \(\overline{F}_N=\overline{F}_{N,\lambda_N}\). The next result is borrowed from [34].

Lemma 8. There is a constant \(C\) depending only on \(\nabla\xi\) such that, for every \(N\in \mathbb{N}\), \(t\in\mathbb{R}_+\), \(q\in \mathcal{Q}^\mathscr{S}_1\), and \(\lambda_N,\,\lambda'_N\), we have \[\begin{align} \label{e46124F-F12460C124lambda-lambda124} \left|\overline{F}_{N,\lambda_N}(t,q) - \overline{F}_{N,\lambda'_N}(t,q)\right|\leqslant C\left( t + |q|_{L^1} +1\right)\left|\lambda_N-\lambda'_N\right|. \end{align}\tag{64}\]

Differentiability↩︎

Let \(G\) be either \(\mathcal{Q}_2\), \(\mathbb{R}_+\times \mathcal{Q}_2\), or \(\mathcal{Q}_2^\mathscr{S}\). Slightly abusing notation, we denote by \(L^2\) the ambient Hilbert space for \(G\), that is, either \(L^2([0,1])\), \(\mathbb{R}\times L^2([0,1])\), or \(L^2([0,1])^{\mathscr{S}} \simeq L^2([0,1]; \mathbb{R}^\mathscr{S})\) respectively. For every \(q\in G\), we define \[\begin{align} \mathrm{Adm}(G,q) = \left\{e\in L^2 \;\big|\; \exists r>0:\: \forall r'\in[0,r],\;q+r'e\in G \right\} \end{align}\] to be the set of directions along which a small line segment starting from \(q\) belongs to \(G\). A function \(g:G\to\mathbb{R}\) is said to be Gateaux differentiable at \(q\in G\) if

  • \(g'(q,e)= \lim_{r\searrow0}\frac{g(q+re)-g(q)}{r}\) exists for every \(e\in \mathrm{Adm}(G,q)\);

  • there is a unique \(y\in L^2\) such that \(g'(q,e)=\left\langle y, e\right\rangle_{L^2}\) for every \(e\in \mathrm{Adm}(G,q)\).

In this case, we call \(y\) the Gateaux derivative of \(g\) at \(q\) and write \(\partial_q g(q)=y\) which is an element in \(L^2\). The following result is extracted from [34], which is adapted from [3].

Proposition 7 (Differentiability of \(\overline{F}_N\)). Let \(N \in \mathbb{N}\) and let \(\overline{F}_N\) be given as in 60 . We have for every \(t,t' \in \mathbb{R}_+\) and \(q,q' \in \mathcal{Q}_\infty^\mathscr{S}\) that \[\left|\overline{F}_N(t,{q}) - \overline{F}_N(t',{q'})\right|\leqslant\left|{q}-{q'}\right|_{L^1} + |t-t'| \, \sup_{|a| \leqslant 1} |\xi(a)|.\] In particular, the free energy in 60 can be extended by continuity to \(\mathbb{R}_+\times\mathcal{Q}_1^\mathscr{S}\). Moreover, the restriction of the function \(\overline{F}_N\) to \(\mathbb{R}_+ \times \mathcal{Q}_2^\mathscr{S}\) is Gateaux differentiable everywhere, jointly in its two variables. We denote its Gateaux derivative in \(q\) by \(\partial_q \overline{F}_N(t,q) = \partial_q \overline{F}_N(t,q, \cdot) \in L^2([0,1]; \mathbb{R}^\mathscr{S})\). For every \(t \geqslant 0\) and \(q \in \mathcal{Q}_2^\mathscr{S}\), we have \[\label{e46bounds46der46FN} \partial_q \overline{F}_N(t,q) \in \mathcal{Q}^\mathscr{S}_{\infty,\leqslant\lambda_N},\qquad{(2)}\] and, for every \(q \in \mathcal{Q}_\infty^\mathscr{S}\) and \(\pi \in L^2([0,1]; \mathbb{R}^\mathscr{S})\), \[\label{e46def46der46FN} \begin{align} \left\langle\pi,\partial_q \overline{F}_N(t,{q})\right\rangle_{L^2} &= \mathbb{E}\left\langle\pi \left(\alpha\wedge\alpha'\right)\cdot R_N(\sigma,\sigma')\right\rangle_N. \end{align}\qquad{(3)}\]

We recall that in expressions such as ?? , the pair \((\sigma',\alpha')\) denotes an independent copy of the pair \((\sigma,\alpha)\) under \(\left\langle\cdot \right\rangle_N\).

Lemma 9 (Regularity of \(\psi_\circ\)). The function \(\psi_\circ\) given in 62 can be extended to \(\mathcal{Q}_1\) and satisfies \[\begin{align} \left|\psi_\circ(q)-\psi_\circ(q')\right|\leqslant|q-q'|_{L^1},\quad\forall q,q'\in\mathcal{Q}_1. \end{align}\] The restriction \(\psi_\circ:\mathcal{Q}_2\to\mathbb{R}\) is Gateaux differentiable everywhere; we denote its Gateaux derivative by \(\partial_q \psi_\circ(q) = \partial_q \psi_\circ(q, \cdot) \in L^2([0,1])\). We have, for every \(q \in \mathcal{Q}_2\), \[\label{e46bound46der46psi} \partial_q\psi_\circ(q) \in \mathcal{Q}_{\infty,\leqslant 1},\tag{65}\] and, for every \(q \in \mathcal{Q}_\infty\) and \(\pi \in L^2([0,1]; \mathbb{R})\), \[\left\langle\pi,\partial_q \psi_\circ(q)\right\rangle_{L^2} = \mathbb{E}\left\langle\pi \left(\alpha\wedge\alpha'\right)\tau\tau'\right\rangle_{q}\] where \(\left\langle\cdot\right\rangle_q \propto \exp\left(\sqrt{2}w^q(\alpha)\cdot \tau-q(1) \tau\tau\right)\mathrm{d}\mathfrak{R}(\alpha) \mathrm{d}P_{\{-1,1\}}(\tau)\), and \((\tau',\alpha')\) denotes an inpendent copy of the canonical random variable \((\tau,\alpha)\) under \(\left\langle\cdot \right\rangle_q\). Moreover, for every \(r \in [1,+\infty]\) and \(q, q' \in \mathcal{Q}_2\) with \(q-q' \in L^r\), we have \[\label{e46continuity46der46psi} \left|\partial_q \psi_\circ(q) -\partial_q \psi_\circ(q')\right|_{L^r}\leqslant 16\left|q-q'\right|_{L^r}.\tag{66}\] In particular, the mapping \(q \mapsto \partial_q \psi_\circ(q)\) can be extended to \(\mathcal{Q}_1\) by continuity, and the properties in 65 and 66 remain valid with \(q, q' \in \mathcal{Q}_1\).

Hamilton–Jacobi functional and critical points↩︎

For every \((t,q)\in \mathbb{R}_+\times \mathcal{Q}^\mathscr{S}_2\), we consider the functional \[\begin{align} \label{e46mcJ61} \mathcal{J}_{t, q}(q',p) = \psi(q') + \left\langle p, q-q'\right\rangle_{L^2}+t\int_0^1\xi(p), \end{align}\tag{67}\] defined for \(q'\in \mathcal{Q}^\mathscr{S}_2\), \(p\in L^2([0,1],\mathbb{R}^\mathscr{S})\). Here, \(\left\langle\cdot,\cdot\right\rangle_{L^2}\) is the inner product in \(L^2([0,1],\mathbb{R}^\mathscr{S})\) and the last integral is \(\int_0^1\xi(p(s))\mathrm{d}s\). As was already discussed around 9 , we say that a pair \((q',p) \in \mathcal{Q}^\mathscr{S}_2\times L^2([0,1],\mathbb{R}^\mathscr{S})\) is a critical point of the functional \(\mathcal{J}_{t, q}\) if \[\begin{align} \label{e46critical95rel} q=q'-t\nabla\xi(p) \qquad\text{and}\qquad p=\partial_q \psi(q'). \end{align}\tag{68}\] Here, the derivative \(\partial_q \psi\) is understood in the Gateaux sense defined above Proposition 7. The differentiability of \(\psi\) is ensured by Lemma 9.

Heuristically, at any critical point \((q',p)\), the derivatives of \(\mathcal{J}_{t, q}\) in \(q'\) and \(p\) are both zero. Critical points and the value of the functional at these points are important to our main results to be stated.

We also consider the Parisi functional. We define \(\theta: \mathbb{R}^\mathscr{S}\to \mathbb{R}\) by \[\begin{align} \label{e46theta61} \theta(a)= a\cdot \nabla\xi (a) -\xi(a) \end{align}\tag{69}\] where \(\nabla\xi :\mathbb{R}^\mathscr{S}\to \mathbb{R}^\mathscr{S}\) is the gradient of \(\xi\) in \(\mathbb{R}^\mathscr{S}\). For \(t\in\mathbb{R}_+\), \(q\in \mathcal{Q}^\mathscr{S}_\infty\), we set \[\begin{align} \label{e46sP95lambda44t44q} \mathscr{P}_{t,q}(p) = \psi(q+t \nabla\xi(p))-t\int_0^1\theta(p(r)) \mathrm{d}r. \end{align}\tag{70}\] Comparing this with 67 , we have \[\begin{align} \label{e46rel95parisi95mcJ} \mathscr{P}_{t,q}(p)= \mathcal{J}_{t,q}(q+t\nabla \xi(p), p). \end{align}\tag{71}\]

Lemma 10 (Lipschitz regularity of Parisi functional). There is a constant \(C>0\) such that, for every \(t, t' \geqslant 0\), \(p,p' \in \mathcal{Q}_{\infty, \leqslant\lambda_\infty}^\mathscr{S}\), and \(q,q' \in \mathcal{Q}_1^\mathscr{S}\), we have \[\begin{gather} \left|\mathscr{P}_{t,q}(p)-\mathscr{P}_{t',q'}(p')\right|\leqslant C\left(\left|t-t'\right|+\left|p-p'\right|_{L^1}+\left|q-q'\right|_{L^1}\right), \\ \left|\partial_q\psi\left(q+t\nabla\xi(p)\right)-\partial_q\psi\left(q'+t'\nabla\xi(p')\right)\right|_{L^1}\leqslant C\left(\left|t-t'\right|+\left|p-p'\right|_{L^1}+\left|q-q'\right|_{L^1}\right). \end{gather}\]

Proof. This follows from the local Lipschitzness of \(\nabla\xi\) and \(\theta\) and results from Lemma 9 together with 63 . ◻

Local semi-concavity↩︎

Recall the definition of \(\mathcal{Q}_{\uparrow,c}\) from 54 . For any increasing path \(q\), we denote by \(\accentset{\large\bfseries .}{q}\) its distributional derivative. The next result is from [34] adapted from [3].

Proposition 8 (Semi-concavity of the free energy). There exists a constant \(C<+\infty\) (depending only on \(\xi\)) such that, for every \(N\in\mathbb{N}\), \(c>0\), \(t,t'\geqslant c\), \(q,q'\in \mathcal{Q}^\mathscr{S}_{\uparrow,c}\) with \(\accentset{\large\bfseries .}{q}-\accentset{\large\bfseries .}{q}' \in L^2\), and \(r\in[0,1]\), we have \[\label{e46semi-concave95cts95F95N} (1-r)\overline{F}_N(t,q)+ r \overline{F}_N(t',q') - \overline{F}_N\left((1-r)(t,q)+r(t',q')\right) \leqslant Cr(1-r)c^{-2}\left((t-t')^2+\left|\accentset{\large\bfseries .}{q}-\accentset{\large\bfseries .}{q}'\right|_{L^2}^2\right).\qquad{(4)}\]

4 Reduction to vector spin glasses↩︎

When all entries of \(\lambda_\infty\) are rational, we show that the limit free energy of the multi-species model agrees with that of a vector spin model whose covariance depends only on the diagonal of the overlap matrix. Working with this vector spin model has a practical advantage. In the next two sections, which concern the Hamilton–Jacobi equation and the cavity computation, the notation becomes simpler and existing results can be adapted more directly. For a general multi-species model with irrational \(\lambda_\infty\), the cavity computation would require an additional approximation step, which is rather technical, especially when the limiting free energy has not yet been identified. Our strategy is therefore to first establish the formula in the rational case and then obtain the irrational case by continuity.

For \({D}\in \mathbb{N}\), we call a collection \((\mathsf{D}_s)_{s\in\mathscr{S}}\) of subsets a weak partition of \(\{1,\dots,{D}\}\) if \(\cup_{s\in\mathscr{S}}\mathsf{D}_s = \{1,\dots,{D}\}\) and \(\mathsf{D}_s\cap \mathsf{D}_{s'}=\emptyset\) whenever \(s\neq s'\). This differs from the standard notion in that we allow \(\mathsf{D}_s\) to be empty. We work with the multi-species spin glass with system size \({D}N\) for \(N\in\mathbb{N}\) and with species proportion satisfying \[\begin{align} \label{e46lambda94MN95s61124M95s12447M} \lambda_{{D}N,s} = |\mathsf{D}_s|/{D},\quad\forall s \in\mathscr{S} \end{align}\tag{72}\] for some weak partition \((\mathsf{D}_s)_{s\in\mathscr{S}}\) of \(\{1,\dots ,{D}\}\). Under this assumption, among \({D}N\) spins of the multi-species configuration \(\sigma\), there are exactly \(|\mathsf{D}_s|N\) spins belonging to the \(s\)-species for each \(s\in\mathscr{S}\).

We want to map this model to a vector spin model with spins in \(\mathbb{R}^{D}\) and size \(N\). We define \[\begin{align} \label{e46b94sum61} b^{\mathrm{sum}}= \Big({D}^{-1}\sum_{d\in \mathsf{D}_s}b_d\Big)_{s\in\mathscr{S}} \in \mathbb{R}^\mathscr{S},\qquad\forall b \in \mathbb{R}^{D}. \end{align}\tag{73}\] For \(\xi\) in 3 , we take \[\begin{align} \label{e46bxi61mp} {\xi}^{\mathrm{vec}}(b) = {D}\xi \left(b^{\mathrm{sum}}\right),\quad\forall b \in \mathbb{R}^{D}, \end{align}\tag{74}\]

For each \(N\in\mathbb{N}\), a spin configuration with size \(N\) is denoted by \(\sigma= (\sigma_{dn})_{1\leqslant d\leqslant{D},\, 1\leqslant n\leqslant N}\in\{-1,1\}^{{D}\times N}\). Given a smooth function \({\xi}^{\mathrm{vec}}:\mathbb{R}^{{D}}\to \mathbb{R}\), for each \(N\in\mathbb{N}\), we assume the existence of a centered Gaussian process \(\left(H^{\mathrm{vec}}_N(\sigma)\right)_{\sigma\in \mathbb{R}^{{D}\times N}}\) with covariance \[\begin{align} \label{e46EH94vec95N40sigma41H94vec95N40sigma394161} \mathbb{E}H^{\mathrm{vec}}_N(\sigma)H^{\mathrm{vec}}_N(\sigma') = N {\xi}^{\mathrm{vec}}\left(\left(\tfrac{1}{N}\sigma_{d\bullet}\cdot\sigma'_{d\bullet}\right)_{d\in\{1,\dots,{D}\}}\right). \end{align}\tag{75}\] For \({{q}}\in \mathcal{Q}_\infty^{D}\) and each \(d\in\{1,\dots,{D}\}\), conditioned on \(\mathfrak{R}\), let \(({w}^{{{q}}_d}(\alpha))_{\alpha\in\mathop{\mathrm{supp}}\mathfrak{R}}\) be the real-valued centered Gaussian process with covariance \[\begin{align} \label{e.E[bwbw]=} \mathbb{E}{w}^{{{q}}_d}(\alpha) {w}^{{{q}}_d}(\alpha') = {{q}}_d(\alpha\wedge\alpha'). \end{align}\tag{76}\] We assume that \(w^{q_d}\) is independent for different \(d\). For each \(d\in\{1,\dots,{D}\}\) and \(i\in\{1,\dots,N\}\), let \({w}^{{{q}}_d}_i\) be independent copies of \({w}^{{{q}}_d}\). Then, we set \[\begin{align} \label{e46W94q95N40alpha4161} W^{{q}}_N(\alpha) = \left({w}^{{{q}}_d}_i(\alpha)\right)_{d\in\{1,\dots,{D}\},\, i\in\{1,\dots,N\}},\quad\forall \alpha\in\mathop{\mathrm{supp}}\mathfrak{R}. \end{align}\tag{77}\] We view \(W^{{q}}_N(\alpha)\) as an \(\mathbb{R}^{{D}\times N}\)-valued process and thus \(W^q_N(\alpha)\cdot \sigma=\sum_{d,i}w^{q_d}_i(\alpha)\sigma_{di}\). For each \(N\in\mathbb{N}\), \(t\in\mathbb{R}_+\), and \({{q}}\in\mathcal{Q}_\infty^{D}\), we consider the Hamiltonian and free energy: \[\begin{gather} H^{{\mathrm{vec}},t,{{q}}}_N(\sigma,\alpha) = \sqrt{2t}H^{\mathrm{vec}}_N(\sigma) - Nt {\xi}^{\mathrm{vec}}\left(\vec{\mathbf{1}}\right) + \sqrt{2}W^{{q}}_N(\alpha)\cdot \sigma- N{{q}}(1)\cdot \vec{\mathbf{1}}, \tag{78} \\ \overline{F}_N^{\mathrm{vec}}(t,{{q}}) = - \frac{1}{N}\mathbb{E}\log\sum_{\sigma\in\{-1,1\}^{{D}\times N}} \int 2^{-{D}N}\exp\left( H^{{\mathrm{vec}},t,{{q}}}_N(\sigma,\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha),\tag{79} \end{gather}\] where \(\vec{\mathbf{1}}=\{1\}_{d\in\{1,\dots,{D}\}}\in\mathbb{R}^{D}\), and the expectation \(\mathbb{E}\) is first taken over Gaussian randomness in \(H^{\mathrm{vec}}_N\) and \(W^{{q}}_N\) and then over the randomness in \(\mathfrak{R}\).

We define \[\begin{align} \label{e46a94vec61} a^{\mathrm{vec}}= \left(\sum_{s \in \mathscr{S}}a_s \mathbb{1}_{d\in \mathsf{D}_s}\right)_{d\in\{1,\dots,{D}\}} \in \mathbb{R}^{D},\qquad\forall a \in \mathbb{R}^\mathscr{S}. \end{align}\tag{80}\] For any path \(q\), we denote by \(q^{\mathrm{vec}}\) the path \(r\mapsto q(r)^{\mathrm{vec}}\). For any \(r\in\mathbb{R}\), write \(\lceil r \rceil = \min\{n\in\mathbb{N}:n\geqslant r\}\). The following is extracted from [34].

Lemma 11 (Equivalence in the rational case). Assume that there are \({D}\in\mathbb{N}\) and a weak partition \((\mathsf{D}_s)_{s\in\mathscr{S}}\) of \(\{1,\dots,{D}\}\) such that \[\begin{align} \lim_{N\to\infty}\lambda_{N,s} = |\mathsf{D}_s|/{D},\quad\forall s \in \mathscr{S}. \end{align}\] Let \(\overline{F}^{\mathrm{vec}}_N\) be the free energy with \({\xi}^{\mathrm{vec}}\) specified in 74 . For every \(t\in\mathbb{R}_+\) and \(q\in \mathcal{Q}_\infty^\mathscr{S}\), let \({{q}}^{\mathrm{vec}}\in\mathcal{Q}_\infty^{D}\) be given as in 80 . We have \[\begin{align} \lim_{N\to\infty}\left| \overline{F}_N(t,q)- {D}^{-1}\overline{F}^{\mathrm{vec}}_{\lceil N/{D}\rceil}\left(t,{{q}}^{\mathrm{vec}}\right)\right|=0. \end{align}\]

A similar version of Proposition 7 holds for \(\overline{F}^{\mathrm{vec}}_N\); see [3]. In particular, \(\overline{F}^{\mathrm{vec}}_N\) can be extended by continuity to \(\mathbb{R}_+\times\mathcal{Q}^{D}_1\). One property of vector spin glasses is the following (see [3]) \[\begin{align} \label{e46F95161F95N} \overline{F}^{\mathrm{vec}}_N(0,q) = \overline{F}^{\mathrm{vec}}_1(0,q),\qquad\forall q\in\mathcal{Q}^{D}_1,\;N\in\mathbb{N}. \end{align}\tag{81}\]

Remark 9. The vector spin model \(\overline{F}^{\mathrm{vec}}_N\) can be viewed as a multi-species spin glass model of size \({D}N\) with \({D}\) species, each having population ratio \(1/{D}\). Therefore, all results from Section 3 apply to \(\overline{F}^{\mathrm{vec}}_N\).

Lastly, we introduce the relevant functional. For \(q\in\mathcal{Q}^{D}_1\), \[\begin{align} \label{e46psi94Vec61} \psi^{\mathrm{vec}}(q) := \overline{F}_1^{\mathrm{vec}}(0,q) = \sum_{d=1}^{D}\psi_\circ\left(q_d\right) \end{align}\tag{82}\] where the last identity follows from an analogous version of 63 . Given \({\xi}^{\mathrm{vec}}\) in 74 , similar to 69 , we define \[\begin{align} \label{e46theta94Vec61} \theta^{\mathrm{vec}}(b) := b\cdot \nabla\xi^{\mathrm{vec}}(b)-\xi^{\mathrm{vec}}(b),\quad\forall b\in\mathbb{R}^{D}. \end{align}\tag{83}\] Similar to 70 , for \(t\in\mathbb{R}_+\) and \(q\in\mathcal{Q}^{D}_\infty\), we define \[\begin{align} \label{e46sP94Vec61} \mathscr{P}_{t,{q}}^{\mathrm{vec}}({p}) := \psi^{\mathrm{vec}}\left({q}+t\nabla\xi^{\mathrm{vec}}({p})\right) -t \int_0^1\theta^{\mathrm{vec}}({p}(s))\mathrm{d}s. \end{align}\tag{84}\] Notice that, by 82 , Lemma 11, and 63 , we have \[\begin{align} \label{e46psi95single61psi} \psi^{\mathrm{vec}}(q^{\mathrm{vec}}) = {D}\psi(q),\qquad\forall q \in \mathcal{Q}^\mathscr{S}_\infty. \end{align}\tag{85}\] Later, we also need to consider \[\begin{align} \label{e46b94avg61} b^{\mathrm{avg}}:= \left(\frac{1}{|\mathsf{D}_s|}\sum_{d\in \mathsf{D}_s}b_d\right)_{s\in\mathscr{S}}\in \mathbb{R}^\mathscr{S},\qquad\forall b \in \mathbb{R}^{D}. \end{align}\tag{86}\]

We next investigate the relations between the objects in the multi-species model and the vector spin model, which we collect in the next result. To distinguish \(\mathbb{R}^\mathscr{S}\)-valued paths and \(\mathbb{R}^{D}\)-valued paths, we add underlines to the latter and write \(\underline p\) and \(\underline q\) for instance.

Lemma 12. For every \(a\in\mathbb{R}^\mathscr{S}\) and \(b\in \mathbb{R}^{D}\), we have \[\begin{gather} a^{\mathrm{vec}}\cdot b = D a \cdot b^{\mathrm{sum}}, \tag{87} \\ (a^{\mathrm{vec}})^{\mathrm{avg}}=a. \tag{88} \end{gather}\] For every \(b\in\mathbb{R}^{D}\), we have \[\begin{align} \label{e46nablaxi40b4161} \nabla_d \xi^{\mathrm{vec}}(b) = \nabla_s\xi(b^{\mathrm{sum}}),\quad\forall d \in \mathsf{D}_s\quad\text{and thus}\qquad \nabla\xi^{\mathrm{vec}}(b) = \left(\nabla\xi(b^{\mathrm{sum}})\right)^{\mathrm{vec}}. \end{align}\tag{89}\] For every \(b,b'\in\mathbb{R}^{D}\), we have \[\begin{align} \label{e46theta94vec61theta} b'\cdot \nabla\xi^{\mathrm{vec}}(b) = D b'^{\mathrm{sum}}\cdot \nabla \xi(b^{\mathrm{sum}})\qquad\text{and thus}\qquad \theta^{\mathrm{vec}}(b)= D \theta (b^{\mathrm{sum}}). \end{align}\tag{90}\] For every \(t\in\mathbb{R}_+\), \(p, q \in \mathcal{Q}_\infty^\mathscr{S}\) and \(\underline p,\underline q\in \mathcal{Q}_\infty^{D}\) satisfying \(p=\underline p^{\mathrm{sum}}\) and \(q^{\mathrm{vec}}= \underline q\), we have \[\begin{align} \label{e46sP94vec61sP} \psi^{\mathrm{vec}}\left(\underline q+ t\nabla\xi^{\mathrm{vec}}(\underline p)\right) = {D}\psi\left(q+t\nabla\xi(p)\right)\quad\text{and thus}\quad \mathscr{P}^{\mathrm{vec}}_{t,\underline q}(\underline p) = {D}\mathscr{P}_{t,q}(p). \end{align}\tag{91}\] Moreover, \[\begin{align} \label{e46dpsi94vec61dpsi} \text{if}\quad \underline p= \partial_{\underline q}\psi^{\mathrm{vec}}\left(\underline q+ t\nabla\xi^{\mathrm{vec}}(\underline p)\right),\qquad\text{then}\quad p = \partial_q \psi(q+t\nabla\xi(p)). \end{align}\tag{92}\]

Proof. The relations 87 and 88 follow directly from the definitions in 80 , 73 , and 86 . Indeed, \[\begin{align} a^{\mathrm{vec}}\cdot b = \sum_{s\in\mathscr{S}}\sum_{d\in\mathsf{D}_s}a_s b_d = {D}\sum_{s\in\mathscr{S}}a_s b_s^{\mathrm{sum}} = {D}a\cdot b^{\mathrm{sum}}. \end{align}\]

We next prove 89 . By 74 , \(\xi^{\mathrm{vec}}(b)={D}\xi(b^{\mathrm{sum}})\). Hence, for \(d\in\mathsf{D}_s\), the chain rule gives \[\begin{align} \nabla_d\xi^{\mathrm{vec}}(b) = {D}\sum_{s'\in\mathscr{S}}\nabla_{s'}\xi(b^{\mathrm{sum}})\, \frac{\partial b_{s'}^{\mathrm{sum}}}{\partial b_d} = {D}\nabla_s\xi(b^{\mathrm{sum}})\frac{1}{{D}} = \nabla_s\xi(b^{\mathrm{sum}}). \end{align}\] This proves the first relation in 89 , and the second follows from the definition of the vectorization map \(a\mapsto a^{\mathrm{vec}}\).

For 90 , using 89 and 87 , we have \[\begin{align} b'\cdot \nabla\xi^{\mathrm{vec}}(b) = b'\cdot \left(\nabla\xi(b^{\mathrm{sum}})\right)^{\mathrm{vec}} = {D}b'^{\mathrm{sum}}\cdot \nabla\xi(b^{\mathrm{sum}}). \end{align}\] Taking \(b'=b\) and using \(\xi^{\mathrm{vec}}(b)={D}\xi(b^{\mathrm{sum}})\) gives \[\begin{align} \theta^{\mathrm{vec}}(b) = b\cdot \nabla\xi^{\mathrm{vec}}(b)-\xi^{\mathrm{vec}}(b) = {D}b^{\mathrm{sum}}\cdot\nabla\xi(b^{\mathrm{sum}})-{D}\xi(b^{\mathrm{sum}}) = {D}\theta(b^{\mathrm{sum}}). \end{align}\]

We now prove 91 . Since \(q^{\mathrm{vec}}=\underline q\), \(p=\underline p^{\mathrm{sum}}\), and by 89 , \[\begin{align} \underline q+t\nabla\xi^{\mathrm{vec}}(\underline p) = q^{\mathrm{vec}}+t\left(\nabla\xi(\underline p^{\mathrm{sum}})\right)^{\mathrm{vec}} = \left(q+t\nabla\xi(p)\right)^{\mathrm{vec}}. \end{align}\] Therefore, by 85 , \[\begin{align} \psi^{\mathrm{vec}}\left(\underline q+t\nabla\xi^{\mathrm{vec}}(\underline p)\right) = {D}\psi\left(q+t\nabla\xi(p)\right). \end{align}\] Combining this identity with \(\theta^{\mathrm{vec}}(\underline p)={D}\theta(\underline p^{\mathrm{sum}})={D}\theta(p)\) pointwise gives \[\begin{align} \mathscr{P}^{\mathrm{vec}}_{t,\underline q}(\underline p) &= \psi^{\mathrm{vec}}\left(\underline q+t\nabla\xi^{\mathrm{vec}}(\underline p)\right) - t\int_0^1\theta^{\mathrm{vec}}(\underline p(r))\,\mathrm{d}r \\ &= {D}\psi\left(q+t\nabla\xi(p)\right) - t{D}\int_0^1\theta(p(r))\,\mathrm{d}r = {D}\mathscr{P}_{t,q}(p). \end{align}\]

It remains to prove 92 . Set \[\begin{align} q':=q+t\nabla\xi(p), \qquad \underline q':=\underline q+t\nabla\xi^{\mathrm{vec}}(\underline p). \end{align}\] By the previous computation, \(\underline q'=q'^{\mathrm{vec}}\). Assume that \[\begin{align} \underline p=\partial_{\underline q}\psi^{\mathrm{vec}}(\underline q'). \end{align}\] Let \(h\in \mathrm{Adm}(\mathcal{Q}_2^\mathscr{S},q')\). Then \(h^{\mathrm{vec}}\in \mathrm{Adm}(\mathcal{Q}_2^{D},\underline q')\) and \(\underline q'+\varepsilon h^{\mathrm{vec}}=(q'+\varepsilon h)^{\mathrm{vec}}\) for all sufficiently small \(\varepsilon\geqslant 0\). Using the Gateaux derivative of \(\psi^{\mathrm{vec}}\) at \(\underline q'\), the identity 85 , and then the Gateaux derivative of \(\psi\) at \(q'\), we obtain \[\begin{align} \left\langle\underline p,h^{\mathrm{vec}}\right\rangle_{L^2([0,1];\mathbb{R}^{D})} &= \lim_{\varepsilon\searrow0} \frac{ \psi^{\mathrm{vec}}(\underline q'+\varepsilon h^{\mathrm{vec}})-\psi^{\mathrm{vec}}(\underline q') }{\varepsilon} \\ &= \lim_{\varepsilon\searrow0} \frac{ {D}\psi(q'+\varepsilon h)-{D}\psi(q') }{\varepsilon} = {D}\left\langle\partial_q\psi(q'),h\right\rangle_{L^2([0,1];\mathbb{R}^\mathscr{S})}. \end{align}\] On the other hand, applying 87 pointwise and integrating gives \[\begin{align} \left\langle\underline p,h^{\mathrm{vec}}\right\rangle_{L^2([0,1];\mathbb{R}^{D})} = {D}\left\langle\underline p^{\mathrm{sum}},h\right\rangle_{L^2([0,1];\mathbb{R}^\mathscr{S})} = {D}\left\langle p,h\right\rangle_{L^2([0,1];\mathbb{R}^\mathscr{S})}. \end{align}\] Hence, for every \(h\in \mathrm{Adm}(\mathcal{Q}_2^\mathscr{S},q')\), \[\begin{align} \left\langle p,h\right\rangle_{L^2([0,1];\mathbb{R}^\mathscr{S})} = \left\langle\partial_q\psi(q'),h\right\rangle_{L^2([0,1];\mathbb{R}^\mathscr{S})}. \end{align}\] By the uniqueness in the definition of the Gateaux derivative, this implies \[\begin{align} p=\partial_q\psi(q') = \partial_q\psi(q+t\nabla\xi(p)). \end{align}\] This proves 92 . ◻

5 Cavity computation↩︎

We consider the vector spin glass model in 7479 and use the shorthand notation \[\begin{align} \label{e46shorthand95vec} \xi = {\xi}^{\mathrm{vec}},\quad H^{t,q}_N=H^{{\mathrm{vec}},t,q}_N, \quad \overline{F}_N =\overline{F}_N^{\mathrm{vec}}\quad \psi= \psi^{\mathrm{vec}}, \quad\theta=\theta^{\mathrm{vec}},\quad \text{and}\quad \mathscr{P}_{t,q}=\mathscr{P}^{\mathrm{vec}}_{t,q}. \end{align}\tag{93}\] Throughout this section, we fix \(t>0\).

5.1 Definitions and notation↩︎

5.1.1 Hamiltonians and perturbation↩︎

We first introduce the Hamiltonians used in the cavity computation. The main idea is to decompose an element \(\rho \in \{-1,1\}^{D \times (N+1)}\) as \(\rho = (\sigma, \tau)\), where \(\sigma \in \{-1,1\}^{D \times N}\) and \(\tau \in \{-1,1\}^{D \times 1}\), and then express free energies involving \(N+1\) variables in terms of averages over the cavity variable \(\tau\) under a Gibbs measure on the variables \(\sigma\).

To obtain the asymptotic validity of the Ghirlanda–Guerra identities, and hence the ultrametricity of the Gibbs measure, we add a sufficiently rich perturbation to the Hamiltonian. Let \((\lambda_n)_{n\in\mathbb{N}}\) be an enumeration of \([0,1]\cap \mathbb{Q}\), and let \((a_n)_{n\in\mathbb{N}}\) be an enumeration of \(\left((0,\infty)\cap\mathbb{Q}\right)^{D}\). Fix any realization of \(\mathfrak{R}\). For every \(h\in \mathbb{N}^4\), let \((H^h_N(\sigma,\alpha))_{\sigma\in\{-1,1\}^{D\times N},\,\alpha\in \mathop{\mathrm{supp}}\mathfrak{R}}\) be an independent centered Gaussian process with covariance \[\begin{align} \mathbb{E}\left[H^h_N(\sigma,\alpha)H^h_N(\sigma',\alpha')\right] = N\left(a_{h_1}\cdot \left(\tfrac{1}{N}\mathsf{diag}\left(\sigma\sigma'^\intercal\right)\right)^{\odot h_2}+\lambda_{h_3} \alpha\wedge\alpha'\right)^{h_4} \end{align}\] where \(\odot\) denotes the Schur product of vectors, that is, \(a\odot b = (a_ib_i)_{i}\). The existence of this process is justified in [3].

For each \(h \in \mathbb{N}^4\), let \(c_h>0\) be a constant such that \[\begin{align} c_h \sqrt{\tfrac{1}{N}\mathbb{E}\left[H^h_N(\sigma,\alpha)^2\right] }\leqslant 2^{-|h|_1}, \end{align}\] uniformly over \(\sigma\in\{-1,1\}^{D\times N}\), \(\alpha \in \mathop{\mathrm{supp}}\mathfrak{R}\), and \(N \in \mathbb{N}\), where \(|h|_1 := \sum_{i=1}^4 h_i\). For every \[\begin{align} \label{e46x95pert} x = (x_h)_{h\in\mathbb{N}^4}\in [0,3]^{\mathbb{N}^4}, \end{align}\tag{94}\] we set \[\begin{align} \label{e46H94pert} \begin{aligned} H_{N}^{x}(\sigma,\alpha) &:= \sum_{h\in \mathbb{N}^4} x_h c_h H^h_N(\sigma,\alpha). \end{aligned} \end{align}\tag{95}\] We define the perturbed free energy by \[\begin{align} \overline{F}^x_N(t,{q}) &:= -\frac{1}{N}\mathbb{E}\log \sum_{\sigma\in\{-1,1\}^{{D}\times N}}\int 2^{-{D}N}\exp\left(H^{t,{q}}_N(\sigma,\alpha) + N^{-\frac{1}{16}}H^{x}_N(\sigma,\alpha)\right) \mathrm{d}\mathfrak{R}(\alpha), \label{e46F94x95N61} \end{align}\tag{96}\] and define the associated Gibbs measure by \[\begin{align} \left\langle\cdot\right\rangle^{}_{N,x,q} &\propto \exp\left(H^{t,{q}}_N(\sigma,\alpha) + N^{-\frac{1}{16}}H^{x}_N(\sigma,\alpha)\right) \mathrm{d}\mathfrak{R}(\alpha) \mathrm{d}P_{\{-1,1\}^{D\times N}}(\sigma),\label{e46606294orig95Nx61} \end{align}\tag{97}\] where \(P_{\{-1,1\}^{D\times N}}\) denotes the uniform probability measure on \(\{-1,1\}^{D\times N}\). The exponent \(1/16\) in 96 is chosen for convenience; any smaller strictly positive exponent would also work. We keep writing \((\sigma,\alpha)\) for the canonical random variable under \(\left\langle\cdot\right\rangle^{}_{N,x,q}\), and write \((\sigma^\ell, \alpha^\ell)_{\ell \geqslant 1}\) for independent copies of \((\sigma,\alpha)\). The expectation \(\mathbb{E}\) in 96 integrates over all Gaussian randomness and over the randomness of \(\mathfrak{R}\).

For the cavity calculation, we use the reference Hamiltonian \((\widetilde{H}_N(\sigma))_{\sigma\in \{-1,1\}^{D\times N}}\) defined as the centered Gaussian process such that, for every \(\sigma, \sigma' \in \{-1,1\}^{D\times N}\), \[\begin{align} \mathbb{E}\left[\widetilde{H}_N(\sigma)\widetilde{H}_N(\sigma')\right] = (N+1)\xi\left(\mathsf{diag}\left(\tfrac{\sigma\sigma'^\intercal}{N+1}\right)\right). \end{align}\] Let \(\widetilde{W}^{q}_N\) be an independent copy of \(W^{q}_N\) defined in 77 . For every \(\sigma \in \{-1,1\}^{D\times N}\) and \(\alpha \in \mathop{\mathrm{supp}}\mathfrak{R}\), set \[\begin{align} \widetilde{H}^{t,{q}}_N(\sigma,\alpha) := \sqrt{2t}\widetilde{H}_N(\sigma) - t(N+1)\xi\left(\tfrac{N}{N+1}\vec{\mathbf{1}}\right) +\sqrt{2}\widetilde{W}^{q}_N(\alpha)\cdot \sigma - N{q}(1)\cdot\vec{\mathbf{1}}. \end{align}\] Here, \(\vec{\mathbf{1}}\) comes from \(\mathsf{diag}(\sigma\sigma^\intercal)=N\vec{\mathbf{1}}\). We denote the free energy and Gibbs measure used in the cavity computation by \[\begin{align} \label{e46tildeF95N61} \widetilde{F}_N^x(t,{q}) := -\frac{1}{N}\mathbb{E}\log\sum_{\sigma\in\{-1,1\}^{{D}\times N}}\int 2^{-{D}N} \exp\left(\widetilde{H}^{t,{q}}_N(\sigma,\alpha)+N^{-\frac{1}{16}} H^{x}_{N}(\sigma,\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha) \end{align}\tag{98}\] and \[\begin{align} \label{e46606294cav95N44x} \left\langle\cdot\right\rangle^\circ_{N,x,q} \propto \exp\left(\widetilde{H}^{t,{q}}_N(\sigma,\alpha) + N^{-\frac{1}{16}}H^{x}_N(\sigma,\alpha)\right)\mathrm{d}\mathfrak{R}(\alpha) \mathrm{d}P_{\{-1,1\}^{D\times N}}(\sigma). \end{align}\tag{99}\]

Remark 10. As observed in Remark 9, the results of Section 3 apply to the vector spin glass model \(\overline{F}_N\) considered here. The same arguments also apply to the perturbed free energies \(\overline{F}^x_N\) and \(\widetilde{F}^x_N\), since the perturbation affects the derivative computations only through the change of Gibbs measure. These results also hold uniformly in the perturbation parameter \(x\). In particular, for every \(t>0\), \(q\in\mathcal{Q}^{D}_\infty\), \(\pi\in L^2([0,1],\mathbb{R}^{D})\), and \(x\in[0,3]^{\mathbb{N}^4}\), the derivative formula in ?? gives \[\begin{align} \left\langle\pi,\partial_q \overline{F}^x_N(t,q)\right\rangle_{L^2}&= \mathbb{E}\left\langle\pi(\alpha\wedge\alpha')\cdot \mathsf{diag}\left(\tfrac{1}{N}\sigma\sigma'^\intercal\right) \right\rangle_{N,x,q}, \tag{100}\\ \left\langle\pi,\partial_q \widetilde{F}^x_N(t,q)\right\rangle_{L^2}&= \mathbb{E}\left\langle\pi(\alpha\wedge\alpha')\cdot \mathsf{diag}\left(\tfrac{1}{N}\sigma\sigma'^\intercal\right) \right\rangle_{N,x,q}^\circ. \tag{101} \end{align}\] Moreover, the Hamiltonian defining \(\left\langle\cdot\right\rangle_{N+1,x,q}\) depends only on \(\mathsf{diag}(\rho\rho'^\intercal)\), so \(\left\langle\cdot\right\rangle_{N+1,x,q}\) is invariant under permutations of the coordinates of \(\rho\). Writing \(\rho \in \{-1,1\}^{D\times (N+1)}\) as \(\rho =(\sigma,\tau)\) with \(\sigma\in \{-1,1\}^{D\times N}\) and \(\tau \in \{-1,1\}^{D\times 1}\), we can therefore rewrite 100 at size \(N+1\) as \[\begin{align} \label{e46dbarF94x95N43161} \left\langle\pi,\partial_q \overline{F}^x_{N+1}(t,q)\right\rangle_{L^2}&= \mathbb{E}\left\langle\pi(\alpha\wedge\alpha')\cdot \mathsf{diag}\left(\tau\tau'^\intercal\right) \right\rangle_{N+1,x,q}. \end{align}\tag{102}\]

5.1.2 Definitions for the free-energy cavity calculation↩︎

We next define the Gibbs average that appears in the free-energy cavity computation, namely in the Aizenman–Sims–Starr scheme [18]. Define \(\theta\) as in 69 , with \(\xi=\xi^{\mathrm{vec}}\) given in 93 . Thus, for every \(a \in \mathbb{R}^{D}\), \[\begin{align} \theta(a) := a\cdot \nabla \xi(a) - \xi(a). \end{align}\] We introduce the following independent centered Gaussian processes indexed by \(\sigma\in \{-1,1\}^{D\times N}\):

  • let \(\mathsf Z(\sigma)\) be an independent \(\mathbb{R}^{D}\)-valued centered Gaussian vector consisting of independent entries \(\mathsf Z_d(\sigma)\), for \(d\in\{1,\dots,{D}\}\), with covariance \(\mathbb{E}\mathsf Z_d(\sigma) \mathsf Z_d(\sigma')^\intercal =\nabla_d \xi \left(\mathsf{diag}\left(\frac{\sigma\sigma'^\intercal}{N}\right)\right)\) where \(\nabla_d\xi\) is the \(d\)-th entry in the \(\mathbb{R}^{D}\)-valued gradient \(\nabla\xi\);

  • let \(\mathsf Y(\sigma)\) be real-valued with covariance \(\mathbb{E}\mathsf Y(\sigma)\mathsf Y(\sigma') = \theta \left(\mathsf{diag}\left(\frac{\sigma\sigma'^\intercal}{N}\right)\right)\).

The existence of these processes is justified in [3]. For every \(\sigma \in \{-1,1\}^{D\times N}\), \(\tau \in \{-1,1\}^{D \times 1}\), and \(\alpha \in \mathop{\mathrm{supp}}\mathfrak{R}\), set \[\begin{align} \label{e46U61} U(\sigma,\alpha,\tau) := \sqrt{2t}\mathsf Z(\sigma)\cdot \tau - t\nabla\xi\left(\vec{\mathbf{1}}\right)\cdot\vec{\mathbf{1}}+ \sqrt{2}W^q_1(\alpha)\cdot\tau-{q}(1)\cdot\vec{\mathbf{1}}, \end{align}\tag{103}\] where the term \(\vec{\mathbf{1}}\) inside \(\nabla\xi\) comes from \(\mathsf{diag}(\sigma\sigma^\intercal)=N\vec{\mathbf{1}}\) and the two instances of \(\vec{\mathbf{1}}\) in inner products come from \(\tau\tau^\intercal =\vec{\mathbf{1}}\). For every \(x \in[0,3]^{\mathbb{N}^4}\), define \[\begin{gather} \label{e46A95N40x41} A_N(x,q) := \mathbb{E}\log \left\langle\sum_{\tau \in \{-1,1\}^{{D}\times1}} 2^{-{D}}\exp\left(U(\sigma,\alpha,\tau)\right) \right\rangle^\circ_{N,x,q} \\ - \mathbb{E}\log \left\langle\exp\left(\sqrt{2t}\mathsf Y(\sigma)- t\theta \left( \vec{\mathbf{1}}\right)\right) \right\rangle^\circ_{N,x,q}. \end{gather}\tag{104}\] Here, \(\theta=\theta^{\mathrm{vec}}\) is given in 83 . Recall the functional \(\mathscr{P}_{t,q}=\mathscr{P}_{t,q}^{\mathrm{vec}}\) defined in 84 . We will relate the limit of \(A_N(x,q)\) to \(\mathscr{P}_{t,{q}}({p})\) for a suitable choice of \({p}\). For every \(\pi \in \mathcal{Q}_\infty^{D}\), define the Gibbs measure \(\left\langle\cdot\right\rangle_{\mathfrak{R},\pi}\) by \[\begin{align} \label{e46606295R44pi} \left\langle\cdot\right\rangle_{\mathfrak{R},\pi} \propto \exp\left(\sqrt{2}w^\pi(\alpha)\cdot\tau -\pi(1)\cdot \vec{\mathbf{1}}\right) \mathrm{d}\mathfrak{R}(\alpha)\mathrm{d}P_{\{-1,1\}^{D\times 1}}(\tau), \end{align}\tag{105}\] and denote by \((\tau,\alpha)\) the canonical random variable under \(\left\langle\cdot\right\rangle_{\mathfrak{R},\pi}\). Comparing 105 with 99 , we have \(\left\langle\cdot\right\rangle_{\mathfrak{R},q'} = \left\langle\cdot\right\rangle_{1,0,q'}\) which is the Gibbs measure associated with \(\overline{F}_1(0,q')=\psi\). By the derivative formula ?? , we can see that for every \(q'\in\mathcal{Q}^{D}_\infty\) and every \(\pi\in L^2([0,1],\mathbb{R}^{D})\), we have \[\begin{align} \label{e46dqpsi61} \mathbb{E}\left\langle\pi(\alpha\wedge\alpha')\cdot \mathsf{diag}(\tau\tau'^\intercal)\right\rangle_{\mathfrak{R},q'} = \left\langle\pi,\partial_q \psi(q')\right\rangle_{L^2}, \end{align}\tag{106}\] which will be useful later. We will show that the limit of \(\mathbb{E}\left\langle g(\tau\tau'^\intercal,\alpha\wedge\alpha')\right\rangle^{}_{N+1,x,q}\) is related to \(\mathbb{E}\left\langle g(\tau\tau'^\intercal,\alpha\wedge\alpha') \right\rangle_{\mathfrak{R}, \pi}\) for a suitable choice of \(\pi\).

Proposition 11 (Free-energy cavity calculation). We have, uniformly over \(N \in \mathbb{N}\), \(x \in [0,3]^{\mathbb{N}^4}\), and \(q\in\mathcal{Q}_\infty^{D}\), \[\begin{align} &-(N+1)\overline{F}_{N+1}^x(t,q) + N\overline{F}_N^x(t,q) = A_N(x,q) + O\left(N^{-1/16}\right). \end{align}\]

Proof. This is essentially the uniform-in-\(q\) version of [3], which was stated for a fixed \(q\). Inspecting the proof shows that the estimates do not depend on \(q\). One can also see this directly from the \(q\)-dependent part of \(H^{t,q}_{N+1}(\rho,\alpha)\) in 78 appearing in \((N+1)\overline{F}^x_{N+1}(t,q)\). This part is given by \(\sqrt{2}W^q_{N+1}(\alpha)\cdot\rho-(N+1)q(1)\cdot \vec{\mathbf{1}}\), and it decomposes into \(\sqrt{2}W^q_N(\alpha)\cdot\sigma-Nq(1)\cdot \vec{\mathbf{1}}\) plus \(\sqrt{2}w^q(\alpha)\cdot \tau-q(1)\cdot \vec{\mathbf{1}}\), with the two terms taken to be independent. The first term is exactly the corresponding contribution in \(H^{t,q}_N(\sigma,\alpha)\) inside \(N\overline{F}_N^x(t,q)\), while the second term is included in \(U(\sigma,\alpha,\tau)\) inside \(A_N(x,q)\). Therefore the argument of [3] applies with estimates that are independent of \(q\). ◻

Lemma 13. Let \(\gamma = 1/16\). For every \(R>0\), there is a constant \(C>0\) such that \[\begin{align} \label{e46l46124F-F12460CN94-gamma} \sup_{t\leqslant R,\;|q|_{L^1}\leqslant R,\;x\in[0,3]^{\mathbb{N}^4}}\left|\widetilde{F}^x_N(t,q) - \overline{F}^x_{N+1}(t,q)\right|\leqslant CN^{-\gamma},\quad\forall N\in\mathbb{N}. \end{align}\tag{107}\]

Proof. By a standard Gaussian interpolation argument, there exists a constant \(C_1>0\) such that \[\begin{align} \label{e46124F-F94x12460} \sup_{x,q}\left|\overline{F}^x_N(t,{q})-\overline{F}_N(t,{q})\right|\leqslant C_1N^{-1/16},\qquad \sup_{x,q}\left|\widetilde{F}^x_N(t,{q})-\overline{F}_N(t,{q})\right|\leqslant C_1N^{-1/16} \end{align}\tag{108}\] for every \(N\in\mathbb{N}\). For the details, we refer to the proof of [3]. That proof shows that the above differences vanish as \(N\to\infty\). The stated rate is not written explicitly there, but it follows from the same estimates. By [3], there exists a constant \(C_2\) such that, for every \(N\in\mathbb{N}\), \(t\geqslant 0\), and \(q\in\mathcal{Q}_1^{D}\), \[\begin{align} \left|N\overline{F}_N(t,{q})-(N+1)\overline{F}_{N+1}(t,{q})\right|\leqslant C_2\left(t+|{q}|_{L^1}\right). \end{align}\] The Lipschitz estimate for \(\overline{F}_N\) in Proposition 7 and Remark 9 also gives a constant \(C_3>0\) such that \(|\overline{F}_N(t,q)|\leqslant C_3(1+|t|+|q|_{L^1})\). Combining these estimates yields 107 . ◻

5.2 Ghirlanda–Guerra identities and the limit of cavity computations↩︎

For every \(N\in\mathbb{N}\), \(\ell,\ell'\in\mathbb{N}\), \(h\in \mathbb{N}^4\), and \(n\in \mathbb{N}\), we write \[\begin{align} \label{e46overlap95notation} \begin{cases} R^{\ell,\ell'}_{N,\sigma} := \frac{1}{N}\mathsf{diag}\left(\sigma^\ell\left(\sigma^{\ell'}\right)^\intercal\right),\qquad R^{\ell,\ell'}_\alpha :=\alpha^\ell\wedge\alpha^{\ell'},\qquad R^{\ell,\ell'}_N :=\left(R^{\ell,\ell'}_{N,\sigma}, R^{\ell,\ell'}_\alpha\right); \\ R_N := \left(R^{\ell,\ell'}_N\right)_{\ell,\ell'\in\mathbb{N}},\qquad R^{\leqslant n}_N := \left(R^{\ell,\ell'}_N\right)_{\ell,\ell'\leqslant n} ; \\ R^{\ell,\ell'}_{N,h} := \left(a_{h_1}\cdot \left(R^{\ell,\ell'}_{N,\sigma}\right)^{\odot h_2}+\lambda_{h_3} R^{\ell,\ell'}_\alpha\right)^{h_4}. \end{cases} \end{align}\tag{109}\] For every \({p} \in \mathcal{Q}_\infty^{D}\), we set \[\begin{align} \label{e46overlap95alpha} Q^{\ell,\ell'}_{p} := \left({p}\left(R^{\ell,\ell'}_\alpha\right), R^{\ell,\ell'}_\alpha\right),\qquad Q_{p} := \left(Q^{\ell,\ell'}_{p}\right)_{\ell,\ell'\in \mathbb{N}},\qquad Q^{\leqslant n}_{p} := \left(Q^{\ell,\ell'}_{p}\right)_{1\leqslant\ell,\ell'\leqslant n}. \end{align}\tag{110}\] In some situations, the \(R_{N,\sigma}\)-overlaps synchronize with the \(R_\alpha\)-overlaps. In that case, the \(R_N\)-overlaps are close to the \(Q_p\)-overlaps for a suitable choice of \(p\).

Let \(\mathbb{E}_x\) denote the expectation with respect to an i.i.d.sequence \(x\) of uniform random variables on \([1,2]\). For \(N\in\mathbb{N}\), an integer \(n\geqslant 2\), \(h\in\mathbb{N}^4\), and a bounded measurable function \(\mathbf{f}:\left(\mathbb{R}^{D}\times \mathbb{R}\right)^{n\times n}\to \mathbb{R}\), define, with \(\left\langle\cdot\right\rangle^\circ= \left\langle\cdot \right\rangle^\circ_{N,x,q}\) as in 99 , \[\label{e46Delta94x} \Delta^{x,q}_N(\mathbf{f},n,h) = \left|\mathbb{E}\left\langle\mathbf{f}\left(R^{\leqslant n}_N\right)R^{1,n+1}_{N,h} \right\rangle^\circ- \frac{1}{n}\mathbb{E}\left\langle\mathbf{f}\left(R^{\leqslant n}_N\right)\right\rangle^\circ\mathbb{E}\left\langle R^{1,2}_{N,h}\right\rangle^\circ- \frac{1}{n}\sum_{l=2}^n \mathbb{E}\left\langle\mathbf{f}\left(R^{\leqslant n}_N\right) R^{1,l}_{N,h}\right\rangle^\circ\right|.\tag{111}\] In 111 and throughout this subsection, \(\mathbb{E}\) integrates the Gaussian randomness in the Hamiltonian and the randomness in \(\mathfrak{R}\), but not the perturbation parameter \(x\).

We enumerate all triples \((\mathbf{f},n,h)\) as \(((\mathbf{f}_j,n_j,h_j))_{j\in\mathbb{N}}\), where \(\mathbf{f}:\left(\mathbb{R}^{D}\times\mathbb{R}\right)^{n\times n}\to\mathbb{R}\) is a monomial with coefficient \(1\), \(n\in\mathbb{N}\), and \(h\in\mathbb{N}^4\). We then modify each \(\mathbf{f}_j\) in two steps. First, since \(R^{\leqslant n}\) is bounded, we change \(\mathbf{f}_j\) outside a bounded set so that it becomes bounded. Second, we rescale \(\mathbf{f}_j\) to ensure that \[\begin{align} \label{e46Delta601} \Delta^{x,q}_N(\mathbf{f}_j,n_j,h_j)\leqslant 1,\qquad\forall j\in\mathbb{N},\;x\in[0,3]^{\mathbb{N}^4},\;q\in\mathcal{Q}_\infty^{D}. \end{align}\tag{112}\] For each \(N \in \mathbb{N}\) and \(x \in [0,3]^{\mathbb{N}^4}\), set \[\begin{align} \label{e46Delta95N40x41} \Delta_N(x,q) := \sum_{j=1}^\infty 2^{-j} \Delta^{x,q}_N(\mathbf{f}_j,n_j,h_j). \end{align}\tag{113}\]

Proposition 12. For every \(R<\infty\), we have \[\begin{align} \label{e46uniform95perturbation} \lim_{N\to\infty}\sup_{q\in\mathcal{Q}_\infty^{D}:\:|q|_{L^\infty}\leqslant R}\mathbb{E}_x\Delta_N(x,q)=0. \end{align}\qquad{(5)}\]

Proof. We first prove the uniform version for each fixed test triple \((\mathbf{f}_j,n_j,h_j)\). The proof of [3] is uniform over the background Hamiltonian. In the present notation, the path \(q\) only enters through the unperturbed part of the Gibbs weight, namely through the cascade field in \(H_N^{t,q}\). The perturbative Hamiltonians indexed by \(x\) are independent of this field, and the estimates in the proof of [3] depend only on the bounded test function, on \(n_j,h_j\), and on the uniform bounds on the overlaps, but not on the particular choice of \(q\) in a bounded subset of \(\mathcal{Q}_\infty^{D}\). Therefore, for every \(R<\infty\) and every fixed \(j\), \[\begin{align} \label{e46uniform95Delta95j} \lim_{N\to\infty}\sup_{|q|_{L^\infty}\leqslant R}\mathbb{E}_x\Delta^{x,q}_N(\mathbf{f}_j,n_j,h_j)=0. \end{align}\tag{114}\] Using 112 , for every \(J\in\mathbb{N}\) we have \[\begin{align} \sup_{|q|_{L^\infty}\leqslant R}\mathbb{E}_x\Delta_N(x,q) &\leqslant\sum_{j=1}^J2^{-j}\sup_{|q|_{L^\infty}\leqslant R}\mathbb{E}_x\Delta^{x,q}_N(\mathbf{f}_j,n_j,h_j)+\sum_{j>J}2^{-j}. \end{align}\] Taking \(\limsup_{N\to\infty}\) and using 114 and then letting \(J\to\infty\), we obtain ?? . ◻

The next result is a modified version of [3]. The main change is that we allow \(q_k\) to vary, instead of keeping the cascade path fixed.

Proposition 13. We fix \((t,q)\in(0,\infty)\times \mathcal{Q}_\infty^{D}\) and suppose that there is a sequence \((N_k,x_k,q_k)_{k\in\mathbb{N}}\) such that \(\lim_{k\to\infty} N_k=+\infty\), \(\lim_{k\to\infty}\Delta_{N_k}(x_k,q_k)=0\), \(\sup_k|q_k|_{L^\infty}<\infty\), and \(q_k\) converges pointwise a.e.to some \(q\in\mathcal{Q}_\infty^{D}\). Then, there are a subsequence \((N'_k,x'_k,q'_k)_{k\in\mathbb{N}}\) and \({p}\in \mathcal{Q}^{D}_{\infty,\leqslant 1}\) such that

  1. \(R_{N'_k}\) under \(\mathbb{E}\left\langle\cdot\right\rangle^\circ_{N'_k,x'_k,q'_k}\) converges in law to \[\begin{align} \left(Q^{\ell,\ell'}_{p}\mathbb{1}_{\ell\neq \ell'}+ (\vec{\mathbf{1}},1) \mathbb{1}_{\ell =\ell'}\right)_{\ell,\ell'\in\mathbb{N}} \end{align}\] under \(\mathbb{E}\left\langle\cdot\right\rangle_\mathfrak{R}\) as \(k\) tends to infinity;

  2. we have \(\lim_{k\to\infty}A_{N'_k}\left(x'_k,q'_k\right) =- \mathscr{P}_{t,{q}}({p})\);

  3. for every bounded continuous \(g:\mathbb{R}^{{D}}\times \mathbb{R}\to\mathbb{R}\), \[\lim_{k\to\infty} \mathbb{E}\left\langle g\left(\mathsf{diag}\left(\tau\tau'^\intercal\right), \alpha\wedge\alpha'\right)\right\rangle_{N'_k+1,x'_k,q'_k} =\mathbb{E}\left\langle g\left(\mathsf{diag}\left(\tau\tau'^\intercal\right), \alpha\wedge\alpha'\right)\right\rangle_{\mathfrak{R},{q}+t\nabla\xi({p})}.\]

In Proposition 13, when we say that \((N_k', x_k', q_k')_{k \in \mathbb{N}}\) is a subsequence, we mean that \[\begin{align} \lim_{k \to \infty} N_k' = +\infty\qquad\text{and}\qquad \{(N_k', x_k', q_k') \mid k \in \mathbb{N}\} \subseteq\{(N_k, x_k, q_k) \mid k \in \mathbb{N}\}. \end{align}\]

We set the number of cavity spins \(M\) in [3] equal to \(1\). Here, we also allow dependence on \(q_k\) in \(A_N(x,q)\), \(\Delta_N(x,q)\), and the Gibbs measures \(\left\langle\cdot\right\rangle^\circ_{N,x,q}\) and \(\left\langle\cdot\right\rangle_{N+1,x,q}\). Apart from the resulting notational changes, the only point that needs attention is the display [3], which should be replaced by \[\begin{gather} \label{e46joint95cvg95in95law951} \big(R_{N'_k}, q'_k(R_\alpha)\big) under \mathbb{E}\left\langle\cdot\right\rangle^\circ_{N'_k,x'_k,q'_k} converges in law\\ to \big(R_\infty, q(R_\alpha)\big) under \mathbb{E}\left\langle\cdot \right\rangle_\mathfrak{R} as k tends to infinity. \end{gather}\tag{115}\] In the original version, \(q'_k\) is fixed to be \(q\). Here, the law of the cascade overlap \(R_\alpha\) remains the same under the two measures in the display, by the invariance property. Since \(q'_k\) converges to \(q\) a.e.and \(q\) is nondecreasing, the original argument still applies and the convergence in law remains valid. Lemmas 6.3, 6.6, and 6.7 in [3] are used in the original proof. Because of the uniform bound on \(q_k\), these lemmas also hold uniformly in \(q_k\).

6 Bounds by critical points↩︎

In this section, we work with the vector spin glass model in 7479 and use the shorthand notation from 93 . The goal is to prove the following result.

Theorem 3. For every \(t > 0\) and \(q \in \mathcal{Q}_1^{D}\), there exist \(p^+, p^- \in \mathcal{Q}_{\infty,\leqslant 1}^{D}\) such that \[\label{e46t46crit46up46low21} p^+=\partial_q\psi(q+t\nabla\xi(p^+)), \qquad p^-=\partial_q\psi(q+t\nabla\xi(p^-)),\tag{116}\] and \[\label{e46t46crit46up46low22} \mathscr{P}_{t,q}(p^-) \leqslant\liminf_{N \to \infty} \overline{F}_N(t,q) \leqslant\limsup_{N\to\infty} \overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+).\tag{117}\]

Let \(\{e_d\}_{d\in\{1,\dots,{D}\}}\) be the standard basis of \(\mathbb{R}^{D}\). Let \(\varphi:[0,1]\to[0,\infty)\) be a smooth function that satisfies \(\int \varphi =1\) and \(\mathop{\mathrm{supp}}\varphi\subseteq(0,1)\). For \(\varepsilon>0\), we define \(\varphi_\varepsilon=\frac{1}{\varepsilon}\varphi(\frac{\cdot}{\varepsilon})\). Let \(i\in\mathbb{N}\) be an enumeration of \((\mathbb{Q}\cap [0,1))\times \{1,\dots,{D}\}\times (\mathbb{Q}\cap(0,1])\) and take paths \(q_i\in\mathcal{Q}^{D}_\infty\) to satisfy \[\begin{align} \label{e46q95i61} \{q_i\}_{i\in\mathbb{N}} = \left\{(\mathbb{1}_{[r,1)}*\varphi_\varepsilon)e_d\right\}_{r\in\mathbb{Q}\cap [0,1),\, d\in\{1,\dots,{D}\},\, \varepsilon\in \mathbb{Q}\cap (0,1]} \end{align}\tag{118}\] where \(\mathbb{1}_{[r,1)}*\varphi_\varepsilon(s) = \int \mathbb{1}_{[r,1)}(s-\tau)\varphi_\varepsilon(\tau)\mathrm{d}\tau\) for \(s\in[0,1)\). For any \(p,p'\in\mathcal{Q}_2^{D}\), we have \[\begin{align} \label{e46p61p39iff60q95i44p626160q95i44p3962} p=p'\qquad\text{if and only if} \qquad \left\langle q_i, p\right\rangle_{L^2} = \left\langle q_i,p'\right\rangle_{L^2}\quad\text{for every i\in\mathbb{N}}. \end{align}\tag{119}\] This can be deduced as follows. We can see that \(p=p'\) if and only if \(\left\langle\mathbb{1}_{[r,1)}e_d,p\right\rangle_{L^2} = \left\langle\mathbb{1}_{[r,1)}e_d,p'\right\rangle_{L^2}\) for every \(r\in[0,1)\) and \(d\in \{1,\dots {D}\}\). Since the collection \(\{q_i\}_{i\in\mathbb{N}}\) consists of approximations of these paths, we get 119 .

Due to the mollification by \(\varphi_\varepsilon\), each \(q_i\) is smooth. We set \[\begin{align} \label{e46a95i61} a_i:=3^{-1}2^{-i}\max\left\{1,\;|q_i|_{L^\infty},\;|\accentset{\large\bfseries .}{q}_i|_{L^\infty}\right\}^{-1}\qquad\text{for every i\in\mathbb{N}}. \end{align}\tag{120}\] Let \(\gamma\) be given as in Lemma 13. For each \(N\in\mathbb{N}\) and \(y\in[0,3]^\mathbb{N}\), we define \[\label{e46q95N40y4161} q_N(y):=N^{-\gamma/2}\sum_{i=1}^\infty a_iy_iq_i.\tag{121}\] The value of the path \(q_N(y)\) at a point \(s\in[0,1)\) is written as \(q_N(y)(s)\). By the definition of \(a_i\), we have \[\label{e46124q95i124611} |q_N(y)|_{L^\infty}\leqslant N^{-\gamma/2} \qquad\text{and}\qquad |\accentset{\large\bfseries .}{q}_N(y)|_{L^\infty}\leqslant N^{-\gamma/2} \qquad\text{for every y\in[0,3]^\mathbb{N} and every N\in\mathbb{N}}.\tag{122}\] In the following, we will add to \(q\) the perturbation \(q_N(y)\).

Henceforth, we denote by \(\mathbb{E}_y\) the expectation under which \((y_i)_{i\in\mathbb{N}}\) are i.i.d.random variables with uniform distribution over \([1,2]\).

Lemma 14. There is a constant \(C>0\) such that the following holds. Let \(f,g:[0,3]\to\mathbb{R}\) be twice differentiable functions satisfying \(|f'|,|g'|\leqslant a\) and \(f'',g''\leqslant b\) for some constants \(a,b>0\). We have \[\begin{align} \label{e46l46semi-concav95L1} \int_1^2\left|f'-g'\right|^2 \leqslant C(a+b)\|f-g\|_{L^\infty[0,3]}. \end{align}\tag{123}\]

Proof. Let \(\eta:[0,3]\to[0,1]\) be smooth and satisfy \(\eta=1\) on \([1,2]\) and \(\eta(0)=\eta(3)=0\). Using the properties of \(\eta\) and integrating by parts, we have \[\begin{align} \int_1^2\left|f'-g'\right|^2 \leqslant\int_0^3\eta \left(f'-g'\right)^2= - \int_0^3\eta'(f-g)(f'-g')-\int_0^3 \eta(f-g)(f''-g''). \end{align}\] Next, we estimate each term on the right. We write \(L^\infty = L^\infty[0,3]\). We start with \[\begin{align} \left|\int_0^3\eta'(f-g)(f'-g')\right|\leqslant 6a\|\eta'\|_{L^\infty} \|f-g\|_{L^\infty} \end{align}\] to bound the first term. For the second term, we have \[\begin{align} \left|\int_0^3 \eta(f-g)(f''-g'')\right|\leqslant\|\eta\|_{L^\infty}\|f-g\|_{L^\infty}\int_0^3\left|f''-g''\right|. \end{align}\] Since \(b-f'',\, b-g''\geqslant 0\), we have \[\begin{align} \int_0^3\left|f''-g''\right|\leqslant\int_0^3 \left|b-f''\right|+\left|b-g''\right| = \int_0^3 2b-f''-g''=6b-f'(3)-g'(3)+f'(0)+g'(0) \\ \leqslant 6b + 4a. \end{align}\] Combining the above displays, we can deduce 123 . ◻

Lemma 15. Let \(t>0\) and \(q\in\mathcal{Q}_{\uparrow,c}^{D}\) for some \(c>0\). There is a constant \(b>0\) such that \[\begin{align} \frac{\mathrm{d}^2}{\mathrm{d}r^2}\overline{F}_N\left(t,\;q+a_i r q_i+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j \right) \leqslant b,\quad\forall i\in\mathbb{N},\; N\in \mathbb{N}, \; r\in[0,1). \end{align}\] Moreover, the same holds for \(\widetilde{F}_N^x\) and \(\overline{F}^x_{N+1}\) in place of \(\overline{F}_N\) uniformly in \(x\in[0,3]^{\mathbb{N}^4}\).

Proof. Since \(r, a_j\geqslant 0\) and \(q_i, q_j\) are increasing paths, we can deduce from the definition of \(\mathcal{Q}_{\uparrow,c}\) in 54 that \[\begin{align} q+a_i r q_i+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j \in \mathcal{Q}_{\uparrow,c}^{D},\qquad\forall i \in\mathbb{N},\;N\in\mathbb{N},\;r\in[0,1). \end{align}\] Fix any \(i\in\mathbb{N}\) and write \(q_* = q+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j\) and \(\kappa = a_iq_i\). Then, the above display ensures that \(q_*+r\kappa\in\mathcal{Q}_{\uparrow,c}^{D}\) for every \(N\) and \(r\). We also write \(F(r)=\overline{F}_N(t,q_*+r\kappa)\). For \(\varepsilon>0\) small, applying Proposition 81 (see also Remark 9) with \(\frac{1}{2}, q_*+r\kappa, q_*+(r+\varepsilon)\kappa\) substituted for \(r, q,q'\) therein, we get \[\begin{align} \tfrac{1}{2}F(r)+\tfrac{1}{2}F(r+\varepsilon)- F\left(r+\tfrac{\varepsilon}{2}\right)\leqslant\tfrac{C}{4} c^{-2}\varepsilon^2\left|\accentset{\large\bfseries .}{\kappa}\right|_{L^2}^2 \end{align}\] for some absolute constant \(C>0\). Dividing both sides by \(\varepsilon^2\), sending \(\varepsilon\to0\), and using \(\kappa=a_iq_i\), we can get \(\frac{\mathrm{d}^2}{\mathrm{d}r^2}F(r)\leqslant 2Cc^{-2}\left|a_i\accentset{\large\bfseries .}{q}_i\right|_{L^2}^2 \leqslant 2Cc^{-2}\), where we also used 120 in the last inequality. This implies the desired result.

To obtain the estimates for \(\widetilde{F}_N^x\) and \(\overline{F}^x_{N+1}\), we can again apply Proposition 8 together with Remark 10. ◻

We fix \((t,q)\) and set \[\begin{align} \label{e46D95N44i40x44y4161} \mathcal{D}_{N,i}(x,y):= \left|\left\langle q_i,\;\partial_q \widetilde{F}_N^x(t, q+q_N(y)) - \partial_q \overline{F}_{N+1}^x(t, q+q_N(y))\right\rangle_{L^2}\right|^2. \end{align}\tag{124}\]

Lemma 16. There is a constant \(C < +\infty\) such that \[\begin{align} \mathbb{E}_y \mathcal{D}_{N,i}(x,y)\leqslant C a_i^{-2} N^{-\gamma/2},\qquad\forall i\in\mathbb{N},\;N\in\mathbb{N},\;x\in[0,3]^{\mathbb{N}^4}. \end{align}\]

Proof. Fix any \(i\in\mathbb{N}\) and fix any \(y_j\in[0,3]\) for every \(j\neq i\). We write \(\widetilde{f}(y_i) = \widetilde{F}_N^x(t, q+q_N(y))\) and \(\overline{f}(y_i) = \overline{F}_{N+1}^x(t, q+q_N(y))\) as functions of \(y_i\in[0,3]\) only. In view of the definition of \(q_N(y)\) in 121 , we can compute the derivatives \[\begin{align} \label{e46f3961} \widetilde{f}'(y_i) = N^{-\gamma/2}a_i\left\langle q_i,\partial_q \widetilde{F}_N^x(t, q+q_N(y))\right\rangle_{L^2}\quad\text{and}\quad \overline{f}'(y_i) = N^{-\gamma/2}a_i\left\langle q_i,\partial_q \overline{F}_{N+1}^x(t, q+q_N(y))\right\rangle_{L^2}. \end{align}\tag{125}\] By the boundedness of \(\partial_q \widetilde{F}_N^x\) and \(\partial_q \overline{F}_{N+1}^x\) as ensured by Proposition 7 and Remark 10, there is some constant \(C_1>0\) such that \[\begin{align} \label{e46124f3912460} \big|\widetilde{f}'(y_i)\big|,\;\big|\overline{f}'(y_i)\big|\leqslant C_1N^{-\gamma/2}a_i|q_i|_{L^2}\stackrel{\eqref{e46a95i61}}{\leqslant}C_1N^{-\gamma/2},\qquad\forall y_i\in [0,3]. \end{align}\tag{126}\] Applying Lemma 15 with \(N^{-\gamma/2}y_i\) substituted for \(r\) and using the chain rule (since \(y_i\in[0,3]\), we only need \(3N^{-\gamma/2}< 1\) to ensure \(N^{-\gamma/2}y_i<1\)), we get \[\begin{align} \label{e46f393960} \widetilde{f}''(y_i),\;\overline{f}''(y_i)\leqslant N^{-\gamma}b,\qquad\forall y_i\in[0,3],\;N\in\mathbb{N}. \end{align}\tag{127}\] By Lemma 13, there is some absolute constant \(C_2\) such that \(\|\widetilde{f}-\overline{f}\|_{L^\infty[0,3]}\leqslant C_2 N^{-\gamma}\). Inserting this, 126 and 127 into Lemma 14, we get \[\begin{align} \int_1^2 \left|\widetilde{f}' - \overline{f}'\right|^2\leqslant C_3\left(C_1N^{-\gamma/2}+N^{-\gamma}b\right)C_2 N^{-\gamma},\qquad\forall N\in\mathbb{N}, \end{align}\] for some constant \(C_3>0\). Comparing 125 with 124 , we have \(\int_1^2 \left|\widetilde{f}' - \overline{f}'\right|^2 = N^{-\gamma}a_i^2 \mathbb{E}_y \mathcal{D}_{N,i}(x,y)\), which together with the above display gives the desired result. ◻

With \((t,q)\) fixed, we set \[\begin{align} \label{e46D95N40x44y4161} \mathcal{D}_N(x,y) := \sum_{i=1}^\infty 2^{-i} a_i^2 \mathcal{D}_{N,i}(x,y). \end{align}\tag{128}\] We denote by \(\mathbb{E}_{x,y}\) the joint expectation under which \((x_h)_{h\in\mathbb{N}^4}\) and \((y_i)_{i\in\mathbb{N}}\) are i.i.d.random variables with uniform distribution over \([1,2]\). Recall \(A_N\) and \(\Delta_N\) introduced in 104 and 113 , respectively. Henceforth, we set \[\begin{align} \label{e46A95N40x44y4144Delta40x44y4161} A_N(x,y):= A_N(x,q+q_N(y))\qquad\text{and}\qquad \Delta_N(x,y):= \Delta_N(x,q+q_N(y)). \end{align}\tag{129}\]

Lemma 17. There exists a sequence \((x_N,y_N)_{N\in\mathbb{N}}\) such that \[\begin{gather} \liminf_{N\to\infty}A_N(x_N,y_N)\leqslant\liminf_{N\to\infty}\mathbb{E}_{x,y} A_N(x,y), \tag{130}\\ \lim_{N\to\infty}\Delta_N(x_N,y_N)=0, \tag{131}\\ \lim_{N\to\infty} \mathcal{D}_N(x_N,y_N) = 0. \tag{132} \end{gather}\] There also exists another sequence \((x'_N,y'_N)_{N\in\mathbb{N}}\) such that \[\begin{align} \limsup_{N\to\infty}\mathbb{E}_{x,y} A_N(x,y)\leqslant\limsup_{N\to\infty}A_N(x'_N,y'_N), \label{e46limsupEA60limsupA2} \end{align}\tag{133}\] and such that 131 and 132 hold with \((x'_N,y'_N)\) in place of \((x_N,y_N)\).

Proof. The boundedness of \(\partial_q \widetilde{F}_N^x\) and \(\partial_q \overline{F}_{N+1}^x\) from ?? , together with 124 , implies that there is an absolute constant \(C>0\) such that \(\mathcal{D}_{N,i}(x,y)\leqslant C|q_i|_{L^2}^2\) uniformly in \(i,N,x,y\). By the choice of \(a_i\) in 120 , this gives \(\left|a_i^2\mathcal{D}_{N,i}(x,y)\right|\leqslant C\) uniformly in \(i,N,x,y\), and therefore justifies interchanging \(\sum_{i=1}^\infty\) with \(\mathbb{E}_{x,y}\) in \(\mathbb{E}_{x,y}\mathcal{D}_N(x,y)\). Combining this with Lemma 16, we obtain \(\mathbb{E}_{x,y} \mathcal{D}_N(x,y)\leqslant CN^{-\gamma/2}\), and hence \[\begin{align} \lim_{N\to\infty} \mathbb{E}_{x,y}\mathcal{D}_N(x,y)=0. \end{align}\] Recall from 113 that \[\begin{align} \Delta_N(x,q+q_N(y)) = \sum_{j=1}^\infty 2^{-j}\Delta_N^{x,q+q_N(y)}(\mathbf{f}_j,n_j,h_j). \end{align}\] By 111 and 112 , we have \(0\leqslant\Delta_N^{x,q+q_N(y)}(\mathbf{f}_j,n_j,h_j)\leqslant 1\) uniformly in \(x,y,j\). By 122 , we have \(|q+q_N(y)|_{L^\infty}\leqslant|q|_{L^\infty}+1\) uniformly in \(N\) and \(y\). Applying Proposition 12, we get \(\lim_{N\to\infty}\mathbb{E}_x\Delta_N(x,y)=0\) for every \(y\). The same bounded-convergence argument as above then yields \[\begin{align} \lim_{N\to\infty}\mathbb{E}_{x,y}\Delta_N(x,y)=0. \end{align}\] Setting \(\mathcal{E}_N(x,y)=\mathcal{D}_N(x,y)+\Delta_N(x,y)\), we have \[\begin{align} \label{e46limEE95N610} \lim_{N\to\infty}\mathbb{E}_{x,y} \mathcal{E}_N(x,y) = 0. \end{align}\tag{134}\] It remains to choose a sequence along which 130 holds and \(\mathcal{E}_N\) vanishes. We use the argument of [5], which we recall in the present notation. From the expression of \(A_N\) in 104 and Jensen’s inequality, there exists a constant \(c>0\) such that \(|A_N(x,y)|\leqslant c\) uniformly in \(N,x,y\). For any \(\varepsilon>0\), define \[\begin{align} \Omega_{\varepsilon,N} = \left\{(x,y):\:A_N(x,y)\leqslant\mathbb{E}_{x,y}A_N(x,y)+\varepsilon\right\}. \end{align}\] Let \(\mathbb{P}_{x,y}\) be the probability measure associated with \(\mathbb{E}_{x,y}\). Then \[\begin{align} \mathbb{E}_{x,y} A_N(x,y) \geqslant\left(\mathbb{E}_{x,y}A_N(x,y)+\varepsilon\right)\mathbb{P}_{x,y}\left(\Omega_{\varepsilon,N}^{\complement}\right)-c \mathbb{P}_{x,y}(\Omega_{\varepsilon,N}), \end{align}\] and therefore \[\begin{align} \mathbb{P}_{x,y}(\Omega_{\varepsilon,N})\geqslant\frac{\varepsilon}{\mathbb{E}_{x,y}A_N(x,y)+\varepsilon+c}>\frac{\varepsilon}{3c},\qquad\forall \varepsilon\in(0,c). \end{align}\] On the other hand, Markov’s inequality gives \[\begin{align} \mathbb{P}_{x,y}\left(\mathcal{E}_N\leqslant\varepsilon\right)\geqslant 1 -\frac{\mathbb{E}_{x,y}\mathcal{E}_N}{\varepsilon}. \end{align}\] Thus \(\Omega_{\varepsilon,N}\cap\left\{\mathcal{E}_N\leqslant\varepsilon\right\}\neq \emptyset\) whenever \(\frac{\mathbb{E}_{x,y}\mathcal{E}_N}{\varepsilon}<\frac{\varepsilon}{3c}\) and \(\varepsilon\in(0,c)\). Taking \(\varepsilon=2(c\mathbb{E}_{x,y}\mathcal{E}_N)^{1/2}\) and using 134 , these two conditions hold for all sufficiently large \(N\). Hence, for such \(N\), we can choose \((x_N,y_N)\) so that \[\begin{align} \mathcal{E}_N(x_N,y_N)\leqslant 2(c\mathbb{E}_{x,y}\mathcal{E}_N)^{1/2}\qquad\text{and}\qquad A_N(x_N,y_N)\leqslant\mathbb{E}_{x,y} A_N(x,y) + 2(c\mathbb{E}_{x,y}\mathcal{E}_N)^{1/2}. \end{align}\] Together with 134 , this proves 130 , 131 , and 132 . The second sequence is obtained by applying the same argument to \(-A_N\) in place of \(A_N\). ◻

The next lemma isolates the telescoping argument that expresses the free energy in terms of the averaged cavity increments.

Lemma 18. Let \(t>0\) and \(q\in\mathcal{Q}_\infty^{D}\). With \(A_j(x,y)=A_j(x,q+q_j(y))\) as in 129 , we have \[\begin{align} \label{e46F95N61-147NsumA95j} \overline{F}_N(t,q)=-\frac{1}{N}\sum_{j=1}^{N-1}\mathbb{E}_{x,y}A_j(x,y)+o(1). \end{align}\tag{135}\]

Proof. Using the Lipschitz continuity of \(\overline{F}_N(t,\cdot)\) from Proposition 7 and Remark 9, the bound on the difference between \(\overline{F}_N\) and \(\overline{F}_N^x\) in 108 , and the estimate \(|q_N(y)|_{L^\infty}\leqslant N^{-\gamma/2}\), we can find constants \(C,c'>0\) such that \[\begin{align} \label{e46F95N95compare95moving95q95N} \left|\overline{F}_N(t,q)-\overline{F}_N^x(t,q+q_N(y))\right|\leqslant CN^{-c'} \end{align}\tag{136}\] uniformly in \(N,x,y\). Set \[\begin{align} Q_j(y):=q+q_j(y),\qquad j\geqslant 1. \end{align}\] We apply Proposition 11 with the moving path \(Q_j(y)\). For \(1\leqslant j\leqslant N-1\), we have \[\begin{align} &-(j+1)\overline{F}_{j+1}^x(t,Q_{j+1}(y))+j\overline{F}_j^x(t,Q_j(y)) \\ &\qquad=-(j+1)\overline{F}_{j+1}^x(t,Q_j(y))+j\overline{F}_j^x(t,Q_j(y)) -(j+1)\left(\overline{F}_{j+1}^x(t,Q_{j+1}(y))-\overline{F}_{j+1}^x(t,Q_j(y))\right) \\ &\qquad=A_j(x,y)+O\left(j^{-\gamma}\right)+O\left(j\,|q_{j+1}(y)-q_j(y)|_{L^1}\right), \end{align}\] uniformly in \(x\) and \(y\). Here we used the uniform Lipschitz continuity of \(\overline{F}_j^x(t,\cdot)\) and the definition \(A_j(x,y)=A_j(x,Q_j(y))\). Summing over \(1\leqslant j\leqslant N-1\), the left-hand side telescopes and gives \[\begin{align} -N\overline{F}_N^x(t,Q_N(y))+\overline{F}_1^x(t,Q_1(y)) =\sum_{j=1}^{N-1}A_j(x,y)+O\left(\sum_{j=1}^{N-1}j^{-\gamma}\right)+O\left(\sum_{j=1}^{N-1}j\,|q_{j+1}(y)-q_j(y)|_{L^1}\right). \end{align}\] By the definition of \(q_j(y)\) in 121 , we can write \(q_j(y)=j^{-\gamma/2}B(y)\) with \(|B(y)|_{L^1}\) uniformly bounded in \(y\). Hence \[\begin{align} |q_{j+1}(y)-q_j(y)|_{L^1}\leqslant C\left(j^{-\gamma/2}-(j+1)^{-\gamma/2}\right)\leqslant Cj^{-1-\gamma/2}. \end{align}\] It follows that \[\begin{align} \frac{1}{N}\sum_{j=1}^{N-1}j^{-\gamma}=O(N^{-\gamma})=o(1) \end{align}\] and \[\begin{align} \frac{1}{N}\sum_{j=1}^{N-1}j\,|q_{j+1}(y)-q_j(y)|_{L^1}\leqslant\frac{C}{N}\sum_{j=1}^{N-1}j^{-\gamma/2}=O(N^{-\gamma/2})=o(1). \end{align}\] Since \(\overline{F}_1^x(t,Q_1(y))\) is uniformly bounded, we obtain \[\begin{align} \overline{F}_N^x(t,q+q_N(y))=-\frac{1}{N}\sum_{j=1}^{N-1}A_j(x,y)+o(1), \end{align}\] uniformly in \(x\) and \(y\). Combining this with 136 , and then averaging over \((x,y)\), gives 135 . ◻

Proof of Theorem 3. Fix \(t>0\). We first prove the upper bound in 117 for \(q\in\mathcal{Q}_{\uparrow,c}^{D}\cap \mathcal{Q}_\infty^{D}\subseteq\mathcal{Q}_{\infty,\uparrow}^{D}\) (see 54 ) with some \(c>0\), and then obtain the general case by continuity.

Let \((x_N,y_N)_{N\in\mathbb{N}}\) be the sequence in \([0,3]^{\mathbb{N}^4}\times [0,3]^\mathbb{N}\) given by Lemma 17, so that 130 , 131 , and 132 hold. Let \((N_k)_{k\in\mathbb{N}}\) be a subsequence along which \(A_N(x_N,y_N)\) attains the liminf in 130 . Then \[\begin{align} \limsup_{N\to\infty}\overline{F}_N(t,q) &\stackrel{\eqref{e46F95N61-147NsumA95j}}{\leqslant} \limsup_{N\to\infty}-\frac{1}{N}\sum_{j=1}^{N-1}\mathbb{E}_{x,y}A_j(x,y) \notag\\ &\leqslant\limsup_{N\to\infty}-\mathbb{E}_{x,y}A_N(x,y) \stackrel{\eqref{e46liminfA60liminfEA2}}{\leqslant} \limsup_{N\to\infty}-A_N(x_N,y_N) = \lim_{k\to\infty}-A_{N_k}(x_{N_k},y_{N_k}). \label{e46limsupF60-limA95k2} \end{align}\tag{137}\] For the rest of this part, set \[\begin{align} q_k := q+q_{N_k}(y_{N_k}),\qquad k\in\mathbb{N}. \end{align}\] For each continuous path \(\kappa\in\mathcal{Q}_\infty^{D}\), the derivative formulas 101 and 102 give \[\begin{align} \left\langle\kappa,\,\partial_q\widetilde{F}_{N_k}^{x_{N_k}}\left(t,q_k\right)\right\rangle_{L^2}&= \mathbb{E}\left\langle\kappa(\alpha\wedge\alpha')\cdot \mathsf{diag}\left(\tfrac{1}{N_k}\sigma\sigma'^\intercal\right)\right\rangle_{N_k,x_{N_k},q_k}^\circ,\\ \left\langle\kappa,\,\partial_q\overline{F}_{N_k+1}^{x_{N_k}}(t,q_k)\right\rangle_{L^2}&= \mathbb{E}\left\langle\kappa(\alpha\wedge\alpha')\cdot \mathsf{diag}(\tau\tau'^\intercal)\right\rangle_{N_k+1,x_{N_k},q_k}, \end{align}\] where \(\tau\) in the second line is the last vector spin at size \(N_k+1\), and the Gibbs measures are defined in 99 and 97 , respectively.

By 122 , the sequence \(q_k\) converges pointwise to \(q\). Together with 131 , this allows us to apply Proposition 13. Passing to a further subsequence, still denoted by \((N_k)_{k\in\mathbb{N}}\), we can find \(p\in \mathcal{Q}_{\infty,\leqslant 1}^{D}\) such that, for every continuous path \(\kappa\in\mathcal{Q}_\infty^{D}\), \[\begin{align} -\lim_{k\to\infty}A_{N_k}(x_{N_k},y_{N_k}) & = \mathscr{P}_{t,q}(p), \tag{138}\\ \lim_{k\to\infty}\left\langle\kappa,\,\partial_q\widetilde{F}_{N_k}^{x_{N_k}}(t,q_k)\right\rangle_{L^2}&= \mathbb{E}\left\langle\kappa(\alpha\wedge\alpha')\cdot p(\alpha\wedge\alpha')\right\rangle_{\mathfrak R}=\left\langle\kappa, p \right\rangle_{L^2}, \tag{139}\\ \lim_{k\to\infty}\left\langle\kappa,\,\partial_q\overline{F}_{N_k+1}^{x_{N_k}}(t,q_k)\right\rangle_{L^2}&= \mathbb{E}\left\langle\kappa(\alpha\wedge\alpha')\cdot \mathsf{diag}(\tau\tau'^\intercal)\right\rangle_{\mathfrak R,\, q +t \nabla\xi(p)}\stackrel{\eqref{e46dqpsi61}}{=}\left\langle\kappa, \partial_q\psi(q+t\nabla\xi(p))\right\rangle_{L^2}. \tag{140} \end{align}\] The desired upper bound in 117 , with \(p^+=p\), follows from 137 and 138 .

It remains to verify that \(p\) satisfies the critical relation in 116 . Since each \(\mathcal{D}_{N,i}(x_N,y_N)\) is nonnegative, 124 and 132 imply that \(\lim_{N\to\infty}\mathcal{D}_{N,i}(x_N,y_N)=0\) for every \(i\in\mathbb{N}\). Hence, \[\begin{align} \lim_{N\to\infty} \left\langle q_i,\;\partial_q \widetilde{F}_N^{x_N}(t, q+q_N(y_N)) - \partial_q \overline{F}_{N+1}^{x_N}(t, q+q_N(y_N))\right\rangle_{L^2} =0,\qquad\forall i \in \mathbb{N}. \end{align}\] Combining this with 139 and 140 , with \(\kappa=q_i\), gives \[\begin{align} \left\langle q_i, p\right\rangle_{L^2} = \left\langle q_i, \partial_q\psi(q+t\nabla\xi(p))\right\rangle_{L^2},\qquad\forall i \in\mathbb{N}. \end{align}\] By 119 , we obtain \[\begin{align} p=\partial_q \psi(q+t\nabla\xi(p)), \end{align}\] which is the critical relation in 116 with \(p^+=p\).

We have so far assumed that \(q\in\mathcal{Q}_{\infty,\uparrow}^{D}\) for some \(c>0\). For a general \(q\in\mathcal{Q}_1^{D}\), choose a sequence \((q_n)_{n\in\mathbb{N}}\) such that \(q_n\in \mathcal{Q}_{\infty,\uparrow}^{D}\) with \(q_n\to q\) in \(L^1\). By the previous argument, there is an associated sequence \((p_n)_{n\in\mathbb{N}}\) such that \((q_n,p_n)\) satisfies 116 and gives the upper bound on \(\limsup_{N\to\infty}\overline{F}_N(t,q_n)\) in 117 . By the compactness of paths in Lemma 7, after passing to a subsequence, we may assume that \(p_n\) converges in \(L^1\) to some \(p\). Using the Lipschitz continuity of \(\overline{F}_N\) from Proposition 7 and the continuity estimates in Lemma 10, we can send \(n\to\infty\) and obtain both the upper bound in 117 and the critical relation in 116 for this \(p\) at the original path \(q\). This completes the proof of the upper bound.

The lower bound in 117 is proved in the same way. The only change is to use the sequence \((x'_N,y'_N)\) from Lemma 17, which gives the lower bound in 133 , and then reverse the corresponding inequalities in 137 . ◻

7 Hamilton–Jacobi equation and one-sided bound↩︎

Let \({D}\in\mathbb{N}\) be fixed, and consider paths in \(\mathcal{Q}^{D}_2\). The multi-species case can be recovered by considering \(\mathcal{Q}^\mathscr{S}_2\), which can be identified with \(\mathcal{Q}^{D}_2\) by taking \({D}=|\mathscr{S}|\).

We recall that the unique viscosity solution of \[\begin{align} \label{e46hj} \partial_t f- \int_0^1 \xi(\partial_q f)=0,\quad &\text{on \mathbb{R}_+\times \mathcal{Q}^{D}_2}, \end{align}\tag{141}\] with initial condition \(f(0,\cdot)=\psi\), gives a lower bound for \(\liminf_{N\to\infty}\overline{F}_N\). This follows from the main results of [8], [13], after a straightforward adaptation. We also recall from [14] that this solution admits a variational representation through the Hopf formula. Later, in order to extend the lower bound to the multi-species model, especially when \(\lambda_\infty\notin\mathbb{Q}^\mathscr{S}\), we need the fact that local uniform limits of viscosity solutions are again viscosity solutions. This stability property is standard in finite dimensions, but since the equation here is posed on an infinite-dimensional convex cone with empty interior in \(L^2\), we include the argument.

We begin by recalling the definition of viscosity solutions for 141 . Because of the infinite-dimensional setting, we first introduce a regularization of \(\xi\). We will then recall that the resulting notion of solution does not depend on the choice of regularization, as shown in [14].

We need some notation. Let \({L^2}:=L^2([0,1);\mathbb{R}^{D})\), and view \(\mathcal{Q}^{D}_2\) as a closed convex cone in \({L^2}\) consisting of increasing paths. The dual cone of \(\mathcal{Q}^{D}_2\) is defined by \[\begin{align} \label{e46C9442} \left(\mathcal{Q}^{D}_2\right)^*=\{q'\in{L^2}: \left\langle q',q\right\rangle_{L^2}\geqslant 0,\quad \forall q\in\mathcal{Q}_2^{D}\}. \end{align}\tag{142}\] Let \(g\) be a real-valued function defined on a subset \(G\) of \({L^2}\), respectively of \(\mathbb{R}^{D}\). We say that \(g\) is \(\left(\mathcal{Q}_2^{D}\right)^*\)-increasing, respectively \(\mathbb{R}^{D}_+\)-increasing, if \(g(a)\geqslant g(b)\) whenever \(a,b\in G\) satisfy \(a-b\in \left(\mathcal{Q}_2^{D}\right)^*\), respectively \(a-b\in\mathbb{R}^{D}_+\).

Definition 1. A function \(\overline{\xi}:\mathbb{R}^{D}_+\to\mathbb{R}\) is called a regularization of \(\xi:\mathbb{R}^{D}\to\mathbb{R}\) if the following conditions hold.

  1. The function \(\overline{\xi}\) agrees with \(\xi\) on the intersection of \(\mathbb{R}^{D}_+\) with the closed unit ball in \(\mathbb{R}^{D}\).

  2. The function \(\overline{\xi}\) is Lipschitz and proper in the following sense: \(\overline{\xi}\) is \(\mathbb{R}^{D}_+\)-increasing and, for every \(b\in\mathbb{R}^{D}_+\), the map \(\mathbb{R}^{D}_+\ni a\mapsto \overline{\xi}(a+b)-\overline{\xi}(a)\) is also \(\mathbb{R}^{D}_+\)-increasing.

This definition is taken from [14], where it is extracted from the assumptions used in [8], [13]. In [14], an additional condition is imposed when \(\xi\) is convex on \(\mathbb{R}^{D}_+\), namely that \(\overline{\xi}\) is also convex. Since we are dealing with non-convex models, this condition is not needed here. The existence of a regularization \(\overline{\xi}\) is proved in [14].

For any regularization \(\overline{\xi}\), define \(\mathsf{H}:{L^2}\to\mathbb{R}\) by \[\begin{align} \label{e46def95H95spin95glass} \mathsf{H}(\kappa) = \inf\left\{\int_0^1\overline{\xi}(q(s))\mathrm{d}s:\: q \in \mathcal{Q}_2^{D}\cap\left(\kappa+\left(\mathcal{Q}_2^{D}\right)^*\right)\right\},\quad\forall \kappa\in{L^2}. \end{align}\tag{143}\] It is proved in [14] that \(\mathsf{H}\) is Lipschitz, bounded below, and \(\left(\mathcal{Q}_2^{D}\right)^*\)-increasing. Moreover, \(\mathsf{H}(p)=\int_0^1\overline{\xi}(p(s))\mathrm{d}s\) for every \(p\in\mathcal{Q}_2^{D}\).

To define viscosity solutions, we also need smooth test functions. A function \(\phi:(0,\infty)\times\mathcal{Q}_2^{D}\to\mathbb{R}\) is called smooth if the following conditions hold.

  1. For every \((t,q)\in(0,\infty)\times\mathcal{Q}_2^{D}\), there exists a unique element of \(\mathbb{R}\times{L^2}\), denoted by \((\partial_t \phi(t,q),\partial_q \phi(t,q))\) and called the differential of \(\phi\) at \((t,q)\), such that \[\begin{align} \phi(s,y)-\phi(t,q) = \partial_t\phi(t,q)(s-t) + \left\langle\partial_q \phi(t,q), y - q\right\rangle_{L^2}+ O\left(|s-t|^2+|y - q|^2_{L^2}\right), \end{align}\] as \((s,y) \in (0,\infty)\times\mathcal{Q}_2^{D}\) tends to \((t,q)\) in \(\mathbb{R}\times {L^2}\).

  2. The map \((t,q)\mapsto(\partial_t\phi(t,q),\partial_q \phi(t,q))\) is continuous from \((0,\infty)\times \mathcal{Q}_2^{D}\) to \(\mathbb{R}\times{L^2}\).

This definition is from [14].

Definition 2 (Viscosity solutions). Let \(\overline{\xi}\) be a regularization of \(\xi\), and let \(\mathsf{H}\) be defined by 143 . Consider the Hamilton–Jacobi equation \[\begin{align} \label{e46hj95H} \partial_t f- \mathsf{H}(\partial_q f)=0,\quad &\text{on \mathbb{R}_+\times \mathcal{Q}^{D}_2}. \end{align}\tag{144}\]

  1. A continuous function \(f:\mathbb{R}_+\times \mathcal{Q}_2^{D}\to \mathbb{R}\) is a viscosity subsolution of 144 if, for every \((t,q) \in (0,\infty)\times \mathcal{Q}_2^{D}\) and every smooth \(\phi:(0,\infty)\times \mathcal{Q}_2^{D}\to\mathbb{R}\) such that \(f-\phi\) has a local maximum at \((t,q)\), we have \[\begin{align} \left(\partial_t \phi - \mathsf{H}(\partial_q\phi)\right)(t,q)\leqslant 0. \end{align}\]

  2. A continuous function \(f:\mathbb{R}_+\times \mathcal{Q}_2^{D}\to \mathbb{R}\) is a viscosity supersolution of 144 if, for every \((t,q) \in (0,\infty)\times \mathcal{Q}_2^{D}\) and every smooth \(\phi:(0,\infty)\times \mathcal{Q}_2^{D}\to\mathbb{R}\) such that \(f-\phi\) has a local minimum at \((t,q)\), we have \[\begin{align} \left(\partial_t \phi - \mathsf{H}(\partial_q\phi)\right)(t,q)\geqslant 0. \end{align}\]

  3. A continuous function \(f:\mathbb{R}_+\times \mathcal{Q}_2^{D}\to \mathbb{R}\) is a viscosity solution of 144 if it is both a viscosity subsolution and a viscosity supersolution.

Finally, a continuous function \(f:\mathbb{R}_+\times \mathcal{Q}^{D}_2\to\mathbb{R}\) is called a viscosity solution of 141 if it is a viscosity solution of 144 for some regularization \(\overline{\xi}\).

This definition combines [14]. As explained in [14], provided that \(f(0,\cdot)=\psi\) for \(\psi\) satisfying the condition in Theorem 4, the solution \(f\) of 141 is independent of the choice of \(\overline{\xi}\), so any regularization may be used.

The main result of [14] shows that the viscosity solution is unique, admits variational representations under suitable convexity assumptions, and is also the limit of the finite-dimensional approximations used in [8], [13]. We only need the following consequence.

Theorem 4 ([14]). Let \(\psi:\mathcal{Q}_2^{D}\to\mathbb{R}\) be \(\left(\mathcal{Q}_2^{D}\right)^*\)-increasing and satisfy \[\begin{align} \label{e46124psi-psi12460124124} \left|\psi(q)-\psi(q')\right|\leqslant\left|q-q'\right|_{L^1},\qquad\forall q,q'\in\mathcal{Q}_2^{D}. \end{align}\tag{145}\] With initial condition \(f(0,\cdot)=\psi\), there exists a viscosity solution \(f\) of 141 , unique in the class of Lipschitz functions on \(\mathbb{R}_+\times\mathcal{Q}_2^{D}\). Moreover, if \(\psi\) is convex on \(\mathcal{Q}_2^{D}\), then \(f\) admits the Hopf representation \[\begin{align} \label{e46Hopf95spin95glass} f(t,q) = \sup_{p \in \mathcal{Q}_\infty^{D}}\inf_{q' \in \mathcal{Q}_\infty^{D}}\left\{ \psi(q') + \left\langle q - q', p\right\rangle_{L^2}+t\int_0^1\xi(p(s))\mathrm{d}s\right\},\quad\forall(t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^{D}. \end{align}\tag{146}\]

Remark 14. The condition in 145 is only a normalization. Indeed, suppose instead that \[\begin{align} \left|\psi(q)-\psi(q')\right|\leqslant C\left|q-q'\right|,\qquad\forall q,q'\in\mathcal{Q}_2^{D}, \end{align}\] for some constant \(C>1\). Set \(\psi_0=C^{-1}\psi\), and let \(f_0\) solve \[\begin{align} \partial_t f_0- \int_0^1 C^{-1}\xi\left(C\partial_q f_0\right)=0,\quad &\text{on \mathbb{R}_+\times \mathcal{Q}^{D}_2}, \end{align}\] with \(f_0(0,\cdot)=\psi_0\). Then \(f:=Cf_0\) solves 141 . Under this rescaling, the Hopf formula 146 for \(f\) is unchanged.

The following comparison principle will be useful, and is taken from [14].

Proposition 15 (Comparison principle). Let \(u\) be a Lipschitz viscosity subsolution and \(v\) be a Lipschitz viscosity supersolution of 141 . If \(u(0,\cdot)\leqslant v(0,\cdot)\) everywhere, then \({u\leqslant v}\).

It is proved in [8], [13] that the viscosity solution \(f\) gives a lower bound for the limit of \(\overline{F}_N\). In those works, \(f\) is first defined as the limit of finite-dimensional equations; see [13]. It is then shown in [14] that this function is the unique viscosity solution. The next theorem is the main result of [13], restated in the form of [14].

Theorem 5 ([8], [13]). Consider the vector spin model in 7479 . Then \[\begin{align} f^{\mathrm{vec}}(t,q)\leqslant\liminf_{N\to\infty}\overline{F}_N^{\mathrm{vec}}(t,q),\qquad\forall (t,q)\in\mathbb{R}_+\times\mathcal{Q}^{D}_2, \end{align}\] where \(f^{\mathrm{vec}}\) is the unique viscosity solution of 141 with initial condition \(f^{\mathrm{vec}}(0,\cdot)=\psi^{\mathrm{vec}}\) given in 82 .

Remark 16. The results cited from [14] and [13] are proved for general vector spin glasses, where the paths are \({D}\times{D}\) matrix-valued; see 202 . In the present setting, the paths are \(\mathbb{R}^{D}\)-valued because we work with a special vector spin glass model in which \(\xi\) depends only on the diagonal of the overlap matrix. The arguments of [13], [14] adapt directly to this setting. For example, [8] treats the bipartite spin glass model and proves the corresponding results for paths in \(\mathcal{Q}_2^2\), and these ideas were later extended to general vector spin glasses in [13].

The following stability result will be used later. It is standard in finite dimensions, but we include the proof because the present state space is infinite-dimensional.

Remark 17. Identifying \(\mathcal{Q}^\mathscr{S}_2\) with \(\mathcal{Q}^{|\mathscr{S}|}_2\) and \(\mathbb{R}^\mathscr{S}\) with \(\mathbb{R}^{|\mathscr{S}|}\), Definitions 1 and 2, Theorem 4, and Proposition 15 apply verbatim on the cone \(\mathcal{Q}^\mathscr{S}_2\).

Lemma 19 (Stability under linear perturbations of the initial condition). Let \(u\) and \(v\) be Lipschitz viscosity solutions of the same Hamilton–Jacobi equation on \(\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}\), with initial conditions \(\psi_u\) and \(\psi_v\). Define \[\ell(q):=\sum_{s\in\mathscr{S}}\int_0^1 q_s(r)\,\mathrm{d}r,\qquad q\in\mathcal{Q}_2^\mathscr{S}.\] Assume that, for some \(\rho\geqslant 0\), \[\label{e46initial95linear95stability95assumption} |\psi_u(q)-\psi_v(q)|\leqslant\rho\,\ell(q),\qquad q\in\mathcal{Q}_2^\mathscr{S}.\tag{147}\] Then there is a constant \(C_\mathsf{H}<\infty\), depending only on the Lipschitz constant of the Hamiltonian in the equation, such that \[\label{e46hj95linear95initial95stability} |u(t,q)-v(t,q)|\leqslant\rho\left(\ell(q)+C_\mathsf{H}t\right),\qquad (t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}.\tag{148}\]

Proof. Fix a regularization and let \(\mathsf{H}\) be the associated Lipschitz Hamiltonian. Denote by \(L_\mathsf{H}\) its Lipschitz constant, and let \(\mathbf{1}\in L^2([0,1),\mathbb{R}^\mathscr{S})\) be the constant path with all coordinates equal to one. Set \(C_\mathsf{H}:=L_\mathsf{H}|\mathbf{1}|_{L^2}\). We show that \[v^+(t,q):=v(t,q)+\rho\ell(q)+\rho C_\mathsf{H}t\] is a viscosity supersolution. Indeed, if a smooth test function \(\phi\) touches \(v^+\) from below at \((t,q)\), then \(\phi-\rho\ell-\rho C_\mathsf{H}t\) touches \(v\) from below at \((t,q)\). Hence \[\partial_t\phi(t,q)-\rho C_\mathsf{H}-\mathsf{H}\left(\partial_q\phi(t,q)-\rho\mathbf{1}\right)\geqslant 0.\] Using the Lipschitz continuity of \(\mathsf{H}\), we get \[\begin{align} \partial_t\phi(t,q)-\mathsf{H}(\partial_q\phi(t,q)) &\geqslant\rho C_\mathsf{H}+\mathsf{H}\left(\partial_q\phi(t,q)-\rho\mathbf{1}\right)-\mathsf{H}(\partial_q\phi(t,q)) \\ &\geqslant\rho C_\mathsf{H}-\rho L_\mathsf{H}|\mathbf{1}|_{L^2}=0. \end{align}\] Thus \(v^+\) is a supersolution. Similarly, \[v^-(t,q):=v(t,q)-\rho\ell(q)-\rho C_\mathsf{H}t\] is a subsolution. By 147 , we have \(v^-(0,\cdot)\leqslant u(0,\cdot)\leqslant v^+(0,\cdot)\). The comparison principle therefore gives \(v^-\leqslant u\leqslant v^+\), which is exactly 148 . ◻

Recall the notation \(b^{\mathrm{avg}}\) from 86 . For any path \(q\), we denote by \(q^{\mathrm{avg}}\) the path \(r\mapsto q(r)^{\mathrm{avg}}\).

Proposition 18. Let \(\xi\) and \(\psi\) be associated with the multi-species model given in 36 . Let \(u:\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_2\to\mathbb{R}\) be the Lipschitz viscosity solution of \[\begin{align} \begin{cases} \partial_t u - \int \xi(\partial_q u)=0 ,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_2, \\ u(0,\cdot) = \psi ,\qquad &\text{on }\mathcal{Q}^\mathscr{S}_2. \end{cases} \end{align}\] Let \(\xi^{\mathrm{vec}}\) be associated with \(\xi\) given as in 74 . Define \(g:\mathbb{R}_+\times\mathcal{Q}^{D}_2\to\mathbb{R}\) by \(g(t,q)= {D}u(t, q^{\mathrm{avg}})\). Then, \(g\) is the Lipschitz viscosity solution of \[\begin{align} \begin{cases} \partial_t g - \int \xi^{\mathrm{vec}}(\partial_q g)=0 ,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}^{D}_2, \\ g(0,q) = {D}\psi(q^{\mathrm{avg}}) ,\qquad &\text{on }\mathcal{Q}^{D}_2. \end{cases} \end{align}\]

To handle the lack of compactness in infinite dimensions, we use Stegall’s variational principle [43]; see also [44].

Theorem 6 (Stegall’s variational principle). Let \(\mathcal{K}\) be a convex and weakly compact set in a separable Hilbert space \(\mathcal{H}\), and let \(g:\mathcal{K}\to\mathbb{R}\) be an upper semi-continuous function bounded from above. Then, for every \(\delta>0\), there exists \(\iota\in \mathcal{H}\) with \(|\iota|_{\mathcal{H}}\leqslant\delta\) such that \(g+\left\langle\iota,\cdot\right\rangle_{\mathcal{H}}\) attains its maximum on \(\mathcal{K}\).

Proof of Proposition 18. We set \(\mathcal{C}_{D}:=\mathcal{Q}_2^{D}\), \(\mathcal{C}_\mathscr{S}:=\mathcal{Q}_2^\mathscr{S}\), \(\mathcal{H}_{D}:=L^2([0,1),\mathbb{R}^{D})\), and \(\mathcal{H}_\mathscr{S}:=L^2([0,1),\mathbb{R}^\mathscr{S})\). Define bounded linear maps \(A,\Pi:\mathcal{H}_{D}\to\mathcal{H}_\mathscr{S}\) by \[\begin{align} (Aq)_s=\frac{1}{|\mathsf{D}_s|}\sum_{d\in\mathsf{D}_s}q_d, \qquad (\Pi q)_s=\frac{1}{{D}}\sum_{d\in\mathsf{D}_s}q_d . \end{align}\] Thus \(Aq=q^{\mathrm{avg}}\). The adjoint of \(A\) is given by \((A^*\eta)_d=\eta_s/|\mathsf{D}_s|\) for \(d\in\mathsf{D}_s\), and \(\Pi({D}A^*\eta)=\eta\).

Fix a regularization \(\overline{\xi}\) of \(\xi\), and define \(\overline{\xi}^{\mathrm{vec}}:\mathbb{R}^{D}_+\to\mathbb{R}\) by \[\begin{align} \overline{\xi}^{\mathrm{vec}}(a):={D}\overline{\xi}(\Pi a). \end{align}\] Then \(\overline{\xi}^{\mathrm{vec}}\) is a regularization of \(\xi^{\mathrm{vec}}\). Let \(\mathsf{H}^\mathscr{S}\) and \(\mathsf{H}^{\mathrm{vec}}\) be the Hamiltonians associated with \(\overline{\xi}\) and \(\overline{\xi}^{\mathrm{vec}}\), respectively.

Step 1. Identification of the averaged Hamiltonian. We claim that \[\begin{align} \label{e46avg95H95identity} \mathsf{H}^{\mathrm{vec}}({D}A^*\eta)={D}\mathsf{H}^\mathscr{S}(\eta), \qquad \eta\in\mathcal{H}_\mathscr{S}. \end{align}\tag{149}\] Indeed, if \(r\in \mathcal{C}_{D}\cap({D}A^*\eta+\mathcal{C}_{D}^*)\), then \(\Pi r\in \mathcal{C}_\mathscr{S}\). Moreover, for every \(h\in \mathcal{C}_\mathscr{S}\), \[\begin{align} \left\langle\Pi r-\eta,h\right\rangle_{\mathcal{H}_\mathscr{S}} = \left\langle r-{D}A^*\eta, \left(\frac{h_s}{{D}}\right)_{d\in\mathsf{D}_s} \right\rangle_{\mathcal{H}_{D}} \geqslant 0 . \end{align}\] Hence \(\Pi r\in \mathcal{C}_\mathscr{S}\cap(\eta+\mathcal{C}_\mathscr{S}^*)\), and so \[\begin{align} \int_0^1\overline{\xi}^{\mathrm{vec}}(r(s))\,\mathrm{d}s = {D}\int_0^1\overline{\xi}(\Pi r(s))\,\mathrm{d}s \stackrel{\eqref{e46def95H95spin95glass}}{\geqslant} {D}\mathsf{H}^\mathscr{S}(\eta). \end{align}\] Taking the infimum over \(r\) gives \(\mathsf{H}^{\mathrm{vec}}({D}A^*\eta)\geqslant{D}\mathsf{H}^\mathscr{S}(\eta)\). Conversely, if \(p\in \mathcal{C}_\mathscr{S}\cap(\eta+\mathcal{C}_\mathscr{S}^*)\), then \(r:={D}A^*p\) belongs to \(\mathcal{C}_{D}\), satisfies \(\Pi r=p\), and for every \(k\in \mathcal{C}_{D}\), \[\begin{align} \left\langle r-{D}A^*\eta,k\right\rangle_{\mathcal{H}_{D}} = {D}\left\langle p-\eta,Ak\right\rangle_{\mathcal{H}_\mathscr{S}} \geqslant 0 . \end{align}\] Thus \(r\in \mathcal{C}_{D}\cap({D}A^*\eta+\mathcal{C}_{D}^*)\). Taking the infimum over \(p\) gives the reverse inequality, and proves 149 .

Step 2. The subsolution inequality. Let \(\phi\) be a smooth test function such that \(g-\phi\) has a local maximum at \((t_0,q_0)\in(0,\infty)\times \mathcal{C}_{D}\). Replacing \(\phi\) by \(\phi+|t-t_0|^2+|q-q_0|_{\mathcal{H}_{D}}^2\), we may assume that the maximum is strict. Thus, for some \(r\in(0,t_0)\), \[\begin{align} \label{e46avg95strict95max} g(t,q)-\phi(t,q) \leqslant g(t_0,q_0)-\phi(t_0,q_0) - |(t,q)-(t_0,q_0)|_{\mathbb{R}\times\mathcal{H}_{D}}^2 \end{align}\tag{150}\] on \(K_r^{D}:=B_r(t_0,q_0)\cap(\mathbb{R}_+\times \mathcal{C}_{D})\). Put \(p_0:=Aq_0\), and choose \(R>0\) such that \(Aq\in K_R^\mathscr{S}:=B_R(p_0)\cap \mathcal{C}_\mathscr{S}\) whenever \((t,q)\in K_r^{D}\). Here, \(B_r(t_0,q_0)\) and \(B_R(p_0)\) are metric balls defined in the obvious way.

For \(\varepsilon>0\), define on \(K_r^{D}\times K_R^\mathscr{S}\) \[\begin{align} \label{e46avg95Phi95eps} \Phi_\varepsilon(t,q,p) := {D}u(t,p)-\phi(t,q)-\frac{{D}}{2\varepsilon}|p-Aq|_{\mathcal{H}_\mathscr{S}}^2 . \end{align}\tag{151}\] By Stegall’s variational principle (Theorem 6), there is \(\zeta_\varepsilon=(\tau_\varepsilon,\iota_\varepsilon,\varrho_\varepsilon)\in\mathbb{R}\times\mathcal{H}_{D}\times\mathcal{H}_\mathscr{S}\) with \(|\zeta_\varepsilon|\leqslant\varepsilon^2\) such that \[\begin{align} \Phi_\varepsilon(t,q,p)+\tau_\varepsilon t+\left\langle\iota_\varepsilon,q\right\rangle_{\mathcal{H}_{D}} +\left\langle\varrho_\varepsilon,p\right\rangle_{\mathcal{H}_\mathscr{S}} \end{align}\] attains its maximum at some \((t_\varepsilon,q_\varepsilon,p_\varepsilon)\in K_r^{D}\times K_R^\mathscr{S}\).

Set \(d_\varepsilon:=|p_\varepsilon-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}\) and \(\Delta_\varepsilon:=|(t_\varepsilon,q_\varepsilon)-(t_0,q_0)|_{\mathbb{R}\times\mathcal{H}_{D}}\). Since \((t_\varepsilon,q_\varepsilon,p_\varepsilon)\) maximizes the perturbed functional and \(p_0=Aq_0\), comparison with \((t_0,q_0,p_0)\) gives \[\begin{align} 0 &\leqslant\Phi_\varepsilon(t_\varepsilon,q_\varepsilon,p_\varepsilon)-\Phi_\varepsilon(t_0,q_0,p_0) +\tau_\varepsilon(t_\varepsilon-t_0)+\left\langle\iota_\varepsilon,q_\varepsilon-q_0\right\rangle_{\mathcal{H}_{D}} +\left\langle\varrho_\varepsilon,p_\varepsilon-p_0\right\rangle_{\mathcal{H}_\mathscr{S}} \\ &= {D}u(t_\varepsilon,p_\varepsilon)-\phi(t_\varepsilon,q_\varepsilon) -\frac{{D}}{2\varepsilon}d_\varepsilon^2-{D}u(t_0,p_0)+\phi(t_0,q_0) \\ &\qquad +\tau_\varepsilon(t_\varepsilon-t_0)+\left\langle\iota_\varepsilon,q_\varepsilon-q_0\right\rangle_{\mathcal{H}_{D}} +\left\langle\varrho_\varepsilon,p_\varepsilon-p_0\right\rangle_{\mathcal{H}_\mathscr{S}}. \end{align}\] Adding and subtracting \({D}u(t_\varepsilon,Aq_\varepsilon)\), and using \(g(t,q)={D}u(t,Aq)\) and \(p_0=Aq_0\), we obtain \[\begin{align} 0 &\leqslant\left(g(t_\varepsilon,q_\varepsilon)-\phi(t_\varepsilon,q_\varepsilon)\right) -\left(g(t_0,q_0)-\phi(t_0,q_0)\right) +{D}\left(u(t_\varepsilon,p_\varepsilon)-u(t_\varepsilon,Aq_\varepsilon)\right) \\ &\qquad -\frac{{D}}{2\varepsilon}d_\varepsilon^2 +\tau_\varepsilon(t_\varepsilon-t_0)+\left\langle\iota_\varepsilon,q_\varepsilon-q_0\right\rangle_{\mathcal{H}_{D}} +\left\langle\varrho_\varepsilon,p_\varepsilon-p_0\right\rangle_{\mathcal{H}_\mathscr{S}}. \end{align}\] By the strict maximum condition 150 , \[\begin{align} \left(g(t_\varepsilon,q_\varepsilon)-\phi(t_\varepsilon,q_\varepsilon)\right) -\left(g(t_0,q_0)-\phi(t_0,q_0)\right) \leqslant-\Delta_\varepsilon^2 . \end{align}\] Moreover, \(p_\varepsilon,Aq_\varepsilon\in K_R^\mathscr{S}\), so the Lipschitz continuity of \(u\) on bounded sets gives \[\begin{align} {D}\left(u(t_\varepsilon,p_\varepsilon)-u(t_\varepsilon,Aq_\varepsilon)\right) \leqslant C|p_\varepsilon-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}=Cd_\varepsilon. \end{align}\] Since \(|\zeta_\varepsilon|\leqslant\varepsilon^2\) and all the points considered stay in the fixed bounded set \(K_r^{D}\times K_R^\mathscr{S}\), the linear perturbation is bounded by \[\begin{align} \left| \tau_\varepsilon(t_\varepsilon-t_0)+\left\langle\iota_\varepsilon,q_\varepsilon-q_0\right\rangle_{\mathcal{H}_{D}} +\left\langle\varrho_\varepsilon,p_\varepsilon-p_0\right\rangle_{\mathcal{H}_\mathscr{S}} \right| \leqslant C\varepsilon^2 . \end{align}\] Combining the previous estimates yields \[\begin{align} 0\leqslant-\Delta_\varepsilon^2+Cd_\varepsilon-\frac{{D}}{2\varepsilon}d_\varepsilon^2+C\varepsilon^2 . \end{align}\] Equivalently, \[\begin{align} \label{e46avg95convergence95est} |(t_\varepsilon,q_\varepsilon)-(t_0,q_0)|_{\mathbb{R}\times\mathcal{H}_{D}}^2 +\frac{{D}}{2\varepsilon}|p_\varepsilon-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}^2 \leqslant C|p_\varepsilon-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}+C\varepsilon^2 . \end{align}\tag{152}\] We now deduce convergence. By Young’s inequality, \[\begin{align} Cd_\varepsilon\leqslant\frac{{D}}{4\varepsilon}d_\varepsilon^2+C\varepsilon. \end{align}\] Using this in 152 and absorbing the term \(\frac{{D}}{4\varepsilon}d_\varepsilon^2\) into the left-hand side gives \[\begin{align} \Delta_\varepsilon^2+\frac{{D}}{4\varepsilon}d_\varepsilon^2\leqslant C\varepsilon+C\varepsilon^2 . \end{align}\] Hence \(\Delta_\varepsilon\to0\) and \(d_\varepsilon\to0\), that is, \[\begin{align} \label{e46avg95convergence} \lim_{\varepsilon\to0}(t_\varepsilon,q_\varepsilon)=(t_0,q_0), \qquad \lim_{\varepsilon\to0} p_\varepsilon-Aq_\varepsilon=0\quad\text{in }\mathcal{H}_\mathscr{S}. \end{align}\tag{153}\] Since \(A\) is bounded, this also implies \(Aq_\varepsilon\to Aq_0=p_0\) and therefore \(p_\varepsilon\to p_0\).

For small \(\varepsilon\), the maximum is therefore local relative to the cones. Keeping \(q=q_\varepsilon\) fixed, \(u\) is touched from above at \((t_\varepsilon,p_\varepsilon)\) by \[\begin{align} \chi_\varepsilon(t,p) := \frac{1}{{D}}\phi(t,q_\varepsilon) + \frac{1}{2\varepsilon}|p-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}^2 - \frac{\tau_\varepsilon}{{D}}t - \frac{1}{{D}}\left\langle\varrho_\varepsilon,p\right\rangle_{\mathcal{H}_\mathscr{S}}. \end{align}\] At \((t_\varepsilon,p_\varepsilon)\), \[\begin{align} \label{e46avg95chi95derivatives} \partial_t\chi_\varepsilon = \frac{1}{{D}}\left(\phi_t(t_\varepsilon,q_\varepsilon)-\tau_\varepsilon\right), \qquad \partial_p\chi_\varepsilon = \frac{p_\varepsilon-Aq_\varepsilon}{\varepsilon} - \frac{\varrho_\varepsilon}{{D}} =:\eta_\varepsilon. \end{align}\tag{154}\] Since \(u\) is a viscosity subsolution, \[\begin{align} \label{e46avg95u95sub} \phi_t(t_\varepsilon,q_\varepsilon)-\tau_\varepsilon-{D}\mathsf{H}^\mathscr{S}(\eta_\varepsilon)\leqslant 0 . \end{align}\tag{155}\]

Keeping instead \(t=t_\varepsilon\) and \(p=p_\varepsilon\) fixed, \(q_\varepsilon\) minimizes over a metric ball centered at \(q_\varepsilon\) in \(\mathcal{C}_{D}\) the function \[\begin{align} q\mapsto \phi(t_\varepsilon,q) + \frac{{D}}{2\varepsilon}|p_\varepsilon-Aq|_{\mathcal{H}_\mathscr{S}}^2 - \left\langle\iota_\varepsilon,q\right\rangle_{\mathcal{H}_{D}}. \end{align}\] Denote this function by \(\ell(q)\). Then, this minimality implies that \(\frac{\mathrm{d}}{\mathrm{d}\delta}\left(\ell(q_\varepsilon+\delta q')-\ell(q_\varepsilon)\right)\big|_{\delta=0^+}\geqslant 0\) and thus we have \(\left\langle q', \partial_q \ell(q_\varepsilon)\right\rangle_{\mathcal{H}_{D}}\geqslant 0\) for every \(q'\) in the convex cone \(\mathcal{C}_{D}\). Notice that we used the fact that \(q_\varepsilon+\delta q'\in \mathcal{C}_{D}\) for every \(\delta>0\) since \(\mathcal{C}_{D}\) is a cone. By the definition of the dual cone in 142 , we conclude that \(\partial_q \ell(q_\varepsilon)\in \mathcal{C}_{D}^*\). Equivalently, we get \[\begin{align} \label{e46avg95normal95sub} \partial_q\phi(t_\varepsilon,q_\varepsilon) - {D}A^*\eta_\varepsilon - A^*\varrho_\varepsilon - \iota_\varepsilon \in \mathcal{C}_{D}^* . \end{align}\tag{156}\] Since \(\mathsf{H}^{\mathrm{vec}}\) is \(\mathcal{C}_{D}^*\)-increasing, 149 and 156 imply \[\begin{align} \mathsf{H}^{\mathrm{vec}}\left(\partial_q\phi(t_\varepsilon,q_\varepsilon)-A^*\varrho_\varepsilon-\iota_\varepsilon\right) \geqslant \mathsf{H}^{\mathrm{vec}}({D}A^*\eta_\varepsilon) = {D}\mathsf{H}^\mathscr{S}(\eta_\varepsilon). \end{align}\] Together with 155 , this gives \[\begin{align} \phi_t(t_\varepsilon,q_\varepsilon)-\tau_\varepsilon - \mathsf{H}^{\mathrm{vec}}\left(\partial_q\phi(t_\varepsilon,q_\varepsilon)-A^*\varrho_\varepsilon-\iota_\varepsilon\right) \leqslant 0 . \end{align}\] Letting \(\varepsilon\to0\), using 153 , the continuity of the differential of \(\phi\), the Lipschitz continuity of \(\mathsf{H}^{\mathrm{vec}}\), and \(\zeta_\varepsilon\to0\), yields \[\begin{align} \phi_t(t_0,q_0)-\mathsf{H}^{\mathrm{vec}}(\partial_q\phi(t_0,q_0))\leqslant 0 . \end{align}\] Thus \(g\) is a viscosity subsolution.

Step 3. The supersolution inequality. The supersolution argument is the same with the signs reversed, so we only record the changes. Suppose that \(g-\phi\) has a local minimum at \((t_0,q_0)\). After replacing \(\phi\) by \(\phi-|t-t_0|^2-|q-q_0|_{\mathcal{H}_{D}}^2\), we may assume that the minimum is strict. Apply Stegall’s principle (Theorem 6) to \[\begin{align} \label{e46avg95Psi95eps} \Psi_\varepsilon(t,q,p) := \phi(t,q)-{D}u(t,p)-\frac{{D}}{2\varepsilon}|p-Aq|_{\mathcal{H}_\mathscr{S}}^2 . \end{align}\tag{157}\] The same comparison as above gives 153 . At the maximizer \((t_\varepsilon,q_\varepsilon,p_\varepsilon)\), keeping \(q=q_\varepsilon\) fixed, \(u\) is touched from below by \[\begin{align} \widetilde{\chi}_\varepsilon(t,p) := \frac{1}{{D}}\phi(t,q_\varepsilon) - \frac{1}{2\varepsilon}|p-Aq_\varepsilon|_{\mathcal{H}_\mathscr{S}}^2 + \frac{\tau_\varepsilon}{{D}}t + \frac{1}{{D}}\left\langle\varrho_\varepsilon,p\right\rangle_{\mathcal{H}_\mathscr{S}}. \end{align}\] Thus, with \[\begin{align} \label{e46avg95chitilde95derivatives} \partial_t\widetilde{\chi}_\varepsilon = \frac{1}{{D}}\left(\phi_t(t_\varepsilon,q_\varepsilon)+\tau_\varepsilon\right), \qquad \partial_p\widetilde{\chi}_\varepsilon = -\frac{p_\varepsilon-Aq_\varepsilon}{\varepsilon} + \frac{\varrho_\varepsilon}{{D}} =:\eta_\varepsilon, \end{align}\tag{158}\] the viscosity supersolution property of \(u\) gives \[\begin{align} \label{e46avg95u95super} \phi_t(t_\varepsilon,q_\varepsilon)+\tau_\varepsilon-{D}\mathsf{H}^\mathscr{S}(\eta_\varepsilon)\geqslant 0 . \end{align}\tag{159}\] The first-order condition in the \(q\) variable is now \[\begin{align} \label{e46avg95normal95super} {D}A^*\eta_\varepsilon - \partial_q\phi(t_\varepsilon,q_\varepsilon) - A^*\varrho_\varepsilon - \iota_\varepsilon \in \mathcal{C}_{D}^* . \end{align}\tag{160}\] Using again the monotonicity of \(\mathsf{H}^{\mathrm{vec}}\) and 149 , we obtain \[\begin{align} {D}\mathsf{H}^\mathscr{S}(\eta_\varepsilon) = \mathsf{H}^{\mathrm{vec}}({D}A^*\eta_\varepsilon) \geqslant \mathsf{H}^{\mathrm{vec}}\left(\partial_q\phi(t_\varepsilon,q_\varepsilon)+A^*\varrho_\varepsilon+\iota_\varepsilon\right). \end{align}\] Together with 159 , this gives \[\begin{align} \phi_t(t_\varepsilon,q_\varepsilon)+\tau_\varepsilon - \mathsf{H}^{\mathrm{vec}}\left(\partial_q\phi(t_\varepsilon,q_\varepsilon)+A^*\varrho_\varepsilon+\iota_\varepsilon\right) \geqslant 0 . \end{align}\] Letting \(\varepsilon\to0\) yields \[\begin{align} \phi_t(t_0,q_0)-\mathsf{H}^{\mathrm{vec}}(\partial_q\phi(t_0,q_0))\geqslant 0 . \end{align}\] Thus \(g\) is a viscosity supersolution.

Step 4. Initial condition and uniqueness. We have proved that \(g\) is a viscosity solution of the Hamilton–Jacobi equation associated with the regularization \(\overline{\xi}^{\mathrm{vec}}\). Since the notion of viscosity solution is independent of the choice of regularization, \(g\) solves \[\begin{align} \partial_t g-\int_0^1\xi^{\mathrm{vec}}(\partial_q g)=0 \qquad\text{on }\mathbb{R}_+\times \mathcal{C}_{D}. \end{align}\] The initial condition is immediate: \[\begin{align} g(0,q)={D}u(0,Aq)={D}\psi(Aq)={D}\psi(q^{\mathrm{avg}}), \qquad q\in \mathcal{C}_{D}. \end{align}\] Finally, \(q\mapsto {D}\psi(Aq)\) is Lipschitz because \(A\) is bounded. It is also \(\mathcal{C}_{D}^*\)-increasing: if \(q'-q\in \mathcal{C}_{D}^*\), then for every \(h\in \mathcal{C}_\mathscr{S}\), \[\begin{align} \left\langle A(q'-q),h\right\rangle_{\mathcal{H}_\mathscr{S}} = \left\langle q'-q,A^*h\right\rangle_{\mathcal{H}_{D}} \geqslant 0 , \end{align}\] since \(A^*h\in \mathcal{C}_{D}\). Hence \(A(q'-q)\in \mathcal{C}_\mathscr{S}^*\), and the monotonicity of \(\psi\) gives the claim. By Theorem 4, with the normalization remark if necessary, \(g\) is the unique Lipschitz viscosity solution with initial condition \(g(0,q)={D}\psi(q^{\mathrm{avg}})\). ◻

8 Proof of the main result↩︎

To prove the main result, we first need multi-species analogues (Propositions 19 and 20) of Theorems 3 and 5, which were established in the vector spin glass setting.

Proposition 19. Let \(\xi\) and \(\psi\) be associated with the multi-species model given in 36 . For every \(t > 0\) and \(q \in \mathcal{Q}_1^\mathscr{S}\), there exist \(p^+, p^- \in \mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\) such that \[p^+=\partial_q\psi(q+t\nabla\xi(p^+)), \qquad p^-=\partial_q\psi(q+t\nabla\xi(p^-)),\] and \[\mathscr{P}_{t,q}(p^-) \leqslant\liminf_{N \to \infty} \overline{F}_N(t,q) \leqslant\limsup_{N\to\infty} \overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+).\]

Proof. We first prove the result when \(\lambda_\infty\) is rational.

Step 1. The rational case with \(q\in\mathcal{Q}_\infty^\mathscr{S}\). Assume that there are \({D}\in\mathbb{N}\) and a weak partition \((\mathsf{D}_s)_{s\in\mathscr{S}}\) of \(\{1,\ldots,{D}\}\) such that \(\lambda_{\infty,s}=|\mathsf{D}_s|/{D}\) for every \(s\in\mathscr{S}\). Let \(\xi^{\mathrm{vec}}\), \(\psi^{\mathrm{vec}}\), and \(\overline{F}_N^{\mathrm{vec}}\) be the associated vector spin model. Fix \(t>0\) and \(q\in\mathcal{Q}_\infty^\mathscr{S}\), and set \(\underline q:=q^{\mathrm{vec}}\).

Applying Theorem 3 to the vector spin model at \((t,\underline q)\), we find \(\underline p^+,\underline p^-\in\mathcal{Q}_{\infty,\leqslant 1}^{D}\) such that \[\begin{align} \label{e46crit95bdd95ms95vec95crit} \underline p^\pm=\partial_{\underline q}\psi^{\mathrm{vec}}\left(\underline q+t\nabla\xi^{\mathrm{vec}}(\underline p^\pm)\right) \end{align}\tag{161}\] and \[\begin{align} \label{e46crit95bdd95ms95vec95bd} \mathscr{P}^{\mathrm{vec}}_{t,\underline q}(\underline p^-)\leqslant\liminf_{N\to\infty}\overline{F}_N^{\mathrm{vec}}(t,\underline q)\leqslant\limsup_{N\to\infty}\overline{F}_N^{\mathrm{vec}}(t,\underline q)\leqslant\mathscr{P}^{\mathrm{vec}}_{t,\underline q}(\underline p^+). \end{align}\tag{162}\] Define \(p^\pm:=(\underline p^\pm)^{\mathrm{sum}}\). Since \(\underline p^\pm\in\mathcal{Q}_{\infty,\leqslant 1}^{D}\), we have \(p^\pm\in\mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\). By 92 and 161 , \[\begin{align} \label{e46crit95bdd95ms95crit95rat} p^\pm=\partial_q\psi\left(q+t\nabla\xi(p^\pm)\right). \end{align}\tag{163}\] Moreover, by Lemma 11, \[\begin{align} \label{e46crit95bdd95ms95free95energy95equiv} \lim_{N\to\infty}\left|\overline{F}_N(t,q)-{D}^{-1}\overline{F}^{\mathrm{vec}}_{\lceil N/{D}\rceil}(t,q^{\mathrm{vec}})\right|=0. \end{align}\tag{164}\] Combining 162 , 164 , and 91 , we obtain \[\begin{align} \label{e46crit95bdd95ms95bd95rat95qinf} \mathscr{P}_{t,q}(p^-)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q)\leqslant\limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+). \end{align}\tag{165}\] This proves the rational case for \(q\in\mathcal{Q}_\infty^\mathscr{S}\).

Step 2. Extension of the rational case to \(q\in\mathcal{Q}_1^\mathscr{S}\). Let now \(q\in\mathcal{Q}_1^\mathscr{S}\), and choose \(q_k\in\mathcal{Q}_\infty^\mathscr{S}\) such that \(q_k\to q\) in \(L^1\). By Step 1, for each \(k\) there exist \(p_k^+,p_k^-\in\mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\) satisfying \[\begin{align} \label{e46crit95bdd95ms95crit95k} p_k^\pm=\partial_q\psi\left(q_k+t\nabla\xi(p_k^\pm)\right) \end{align}\tag{166}\] and \[\begin{align} \label{e46crit95bdd95ms95bd95k} \mathscr{P}_{t,q_k}(p_k^-)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q_k)\leqslant\limsup_{N\to\infty}\overline{F}_N(t,q_k)\leqslant\mathscr{P}_{t,q_k}(p_k^+). \end{align}\tag{167}\] By the compactness of monotone paths (see Lemma 7), after passing to subsequences, we may assume that \(p_k^\pm\to p^\pm\) in \(L^1\) for some \(p^\pm\in\mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\). Lemma 10 and 166 give \[\begin{align} \label{e46crit95bdd95ms95crit95rat95q1} p^\pm=\partial_q\psi\left(q+t\nabla\xi(p^\pm)\right). \end{align}\tag{168}\] Using the Lipschitz continuity of \(\overline{F}_N\) in Proposition 7, 167 , and Lemma 10, and then sending \(k\to\infty\), gives \[\begin{align} \label{e46crit95bdd95ms95bd95rat95q1} \mathscr{P}_{t,q}(p^-)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q)\leqslant\limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+). \end{align}\tag{169}\] This proves the proposition when \(\lambda_\infty\) is rational.

Step 3. Approximation of the proportions. We now consider a general \(\lambda_\infty\). Let \((\lambda^{(m)})_{m\in\mathbb{N}}\) be a sequence of rational probability vectors such that \(\lambda^{(m)}\to\lambda_\infty\). Let \(\psi_m\) and \(\mathscr{P}^m\) denote the initial condition and Parisi functional corresponding to \(\lambda^{(m)}\). For each \(m\), choose a sequence of species proportions \(\lambda_N^{(m)}\) such that \(\lambda_N^{(m)}\to\lambda^{(m)}\), and write \(\overline{F}_N^m\) for the corresponding free energy.

By the rational case, for every \(m\) there exist \(p_m^+,p_m^-\in\mathcal{Q}_{\infty,\leqslant\lambda^{(m)}}^\mathscr{S}\) such that \[\begin{align} \label{e46crit95bdd95ms95crit95m} p_m^\pm=\partial_q\psi_m\left(q+t\nabla\xi(p_m^\pm)\right) \end{align}\tag{170}\] and \[\begin{align} \label{e46crit95bdd95ms95bd95m} \mathscr{P}^m_{t,q}(p_m^-)\leqslant\liminf_{N\to\infty}\overline{F}_N^m(t,q)\leqslant\limsup_{N\to\infty}\overline{F}_N^m(t,q)\leqslant\mathscr{P}^m_{t,q}(p_m^+). \end{align}\tag{171}\] By compactness, after passing to subsequences, we may assume that \(p_m^\pm\to p^\pm\) in \(L^1\). Since \(p_m^\pm\leqslant\lambda^{(m)}\) and \(\lambda^{(m)}\to\lambda_\infty\), we have \(p^\pm\in\mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\). Moreover, using 63 , Lemma 9, and Lemma 10, we can pass to the limit in 170 and obtain \[\begin{align} \label{e46crit95bdd95ms95crit95general} p^\pm=\partial_q\psi\left(q+t\nabla\xi(p^\pm)\right). \end{align}\tag{172}\]

It remains to pass the bounds to the limit. By Lemma 8, \[\begin{align} \label{e46crit95bdd95ms95lambda95cont95upper} \limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\limsup_{N\to\infty}\overline{F}_N^m(t,q)+C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(m)}| \end{align}\tag{173}\] and \[\begin{align} \label{e46crit95bdd95ms95lambda95cont95lower} \liminf_{N\to\infty}\overline{F}_N(t,q)\geqslant\liminf_{N\to\infty}\overline{F}_N^m(t,q)-C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(m)}|. \end{align}\tag{174}\] Combining 171 with 173 and 174 , we get \[\begin{align} \mathscr{P}^m_{t,q}(p_m^-)-C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(m)}|\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q) \end{align}\] and \[\begin{align} \limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\mathscr{P}^m_{t,q}(p_m^+)+C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(m)}|. \end{align}\] Finally, by 63 , Lemma 9, and Lemma 10, \[\begin{align} \lim_{m\to\infty}\mathscr{P}^m_{t,q}(p_m^\pm) = \mathscr{P}_{t,q}(p^\pm). \end{align}\] Letting \(m\to\infty\) yields \[\begin{align} \mathscr{P}_{t,q}(p^-)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q)\leqslant\limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+). \end{align}\] Together with 172 , this completes the proof. ◻

Proposition 20. Let \(\xi\) and \(\psi\) be associated with the multi-species model given in 36 . Let \(f:\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_2\to\mathbb{R}\) be the Lipschitz viscosity solution of \[\begin{align} \begin{cases} \partial_t f - \int_0^1 \xi(\partial_q f)=0 ,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}^\mathscr{S}_2, \\ f(0,\cdot) = \psi ,\qquad &\text{on }\mathcal{Q}^\mathscr{S}_2. \end{cases} \end{align}\] Then, we have \[\begin{align} \label{e46p46HJ95bdd95ms} f(t,q)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q),\qquad \forall (t,q)\in\mathbb{R}_+\times \mathcal{Q}^\mathscr{S}_2. \end{align}\qquad{(6)}\]

Proof. We proceed in two steps. First, we prove ?? in the rational case. We then extend the result to the general case by approximation.

Step 1. The rational case. Assume first that \(\lambda_\infty\) is rational. Choose \({D}\in\mathbb{N}\) and a weak partition \((\mathsf{D}_s)_{s\in\mathscr{S}}\) of \(\{1,\ldots,{D}\}\) such that \(\lambda_{\infty,s}=|\mathsf{D}_s|/{D}\). Let \(\xi^{\mathrm{vec}}\) and \(\overline{F}_N^{\mathrm{vec}}\) be the associated vector spin model introduced in 7479 , and let \(f^{\mathrm{vec}}\) be the viscosity solution appearing in Theorem 5. By Proposition 18, the function \(g(t,\underline q):={D}f(t,\underline q^{\mathrm{avg}})\) is the Lipschitz viscosity solution of the Hamilton–Jacobi equation associated with \(\xi^{\mathrm{vec}}\), with initial condition \(g(0,\underline q)={D}\psi(\underline q^{\mathrm{avg}})\). Moreover, by Corollary 1, applied to the vector model at \(t=0\), we have \[\begin{align} {D}\psi(\underline q^{\mathrm{avg}})\stackrel{\eqref{e46psi61sumlambdapsi}}{=}\sum_{s\in\mathscr{S}}|\mathsf{D}_s|\psi_\circ\left((\underline q^{\mathrm{avg}})_s\right)\stackrel{\text{\eqref{e46b94avg61} \& Jensen}}{\leqslant}\sum_{s\in\mathscr{S}}\sum_{d\in\mathsf{D}_s}\psi_\circ(\underline q_d)\stackrel{\eqref{e46psi95single61}}{=}\psi^{\mathrm{vec}}(\underline q). \label{e46HJ95bdd95ms95init95comp} \end{align}\tag{175}\] Therefore \(g(0,\cdot)\leqslant f^{\mathrm{vec}}(0,\cdot)\), and the comparison principle in Proposition 15 gives \[\begin{align} {D}f(t,\underline q^{\mathrm{avg}})=g(t,\underline q)\leqslant f^{\mathrm{vec}}(t,\underline q),\qquad (t,\underline q)\in\mathbb{R}_+\times\mathcal{Q}_2^{D}. \label{e46HJ95bdd95ms95compare95vec} \end{align}\tag{176}\] Now fix \((t,q)\in\mathbb{R}_+\times\mathcal{Q}_\infty^\mathscr{S}\) and take \(\underline q=q^{\mathrm{vec}}\). Since we have \((q^{\mathrm{vec}})^{\mathrm{avg}}=q\) due to 88 , Theorem 5 and 176 yield \[\begin{align} {D}f(t,q)\leqslant f^{\mathrm{vec}}(t,q^{\mathrm{vec}})\leqslant\liminf_{N\to\infty}\overline{F}_N^{\mathrm{vec}}(t,q^{\mathrm{vec}}). \label{e46HJ95bdd95ms95vec95lower} \end{align}\tag{177}\] Using Lemma 11, and replacing \(N\) by \(\lceil N/{D}\rceil\) in the vector free energy, we obtain \[\begin{align} f(t,q)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q),\qquad (t,q)\in\mathbb{R}_+\times\mathcal{Q}_\infty^\mathscr{S}. \end{align}\] Finally, the extension from \(q\in\mathcal{Q}_\infty^\mathscr{S}\) to \(q\in\mathcal{Q}_2^\mathscr{S}\) follows by approximation. Indeed, choose \(q_k\in\mathcal{Q}_\infty^\mathscr{S}\) such that \(q_k\to q\) in \(L^2\) and in \(L^1\). The solution \(f\) is Lipschitz by Theorem 4, while \(\overline{F}_N\) is uniformly Lipschitz in \(q\) by Proposition 7. Therefore, \[\begin{align} f(t,q)\leqslant f(t,q_k)+C|q-q_k|_{L^2}\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q_k)+C|q-q_k|_{L^2} \\ \leqslant\liminf_{N\to\infty}\overline{F}_N(t,q)+C|q-q_k|_{L^1}+C|q-q_k|_{L^2}. \end{align}\] Letting \(k\to\infty\) proves the rational case.

Step 2. Approximation of the proportions. We now remove the rationality assumption. Let \((\lambda^{(n)})_{n\in\mathbb{N}}\) be a sequence of rational points in \((0,1)^\mathscr{S}\) such that \(\sum_{s\in\mathscr{S}}\lambda_s^{(n)}=1\) and \(\lambda^{(n)}\to\lambda_\infty\). Let \(\psi_n(q):=\sum_{s\in\mathscr{S}}\lambda_s^{(n)}\psi_\circ(q_s)\), and let \(f_n\) be the Lipschitz viscosity solution of \[\begin{align} \partial_t f_n-\int_0^1\xi(\partial_q f_n)=0,\qquad f_n(0,\cdot)=\psi_n . \end{align}\] By the rational case, for any auxiliary sequence of species proportions \(\lambda_N^{(n)}\) satisfying \(\lambda_N^{(n)}\to\lambda^{(n)}\), we have \[\begin{align} f_n(t,q)\leqslant\liminf_{N\to\infty}\overline{F}_{N,\lambda_N^{(n)}}(t,q),\qquad (t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}. \label{e46HJ95bdd95ms95rational95n} \end{align}\tag{178}\] On the other hand, Lemma 8 gives, for the original sequence \(\lambda_N\to\lambda_\infty\), \[\begin{align} \liminf_{N\to\infty}\overline{F}_{N,\lambda_N}(t,q)\geqslant\liminf_{N\to\infty}\overline{F}_{N,\lambda_N^{(n)}}(t,q)-C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(n)}|. \label{e46HJ95bdd95ms95lambda95cont} \end{align}\tag{179}\] Combining 178 and 179 , we get \[\begin{align} \liminf_{N\to\infty}\overline{F}_{N,\lambda_N}(t,q)\geqslant f_n(t,q)-C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(n)}|. \label{e46HJ95bdd95ms95before95n} \end{align}\tag{180}\] It remains to pass to the limit in \(n\). Set \[\rho_n:=\max_{s\in\mathscr{S}}|\lambda_s^{(n)}-\lambda_{\infty,s}|.\] Since \(\psi_\circ(0)=0\) and \(\psi_\circ\) is \(L^1\)-Lipschitz by Lemma 9, we have, for every \(q\in\mathcal{Q}_2^\mathscr{S}\), \[\begin{align} |\psi_n(q)-\psi(q)| &\leqslant\sum_{s\in\mathscr{S}}|\lambda_s^{(n)}-\lambda_{\infty,s}|\,|\psi_\circ(q_s)| \leqslant\rho_n\sum_{s\in\mathscr{S}}|q_s|_{L^1} =\rho_n\ell(q). \end{align}\] Applying Lemma 19 to \(f_n\) and \(f\), we get \[\label{e46fn95to95f95lambda95stability} |f_n(t,q)-f(t,q)|\leqslant\rho_n\left(\ell(q)+C_\mathsf{H}t\right),\qquad (t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}.\tag{181}\] Combining 180 with 181 , we obtain \[\begin{align} \liminf_{N\to\infty}\overline{F}_{N,\lambda_N}(t,q) &\geqslant f(t,q)-\rho_n\left(\ell(q)+C_\mathsf{H}t\right)-C\left(t+|q|_{L^1}+1\right)|\lambda_\infty-\lambda^{(n)}|. \end{align}\] Letting \(n\to\infty\) gives ?? as desired. ◻

Proof of Theorem 1. By Proposition 20, we already have \[\begin{align} \label{e46t46lower} f(t,q)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,q), \qquad (t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}. \end{align}\tag{182}\] Theorem 4 together with Remark 17 also gives the Hopf formula for \(f\). Hence, \(f\) is equal to the right-hand side of 10 ; this yields the desired lower bound for the limit free energy. It remains to prove the matching upper bound.

Fix first \(t>0\) and \(q\in\mathcal{Q}_2^\mathscr{S}\). Since \(\mathcal{Q}_2^\mathscr{S}\subseteq\mathcal{Q}_1^\mathscr{S}\), Proposition 19 gives \(p^+\in\mathcal{Q}_{\infty,\leqslant\lambda_\infty}^\mathscr{S}\) such that \[\begin{gather} p^+=\partial_q\psi\left(q+t\nabla\xi(p^+)\right),\tag{183} \\ \limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+). \tag{184} \end{gather}\] Set \[\begin{align} \label{e46q944361} q^+:=q+t\nabla\xi(p^+). \end{align}\tag{185}\] By Corollary 1, the function \(\psi\) is convex. Hence, using 183 , for every \(q'\in\mathcal{Q}_\infty^\mathscr{S}\), \[\begin{align} \label{e46t46convex95support} \psi(q')\geqslant\psi(q^+)+\left\langle p^+,q'-q^+\right\rangle_{L^2}. \end{align}\tag{186}\] Therefore, for every \(q'\in\mathcal{Q}_\infty^\mathscr{S}\), \[\begin{align} \psi(q')+\left\langle q-q',p^+\right\rangle_{L^2}+t\int_0^1\xi(p^+(s))\,\mathrm{d}s \stackrel{\eqref{e46t46convex95support}}{\geqslant} \psi(q^+)+\left\langle q-q^+,p^+\right\rangle_{L^2}+t\int_0^1\xi(p^+(s))\,\mathrm{d}s \\ \stackrel{\eqref{e46q944361}}{=}\psi\left(q+t\nabla\xi(p^+)\right)-t\int_0^1 p^+(s)\cdot\nabla\xi(p^+(s))\,\mathrm{d}s+t\int_0^1\xi(p^+(s))\,\mathrm{d}s \stackrel{\eqref{e46sP95lambda44t44q}}{=} \mathscr{P}_{t,q}(p^+). \end{align}\] Taking the infimum over \(q'\in\mathcal{Q}_\infty^\mathscr{S}\) and then using the Hopf formula 146 for \(f\), with the admissible choice \(p=p^+\), gives \[\begin{align} \label{e46t46parisi95leq95f} \mathscr{P}_{t,q}(p^+) \leqslant \inf_{q'\in\mathcal{Q}_\infty^\mathscr{S}}\left\{\psi(q')+\left\langle q-q',p^+\right\rangle_{L^2}+t\int_0^1\xi(p^+(s))\,\mathrm{d}s\right\} \leqslant f(t,q). \end{align}\tag{187}\] Combining 184 and 187 , we obtain \[\begin{align} \label{e46t46upper} \limsup_{N\to\infty}\overline{F}_N(t,q)\leqslant f(t,q), \qquad t>0,\;q\in\mathcal{Q}_2^\mathscr{S}. \end{align}\tag{188}\] Together with 182 , this proves 10 for \(t>0\).

The case \(t=0\) follows from the Lipschitz continuity of \(\overline{F}_N\) in Proposition 7, uniformly in \(N\). Thus 10 holds for every \((t,q)\in\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}\). Finally, the link between the right-hand side of 10 and the solution of 11 boils down to the Hopf representation 146 . This completes the proof. ◻

9 Balanced models↩︎

In this section, we record a reduction of the formula in Theorem 1 for balanced models. A typical example of a balanced model is the bipartite model with species of equal sizes, namely \(\xi(a_1, a_2) = a_1 a_2\) and \(\lambda_\infty = (1/2, 1/2)\). For this example, we will relate the limit free energy of this two-species model to that of the single-species model with covariance function \(\xi_\star(r) = r^2/4\). More generally, this reduction to a single-species model can be obtained under the following condition, where here and throughout this section, we write \(\lambda=(\lambda_s)_{s\in\mathscr{S}}\) for \(\lambda_\infty\) (and for \(r \in \mathbb{R}\), we write \(r \lambda = (r\lambda_s)_{s\in\mathscr{S}}\)).

Definition 3 (Balanced comparison structure). We say that \(\xi\) is balanced with respect to \(\lambda\) if there exists a one-species covariance function \(\xi_\star:\mathbb{R}_+\to\mathbb{R}\) such that, for every \(r\in\mathbb{R}_+\), \[\label{e46balanced95diag95identity} \xi(r\lambda)=\xi_\star(r),\tag{189}\] and, for every \(a=(a_s)_{s\in\mathscr{S}}\in\mathbb{R}_+^\mathscr{S}\), \[\label{e46balanced95comparison95ineq} \xi(a)\leqslant\sum_{s\in\mathscr{S}}\lambda_s\xi_\star\left(\frac{a_s}{\lambda_s}\right).\tag{190}\]

The following lemma shows that the balanced multi-species models of [9] fit into Definition 3, after translating their species-normalized overlaps into the normalization used in 1 .

Lemma 20 (Explicit balanced models). Assume that \(\xi\) has the expansion \[\label{e46balanced95power95series95xi} \xi(a)=\sum_{p\geqslant 1}\sum_{s_1,\ldots,s_p\in\mathscr{S}}\Delta^2_{s_1,\ldots,s_p}a_{s_1}\cdots a_{s_p},\qquad a\in\mathbb{R}^\mathscr{S},\tag{191}\] where the coefficients are nonnegative and satisfy the standing summability assumptions. For each \(p\geqslant 1\), define the symmetrized coefficients \[\label{e46symmetrized95delta95balanced} \widehat\Delta^2_{s_1,\ldots,s_p}:=\frac{1}{p!}\sum_{\pi\in\mathfrak S_p}\Delta^2_{s_{\pi(1)},\ldots,s_{\pi(p)}}.\tag{192}\] Suppose that \[\begin{align} \label{e46balanced95p195condition} \begin{cases} \widehat\Delta_t^2\quad\text{does not depend on }t\in\mathscr{S}, \\ \sum_{s_2,\ldots,s_p\in\mathscr{S}}\widehat\Delta^2_{t,s_2,\ldots,s_p}\lambda_{s_2}\cdots\lambda_{s_p}\quad\text{does not depend on t\in\mathscr{S} for every p\geqslant 2.} \end{cases} \end{align}\tag{193}\] Define \[\label{e46balanced95beta95p} \beta_p^2:=\sum_{s_1,\ldots,s_p\in\mathscr{S}}\Delta^2_{s_1,\ldots,s_p}\lambda_{s_1}\cdots\lambda_{s_p}\quad\text{for p\geqslant 1},\quad\text{and}\quad \xi_\star(r):=\sum_{p\geqslant 1}\beta_p^2r^p=\xi(r\lambda)\quad \text{for r\in\mathbb{R}_+}.\tag{194}\] Then \(\xi\) is balanced with respect to \(\lambda\) in the sense of Definition 3.

Proof. As observed in [9], the coefficient array may be symmetrized without changing the model. In the present notation, this means that the symmetrized coefficients in 192 satisfy \[\begin{align} \sum_{s_1,\ldots,s_p\in\mathscr{S}}\Delta^2_{s_1,\ldots,s_p}a_{s_1}\cdots a_{s_p} =\sum_{s_1,\ldots,s_p\in\mathscr{S}}\widehat\Delta^2_{s_1,\ldots,s_p}a_{s_1}\cdots a_{s_p} \end{align}\] for every \(a\in\mathbb{R}^\mathscr{S}\). The same identity with \(a=\lambda\) gives \[\begin{align} \beta_p^2=\sum_{s_1,\ldots,s_p\in\mathscr{S}}\widehat\Delta^2_{s_1,\ldots,s_p}\lambda_{s_1}\cdots\lambda_{s_p}. \end{align}\] Thus we may work with the symmetric coefficients \(\widehat\Delta^2\).

It remains to prove 190 . Write \(a_s=\lambda_s x_s\), with \(x_s\geqslant 0\). The case \(p=1\) follows directly from 193 . For \(p\geqslant 2\), the arithmetic-geometric mean inequality and the balanced condition give \[\begin{align} &\sum_{s_1,\ldots,s_p\in\mathscr{S}}\widehat\Delta^2_{s_1,\ldots,s_p}\lambda_{s_1}\cdots\lambda_{s_p}x_{s_1}\cdots x_{s_p} \\ &\qquad\leqslant\sum_{t\in\mathscr{S}}\lambda_t x_t^p\sum_{s_2,\ldots,s_p\in\mathscr{S}}\widehat\Delta^2_{t,s_2,\ldots,s_p}\lambda_{s_2}\cdots\lambda_{s_p} =\beta_p^2\sum_{t\in\mathscr{S}}\lambda_t x_t^p. \end{align}\] Summing over \(p\geqslant 1\) yields \[\begin{align} \xi(a)&\leqslant\sum_{p\geqslant 1}\beta_p^2\sum_{s\in\mathscr{S}}\lambda_s\left(\frac{a_s}{\lambda_s}\right)^p =\sum_{s\in\mathscr{S}}\lambda_s\xi_\star\left(\frac{a_s}{\lambda_s}\right). \end{align}\] The identity \(\xi(r\lambda)=\xi_\star(r)\) follows directly from the definition of \(\beta_p^2\). ◻

Besides the bipartite model already discussed in the opening of this section, additional examples of the form in 191 can be obtained by setting \(\lambda_s = |\mathscr{S}|^{-1}\) for every \(s \in \mathscr{S}\) and by making sure that for every \(p\), \(s_1, \ldots, s_p \in \mathscr{S}\), and permutation \(\pi\) on \(\mathscr{S}\), we have \(\Delta^2_{s_1, \ldots, s_p} = \Delta^2_{\pi(s_1), \ldots, \pi(s_p)}\). See also [10] for further discussion on such permutation-invariant models.

For \(r,r'\in\mathcal{Q}_2\) and \(a\in\mathcal{Q}_\infty\), define the one-species Hamilton–Jacobi functional \[\label{e46balanced95J95star} \mathcal{J}^\star_{t,r}(r',a):=\psi_\circ(r')+\left\langle r-r',a\right\rangle_{L^2}+t\int_0^1\xi_\star(a(v))\,\mathrm{d}v.\tag{195}\] We also define \[\label{e46balanced95u95def} u(t,r):=\sup_{a\in\mathcal{Q}_\infty}\inf_{r'\in\mathcal{Q}_\infty}\mathcal{J}^\star_{t,r}(r',a),\qquad (t,r)\in\mathbb{R}_+\times\mathcal{Q}_2.\tag{196}\] For \(q=(q_s)_{s\in\mathscr{S}}\in\mathcal{Q}_2^\mathscr{S}\), write \[\label{e46balanced95q95lambda} q^\lambda:=\sum_{s\in\mathscr{S}}\lambda_s q_s\in\mathcal{Q}_2.\tag{197}\]

Proposition 21 (Balanced reduction). Assume that \(\xi\) is balanced with respect to \(\lambda\) in the sense of Definition 3. Let \(f\) be the limit free energy, or equivalently the Hopf formula in Theorem 1. Then, for every \(t\geqslant 0\) and every \(q\in\mathcal{Q}_2^\mathscr{S}\), \[\label{e46balanced95comparison} u(t,q^\lambda)\leqslant f(t,q)\leqslant\sum_{s\in\mathscr{S}}\lambda_s u(t,q_s).\qquad{(7)}\] In particular, \[\label{e46balanced95exact95reduction} f(t,0)=u(t,0),\qquad t\geqslant 0.\qquad{(8)}\]

Proof. By Theorem 1, \[\label{e46balanced95f95hopf} f(t,q)=\sup_{p\in\mathcal{Q}_\infty^\mathscr{S}}\inf_{q'\in\mathcal{Q}_\infty^\mathscr{S}}\left\{\psi(q')+\left\langle q-q',p\right\rangle_{L^2}+t\int_0^1\xi(p(v))\,\mathrm{d}v\right\}.\tag{198}\]

We first prove the lower bound. Fix \(a\in\mathcal{Q}_\infty\) and set \(p_s=\lambda_s a\) for every \(s\in\mathscr{S}\). For every \(q'\in\mathcal{Q}_\infty^\mathscr{S}\), Jensen’s inequality and the convexity of \(\psi_\circ\) from Proposition 3 give \[\label{e46balanced95jensen95psi} \psi(q')=\sum_{s\in\mathscr{S}}\lambda_s\psi_\circ(q'_s)\geqslant\psi_\circ\left(\sum_{s\in\mathscr{S}}\lambda_s q'_s\right)=\psi_\circ((q')^\lambda).\tag{199}\] Using also \(\xi(\lambda a)=\xi_\star(a)\) due to 189 , we obtain \[\begin{align} &\psi(q')+\left\langle q-q',p\right\rangle_{L^2}+t\int_0^1\xi(p(v))\,\mathrm{d}v \\ &\qquad\geqslant\psi_\circ((q')^\lambda)+\left\langle q^\lambda-(q')^\lambda,a\right\rangle_{L^2}+t\int_0^1\xi_\star(a(v))\,\mathrm{d}v =\mathcal{J}^\star_{t,q^\lambda}((q')^\lambda,a). \end{align}\] Taking the infimum over \(q'\in\mathcal{Q}_\infty^\mathscr{S}\), and using the fact that \((q')^\lambda\) ranges over all of \(\mathcal{Q}_\infty\) by taking \(q'_s=r'\) for every \(s\), gives \[\inf_{q'\in\mathcal{Q}_\infty^\mathscr{S}}\mathcal{J}_{t,q}(q',p)\geqslant\inf_{r'\in\mathcal{Q}_\infty}\mathcal{J}^\star_{t,q^\lambda}(r',a).\] Taking the supremum over \(a\in\mathcal{Q}_\infty\) yields \(f(t,q)\geqslant u(t,q^\lambda)\).

We now prove the upper bound. Fix \(p\in\mathcal{Q}_\infty^\mathscr{S}\) and set \(a_s=p_s/\lambda_s\). By 190 , for almost every \(v\in[0,1)\), \[\xi(p(v))\leqslant\sum_{s\in\mathscr{S}}\lambda_s\xi_\star(a_s(v)).\] Therefore, for every \(q'\in\mathcal{Q}_\infty^\mathscr{S}\), \[\begin{align} &\psi(q')+\left\langle q-q',p\right\rangle_{L^2}+t\int_0^1\xi(p(v))\,\mathrm{d}v \\ &\qquad\leqslant\sum_{s\in\mathscr{S}}\lambda_s\left\{\psi_\circ(q'_s)+\left\langle q_s-q'_s,a_s\right\rangle_{L^2}+t\int_0^1\xi_\star(a_s(v))\,\mathrm{d}v\right\}. \end{align}\] Taking the infimum over \(q'\) and using that the variables \(q'_s\) are independent on the right side, we obtain \[\inf_{q'\in\mathcal{Q}_\infty^\mathscr{S}}\mathcal{J}_{t,q}(q',p)\leqslant\sum_{s\in\mathscr{S}}\lambda_s\inf_{r'\in\mathcal{Q}_\infty}\mathcal{J}^\star_{t,q_s}(r',a_s).\] Taking the supremum over \(p\in\mathcal{Q}_\infty^\mathscr{S}\), or equivalently over the collection \((a_s)_{s\in\mathscr{S}}\), gives \[f(t,q)\leqslant\sum_{s\in\mathscr{S}}\lambda_s\sup_{a_s\in\mathcal{Q}_\infty}\inf_{r'\in\mathcal{Q}_\infty}\mathcal{J}^\star_{t,q_s}(r',a_s)=\sum_{s\in\mathscr{S}}\lambda_su(t,q_s).\] This proves ?? . Taking \(q=0\) gives ?? . ◻

Corollary 2 (One-species formula for balanced models). Assume that \(\xi\) is balanced with respect to \(\lambda\). Then, for every \(t\geqslant 0\), \[\label{e46balanced95simple95formula} \lim_{N\to\infty}\overline{F}_N(t,0)=\sup_{a\in\mathcal{Q}_\infty}\inf_{r\in\mathcal{Q}_\infty}\left\{\psi_\circ(r)-\left\langle r,a\right\rangle_{L^2}+t\int_0^1\xi_\star(a(v))\,\mathrm{d}v\right\}.\tag{200}\] In particular, for the explicit balanced models in Lemma 20, the effective one-species covariance function is \[\label{e46balanced95effective95covariance} \xi_\star(x)=\sum_{p\geqslant 1}\beta_p^2x^p,\qquad \beta_p^2=\sum_{s_1,\ldots,s_p\in\mathscr{S}}\Delta^2_{s_1,\ldots,s_p}\lambda_{s_1}\cdots\lambda_{s_p}.\tag{201}\]

Proof. By Theorem 1, the left side of 200 is \(f(t,0)\). By Proposition 21, \(f(t,0)=u(t,0)\). The definition 196 of \(u\) at \(r=0\) is precisely 200 . ◻

Remark 22. Equivalently, the right-hand side of 200 is the limiting free energy of the single-species centered Ising spin glass with covariance function \(\xi_\star\). In other words, if \((H_N^\star(\sigma))_{\sigma\in\{-1,1\}^N}\) is the centered Gaussian field with covariance \[\mathbb{E}\left[H_N^\star(\sigma)H_N^\star(\sigma')\right]=N\xi_\star\left(\frac{1}{N}\sum_{i=1}^N\sigma_i\sigma'_i\right),\] then \[\lim_{N\to\infty}\overline{F}_N(t,0)=\lim_{N\to\infty}\left\{-\frac{1}{N}\mathbb{E}\log\sum_{\sigma\in\{-1,1\}^N}2^{-N}\exp\left(\sqrt{2t}H_N^\star(\sigma)-Nt\xi_\star(1)\right)\right\}.\] This shows that the lower bound in [9] is sharp for balanced models with centered Ising spins in the present setting.

10 Theorem 3 in general vector spin glasses↩︎

The setting in which we proved Theorem 3 is given in 93 . This is a special vector spin glass model, where the covariance of the Hamiltonian depends only on the diagonal entries of the overlap matrix. It is not the most general vector spin glass setting considered in [3]. In this section, we describe the modifications needed to obtain a version of Theorem 3 for the general vector spin model described in [3].

We first discuss the relevant path space. In the special case 93 , the paths are \(\mathbb{R}^{D}_+\)-valued nondecreasing paths. For the general vector spin model, the paths are matrix-valued. We again denote by \({D}\) the dimension of a single spin, and assume that the distribution of a single spin is supported on the unit ball in \(\mathbb{R}^{D}\). Let \(\mathbf{S}^{D}\) be the space of \({D}\times{D}\) real symmetric matrices, and let \(\mathbf{S}^{D}_+\) be the subset of positive semidefinite matrices and \(\mathbf{S}^{D}_{++}\) the subset of positive definite matrices. We equip \(\mathbf{S}^{D}\) with the Frobenius norm. Let \[\label{e46def46mclQ} \mathcal{Q} := \left\{ q : [0,1) \to \mathbf{S}^{D}_+ \;: \;q \text{ is right-continuous with left limits, and is increasing} \right\},\tag{202}\] where “\(q\) is increasing” means that, for every \(u,v \in [0,1)\), \[u \leqslant v \quad \implies \quad q(u) \leqslant q(v),\] and the latter inequality means that \(q(v)-q(u)\in\mathbf{S}^{D}_+\). For every \(r \in [1,\infty]\), we set \(\mathcal{Q}_r := \mathcal{Q} \cap L^r([0,1]; \mathbf{S}^{D})\). For any matrix \(a\in\mathbf{S}^{D}\), we denote by \(\lambda_{\max}(a)\) and \(\lambda_{\min}(a)\) its largest and smallest eigenvalues, respectively. For each \(a\in\mathbf{S}^{D}_+\), define \[\begin{align} \mathsf{Ellipt}(a) := \frac{\lambda_{\max}(a)}{\lambda_{\min}(a)}. \end{align}\] For every \(c > 0\), we write \[\begin{gather} \label{e46def46C95c} \mathcal{Q}_{\uparrow,c} :=\big \{{q}\in\mathcal{Q}_2 \;\mid \;q(0) = 0 \;\text{ and } \;\forall u \leqslant v \in [0,1), \quad q(v) - q(u) \geqslant c (v-u) \mathrm{Id}\\ \text{and } \quad \mathsf{Ellipt}(q(v) - q(u)) \leqslant c^{-1} \big\}, \end{gather}\tag{203}\] where \(\mathrm{Id}\) denotes the identity matrix.

The first main modifications occur in the cavity computations in Section 5, which correspond to [3]. In the present general setting, the self-overlap \(\sigma\sigma^\intercal\) is no longer constantly equal to \(\vec{\mathbf{1}}\). Thus, in the definition of \(\Delta_N\) in 113 , we need additional perturbation terms that force the self-overlap to concentrate. These terms are already included in the definition of \(\Delta_N\) in [3]. Proposition 13 is already a modification of [3]. With the modification described below Proposition 13, we obtain the corresponding strengthened version of [3], allowing the additional varying parameter \(q_k\) as in Proposition 13.

The arguments in Section 6 are new. The only modifications needed here are to handle the extra technical condition involving \(\mathsf{Ellipt}\) in the definition of \(\mathcal{Q}_{\uparrow,c}\). We start by defining \(\{q_i\}_{i\in\mathbb{N}}\) as in 118 , but now with \(\{e_d\}_{d\in \{1,\dots,\frac{{D}({D}+1)}{2}\}}\) chosen to be matrices in \(\mathbf{S}^{D}_+\) that span \(\mathbf{S}^{D}\). We then need the following technical lemma.

Lemma 21. If \(q\in \mathcal{Q}_{\uparrow,c}\) and \(q'\in\mathcal{Q}\) with \(|\accentset{\large\bfseries .}{q}'|_{L^\infty}\leqslant a\) for some constants \(c>a>0\), then \(q+q'\in\mathcal{Q}_{\uparrow,\frac{c-a}{1+a}}\).

Proof. Fix any \(0\leqslant u<v<1\). The definition of \(\mathcal{Q}_{\uparrow,c}\) gives \[\begin{align} \label{e46q40v41-q40u41} q(v) -q(u) \geqslant c(v-u) \mathrm{Id}\quad\text{and}\quad \mathsf{Ellipt}(q(v)-q(u)) \leqslant c^{-1}. \end{align}\tag{204}\] Since \(q'\in\mathcal{Q}\), we immediately have \[\begin{align} \label{e46q43q39-q-q3962} (q(v)+q'(v))-(q(u)+q'(u)) \geqslant q(v)-q(u)\geqslant c(v-u)\mathrm{Id}. \end{align}\tag{205}\] By Weyl’s inequalities, \(\lambda_{\max}\) and \(\lambda_{\min}\) are respectively sub-additive and super-additive. Therefore, given two symmetric matrices \(A,B \in \mathbf{S}^{D}\) such that \(A+B \in \mathbf{S}^{D}_{++}\), \(\lambda_{\max}(A) + \lambda_{\max}(B) \geqslant 0\), and \(\lambda_{\min}(A) + \lambda_{\min}(B) > 0\), we have \[\label{e46ellipt32bounds} \mathsf{Ellipt}(A+B) \leqslant\frac{\lambda_{\max}(A) + \lambda_{\max}(B)}{\lambda_{\min}(A) + \lambda_{\min}(B)}.\tag{206}\] The bound \(|\accentset{\large\bfseries .}{q}'|_{L^\infty}\leqslant a\) implies \[\begin{align} \label{e46kappa40v41-kappa40u4160} q'(v) - q'(u) \leqslant a(v-u)\mathrm{Id}. \end{align}\tag{207}\] Thus, \[\begin{align} \label{e46lambda40kappa40v41-kappa40u4141} \lambda_{\max}(q'(v)-q'(u)),\;\lambda_{\min}(q'(v)-q'(u)) \in [-a(v-u), a(v-u)]. \end{align}\tag{208}\] It follows that \[\begin{align} &\mathsf{Ellipt}((q(v)+q'(v))-(q(u)+q'(u))) \stackrel{\eqref{e46ellipt32bounds}\eqref{e46lambda40kappa40v41-kappa40u4141}}{\leqslant} \frac{\lambda_{\max}(q(v) - q(u)) + a(v-u)}{\lambda_{\min}(q(v) - q(u)) - a (v-u)} \\ &\stackrel{\eqref{e46q40v41-q40u41}}{\leqslant} \frac{c^{-1}(\lambda_{\min}(q(v) - q(u))-a(v-u)) + (c^{-1}+1)a(v-u)}{\lambda_{\min}(q(v) - q(u)) - a (v-u)} \leqslant c^{-1} + \frac{(c^{-1}+1)a(v-u)}{\lambda_{\min}(q(v) - q(u)) - a (v-u)} \\ &\stackrel{\eqref{e46q40v41-q40u41}}{\leqslant} c^{-1} + \frac{(c^{-1}+1)a(v-u)}{c(v-u) - a (v-u)} =c^{-1} +\frac{(c^{-1}+1)a}{c - a} = \frac{1+a}{c-a}. \end{align}\] Together with 205 , this shows that \(q+q'\in\mathcal{Q}_{\uparrow,\frac{c-a}{1+a}}\). ◻

We also need to replace Lemma 15 with the following result.

Lemma 22. Let \(t>0\) and \(q\in\mathcal{Q}_{\uparrow,c}\) for some \(c>0\). Then, there are constants \(b,N_0,r_0>0\) such that \[\begin{align} \frac{\mathrm{d}^2}{\mathrm{d}r^2}\overline{F}_N\left(t,\;q+a_i r q_i+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j \right) \leqslant b,\quad\forall i\in\mathbb{N},\; N\geqslant N_0, \; r\in[0,r_0). \end{align}\] Moreover, the same statement holds for \(\widetilde{F}_N^x\) and \(\overline{F}^x_{N+1}\) in place of \(\overline{F}_N\), uniformly in \(x\in[0,3]^{\mathbb{N}^4}\).

Proof. Writing \(q' = a_i r q_i+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j\), we obtain from 120 that \(|\accentset{\large\bfseries .}{q}'|_{L^\infty}\leqslant N^{-\gamma/2}+ r\). Hence, by Lemma 21, we can find \(c_0, N_0, r_0>0\) such that \[\begin{align} q+a_i r q_i+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j \in \mathcal{Q}_{\uparrow,c_0},\qquad\forall i \in\mathbb{N},\;N\geqslant N_0,\;r\in[0,r_0). \end{align}\]

Fix any \(i\in\mathbb{N}\) and write \(q_* = q+N^{-\gamma/2}\sum_{j\neq i}a_j y_jq_j\) and \(\kappa = a_iq_i\). The preceding display ensures that \(q_*+r\kappa\in\mathcal{Q}_{\uparrow,c_0}\) for every \(N\geqslant N_0\) and \(r<r_0\). Set \(F(r)=\overline{F}_N(t,q_*+r\kappa)\). For \(\varepsilon>0\) small, applying the local semi-concavity result for \(\overline{F}_N\) from [3]2 with \(\frac{1}{2}, q_*+r\kappa, q_*+(r+\varepsilon)\kappa, c_0\) substituted for \(r, q,q',c\) therein, we get \[\begin{align} \tfrac{1}{2}F(r)+\tfrac{1}{2}F(r+\varepsilon)- F\left(r+\tfrac{\varepsilon}{2}\right)\leqslant\tfrac{C}{4} c_0^{-2}\varepsilon^2\left|\accentset{\large\bfseries .}{\kappa}\right|_{L^2}^2 \end{align}\] for some absolute constant \(C>0\). Dividing both sides by \(\varepsilon^2\), sending \(\varepsilon\to0\), and using \(\kappa=a_iq_i\), we obtain \(\frac{\mathrm{d}^2}{\mathrm{d}r^2}F(r)\leqslant 2Cc_0^{-2}\left|a_i\accentset{\large\bfseries .}{q}_i\right|_{L^2}^2 \leqslant 2Cc_0^{-2}\), where the last inequality follows from 120 . This gives the desired result.

The same estimates hold for \(\widetilde{F}_N^x\) and \(\overline{F}^x_{N+1}\) for the same reason as in Remark 10. ◻

With this lemma, one can prove the corresponding version of Lemma 16, with the bound now holding only for \(N\geqslant N_0\) for some \(N_0\) possibly larger than the one in Lemma 22. Indeed, to obtain 127 , we need to apply Lemma 22 with \(N^{-\gamma/2}y_i\) substituted for \(r\), which requires \(N^{-\gamma/2}y_i<r_0\). Since \(y_i\in[0,3]\), it is enough to enlarge \(N_0\) so that \(3N_0^{-\gamma/2}<r_0\).

The remaining proofs in Section 6 are unchanged. Therefore, we obtain the following version of Theorem 3.

Theorem 7. Assume the setting of [3]. For every \(t > 0\) and \(q \in \mathcal{Q}_1\), there exist \(p^+, p^- \in \mathcal{Q}_{\infty}\) satisfying \(\left|p^\pm\right|_{L^\infty}\leqslant 1\) such that \[p^+=\partial_q\psi(q+t\nabla\xi(p^+)), \qquad p^-=\partial_q\psi(q+t\nabla\xi(p^-)),\] and \[\mathscr{P}_{t,q}(p^-) \leqslant\liminf_{N \to \infty} \overline{F}_N(t,q) \leqslant\limsup_{N\to\infty} \overline{F}_N(t,q)\leqslant\mathscr{P}_{t,q}(p^+).\]

11 A Hamilton–Jacobi comparison proof for balanced models↩︎

In this appendix, we sketch an alternative proof of the single-species interpretation in Remark 22. The argument is closer in spirit to the Hamilton–Jacobi comparison method used in [10]. It does not use the Hopf formula, nor does it use Theorem 1. Throughout this appendix, we assume that \(\xi\) is balanced with respect to \(\lambda\) in the sense of Definition 3, and that \(\xi_\star\) is an admissible one-species covariance function. This latter condition is automatic for the power-series examples in Lemma 20.

Let \(f:\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S}\to\mathbb{R}\) be the Lipschitz viscosity solution of \[\begin{align} \label{e46app95balanced95ms95hj} \begin{cases} \partial_t f-\displaystyle\int_0^1 \xi(\partial_q f)=0,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}_2^\mathscr{S},\\ f(0,q)=\psi(q)=\displaystyle\sum_{s\in\mathscr{S}}\lambda_s\psi_\circ(q_s),\qquad &q=(q_s)_{s\in\mathscr{S}}\in\mathcal{Q}_2^\mathscr{S}. \end{cases} \end{align}\tag{209}\] Let \(u:\mathbb{R}_+\times\mathcal{Q}_2\to\mathbb{R}\) be the Lipschitz viscosity solution of the associated one-species equation \[\begin{align} \label{e46app95balanced95single95hj} \begin{cases} \partial_t u-\displaystyle\int_0^1 \xi_\star(\partial_q u)=0,\qquad &\text{on }\mathbb{R}_+\times\mathcal{Q}_2,\\ u(0,r)=\psi_\circ(r),\qquad &r\in\mathcal{Q}_2. \end{cases} \end{align}\tag{210}\] By the one-species Parisi formula, or equivalently by the one-species Hamilton–Jacobi convergence theorem, \(u(t,0)\) is the limiting free energy of the centered Ising spin glass with covariance function \(\xi_\star\).

We first recall the two bounds that enter the comparison. The lower bound is the Hamilton–Jacobi lower bound from Proposition 20: \[\begin{align} \label{e46app95balanced95lower95bound} f(t,0)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,0). \end{align}\tag{211}\] The corresponding upper bound is obtained by an interpolation, as in [10] and in the balanced comparison of [9]. More precisely, let \((H_N^\star(\sigma))_{\sigma\in\{-1,1\}^N}\) be the one-species Gaussian field with covariance \[\begin{align} \mathbb{E}\left[H_N^\star(\sigma)H_N^\star(\sigma')\right] =N\xi_\star\left(\frac{1}{N}\sum_{i=1}^N\sigma_i\sigma_i'\right), \end{align}\] and define \[\begin{align} \label{e46app95balanced95single95free95energy} \overline{F}_N^\star(t,0):=-\frac{1}{N}\mathbb{E}\log\sum_{\sigma\in\{-1,1\}^N}2^{-N}\exp\left(\sqrt{2t}H_N^\star(\sigma)-Nt\xi_\star(1)\right). \end{align}\tag{212}\] Then, [10] gives \[\begin{align} \label{e46app95balanced95upper95bound} \limsup_{N\to\infty}\overline{F}_N(t,0)\leqslant\lim_{N\to\infty}\overline{F}_N^\star(t,0)=u(t,0). \end{align}\tag{213}\]

It remains to show that the two bounds 211 and 213 match. This is a purely Hamilton–Jacobi comparison statement.

Proposition 23. For every \(t\geqslant 0\) and every \(q=(q_s)_{s\in\mathscr{S}}\in\mathcal{Q}_2^\mathscr{S}\), writing \(q^\lambda:=\sum_{s\in\mathscr{S}}\lambda_s q_s\), we have \[\begin{align} \label{e46app95balanced95hj95sandwich} u(t,q^\lambda)\leqslant f(t,q)\leqslant\sum_{s\in\mathscr{S}}\lambda_s u(t,q_s). \end{align}\qquad{(9)}\] In particular, we have \(f(t,0)=u(t,0)\).

Sketch of proof. Define \[\begin{align} v(t,q):=u(t,q^\lambda),\qquad w(t,q):=\sum_{s\in\mathscr{S}}\lambda_s u(t,q_s). \end{align}\] We first check, in the viscosity sense, that \(v\) solves the multi-species equation 209 . Formally, if \(a=\partial_q u(t,q^\lambda)\), then \[\begin{align} \partial_{q_s}v(t,q)=\lambda_s a,\qquad s\in\mathscr{S}. \end{align}\] Thus, using the diagonal identity 189 , \[\begin{align} \xi((\partial_{q_s}v)_{s\in\mathscr{S}})=\xi(\lambda a)=\xi_\star(a), \end{align}\] and therefore the equation for \(v\) follows from the equation for \(u\).

This formal verification can be justified rigorously with the standard doubling-variable argument for viscosity solutions on infinite-dimensional cones. The only point that is not completely formal is the existence of maximizers for the penalized functional; as in the proof of Proposition 18, this is obtained by applying Stegall’s variational principle, Theorem 6. Equivalently, one repeats the proof of Proposition 18 with the bounded linear map \[\begin{align} B:\mathcal{H}_\mathscr{S}\to L^2([0,1]),\qquad Bq=\sum_{s\in\mathscr{S}}\lambda_s q_s, \end{align}\] whose adjoint is \(B^*a=(\lambda_s a)_{s\in\mathscr{S}}\). The identity \(\xi(B^*a)=\xi_\star(a)\) is exactly 189 . This proves that \(v\) is a viscosity solution, in particular a viscosity subsolution, of 209 .

Next we check that \(w\) is a viscosity supersolution of 209 . Formally, if \(a_s=\partial_q u(t,q_s)\), then \[\begin{align} \partial_{q_s}w(t,q)=\lambda_s a_s. \end{align}\] Using the one-species equation for \(u\) and the balanced comparison inequality 190 , we obtain \[\begin{align} \partial_t w(t,q)-\int_0^1\xi(\partial_q w) &=\sum_{s\in\mathscr{S}}\lambda_s\int_0^1\xi_\star(a_s(v))\,\mathrm{d}v-\int_0^1\xi((\lambda_s a_s(v))_{s\in\mathscr{S}})\,\mathrm{d}v\geqslant 0. \end{align}\] The viscosity justification is again obtained by the same Stegall perturbation argument used in Proposition 18, now applied separately to the components \(q_s\). Thus \(w\) is a viscosity supersolution.

Finally, by the transport convexity of \(\psi_\circ\) proved in Proposition 3, \[\begin{align} v(0,q)=\psi_\circ(q^\lambda)\leqslant\sum_{s\in\mathscr{S}}\lambda_s\psi_\circ(q_s)=f(0,q), \end{align}\] while \[\begin{align} w(0,q)=\sum_{s\in\mathscr{S}}\lambda_s\psi_\circ(q_s)=f(0,q). \end{align}\] The comparison principle for the Hamilton–Jacobi equation gives \(v\leqslant f\leqslant w\), which is ?? . Taking \(q=0\) gives the particular case. ◻

Combining 211 , 213 , and Proposition 23, we obtain \[\begin{align} u(t,0)=f(t,0)\leqslant\liminf_{N\to\infty}\overline{F}_N(t,0)\leqslant\limsup_{N\to\infty}\overline{F}_N(t,0)\leqslant u(t,0). \end{align}\] Consequently, \[\begin{align} \label{e46app95balanced95final95identity} \lim_{N\to\infty}\overline{F}_N(t,0)=u(t,0)=\lim_{N\to\infty}\overline{F}_N^\star(t,0). \end{align}\tag{214}\] This recovers the conclusion of Remark 22 without using either the Hopf representation or Theorem 1. In particular, for the power-series balanced models of Lemma 20, this gives the matching single-species Parisi-formula bound in the sense of [9].

Acknowledgements. HBC acknowledges funding from the NYU Shanghai Start-Up Fund and support from the NYU–ECNU Institute of Mathematical Sciences at NYU Shanghai. HBC warmly thanks Mirek Olšák, Zoe Xue, Tianhao Zheng, and Lixing Zhou for performing simulations that support the convexity result in Proposition 3. VI acknowledges stimulating discussions with Fu-Hsuan Ho before starting this project. JCM acknowledges the support of the ERC MSCA grant SLOHD (101203974).

References↩︎

[1]
Adriano Barra, Pierluigi Contucci, Emanuele Mingione, and Daniele Tantari. Multi-species mean field spin glasses. Rigorous results. Ann. Henri Poincaré, 16(3):691–708, 2015.
[2]
Hong-Bin Chen. Free energy in spin glass models with conventional order. J. Stat. Phys., 191(4):49, 2024.
[3]
Hong-Bin Chen and Jean-Christophe Mourrat. On the free energy of vector spin glasses with nonconvex interactions. Probab. Math. Phys., 6(1):1–80, 2025.
[4]
Francesco Guerra. Broken replica symmetry bounds in the mean field spin glass model. Comm. Math. Phys., 233(1):1–12, 2003.
[5]
Dmitry Panchenko. The Sherrington–Kirkpatrick model. Springer Monographs in Mathematics. Springer, New York, 2013.
[6]
Dmitry Panchenko. The free energy in a multi-species Sherrington–Kirkpatrick model. Ann. Probab., 43(6):3494–3513, 2015.
[7]
Michel Talagrand. The Parisi formula. Ann. of Math. (2), 163(1):221–263, 2006.
[8]
Jean-Christophe Mourrat. Nonconvex interactions in mean-field spin glasses. Probab. Math. Phys., 2(2):281–339, 2021.
[9]
Erik Bates and Youngtak Sohn. Balanced multi-species spin glasses. Preprint, arXiv:2507.06522, 2025.
[10]
Victor Issa. Existence and uniqueness of permutation-invariant optimizers for Parisi formula. Preprint, arXiv:2407.13846, 2024.
[11]
Tomas Dominguez and Jean-Christophe Mourrat. Statistical mechanics of mean-field disordered systems: a Hamilton–Jacobi approach. Zurich Lectures in Advanced Mathematics. EMS Press, 2024.
[12]
Hong-Bin Chen, Victor Issa, and Jean-Christophe Mourrat. Free energy of non-convex multi-species spherical spin glasses. In preparation, 2026.
[13]
Jean-Christophe Mourrat. Free energy upper bound for mean-field vector spin glasses. Ann. Inst. Henri Poincaré Probab. Stat., 59(3):1143–1182, 2023.
[14]
Hong-Bin Chen and Jiaming Xia. . Probab. Theory Related Fields, 192(3):803–873, 2025.
[15]
Giorgio Parisi. Infinite number of order parameters for spin-glasses. Phys. Rev. Lett., 43(23):1754, 1979.
[16]
Giorgio Parisi. A sequence of approximated solutions to the SK model for spin glasses. J. Phys. A: Math. Gen., 13(4):L115–L121, 1980.
[17]
Dmitry Panchenko. The Parisi ultrametricity conjecture. Ann. of Math. (2), 177(1):383–393, 2013.
[18]
Michael Aizenman, Robert Sims, and Shannon L. Starr. . Phys. Rev. B, 68(21):214403, 2003.
[19]
Dmitry Panchenko. Free energy in the Potts spin glass. Ann. Probab., 46(2):829–864, 2018.
[20]
Dmitry Panchenko. Free energy in the mixed \(p\)-spin models with vector spins. Ann. Probab., 46(2):865–896, 2018.
[21]
Erik Bates and Youngtak Sohn. Free energy in multi-species mixed \(p\)-spin spherical models. Electron. J. Probab., 27:Paper No. 52, 75, 2022.
[22]
Wei-Kuo Chen. The Aizenman–Sims–Starr scheme and Parisi formula for mixed \(p\)-spin spherical models. Electron. J. Probab., 18:no. 94, 14, 2013.
[23]
Michel Talagrand. Free energy of the spherical mean field model. Probab. Theory Related Fields, 134(3):339–382, 2006.
[24]
Eliran Subag. TAP approach for multispecies spherical spin glasses II: The free energy of the pure models. Ann. Probab., 51(3):1004–1024, 2023.
[25]
Eliran Subag. TAP approach for multi-species spherical spin glasses I: General theory. Electron. J. Probab., 30:Paper No. 87, 32, 2025.
[26]
Antonio Auffinger and Wei-Kuo Chen. Free energy and complexity of spherical bipartite models. J. Stat. Phys., 157(1):40–59, 2014.
[27]
Jinho Baik and Ji Oon Lee. Free energy of bipartite spherical Sherrington–Kirkpatrick model. Ann. Inst. Henri Poincaré Probab. Stat., 56(4):2897–2934, 2020.
[28]
Stephane Dartois and Benjamin McKenna. Injective norm of real and complex random tensors I: From spin glasses to geometric entanglement. Preprint, arXiv:2404.03627, 2024.
[29]
Erik Bates and Youngtak Sohn. formula for balanced Potts spin glass. Comm. Math. Phys., 405(10):Paper No. 228, 68, 2024.
[30]
Yan V. Fyodorov, I. Ya. Korenblit, and E.F. Shender. Antiferromagnetic Ising spin glass. J. Phys. C: Solid State Phys., 20(12):1835, 1987.
[31]
Yan V. Fyodorov, I. Ya. Korenblit, and E.F. Shender. Phase transitions in frustrated metamagnets. EPL, 4(7):827, 1987.
[32]
Gavin S Hartnett, Edward Parker, and Edward Geist. Replica symmetry breaking in bipartite spin glasses and neural networks. Phys. Rev. E, 98(2):022116, 2018.
[33]
I. Ya. Korenblit and E.F. Shender. Spin glass in an Ising two-sublattice magnet. Zh. Eksp. Teor. Fiz., 89:1785–1795, 1985.
[34]
Hong-Bin Chen. On free energy of non-convex multi-species spin glasses. ALEA Lat. Am. J. Probab. Math. Stat., 23(1):429–473, 2026.
[35]
Jean-Christophe Mourrat and Dmitry Panchenko. Extending the Parisi formula along a Hamilton–Jacobi equation. Electron. J. Probab., 25:Paper No. 23, 17, 2020.
[36]
Jean-Christophe Mourrat. The Parisi formula is a Hamilton–Jacobi equation in Wasserstein space. Canad. J. Math., 74(3):607–629, 2022.
[37]
Hong-Bin Chen, Victor Issa, and Jean-Christophe Mourrat. . Preprint, arXiv:2508.06397, 2025.
[38]
Victor Issa. A Hopf-like formula for mean-field spin glass models. Preprint, arXiv:2410.08754, 2024.
[39]
Jean-Christophe Mourrat. Spin glasses and the Parisi formula. Preprint, arXiv:2510.01054, 2025.
[40]
Jean-Christophe Mourrat. Un-inverting the Parisi formula. Ann. Inst. Henri Poincaré Probab. Stat., 61(4):2709–2720, 2025.
[41]
Antonio Auffinger and Wei-Kuo Chen. The Parisi formula has a unique minimizer. Comm. Math. Phys., 335(3):1429–1444, 2015.
[42]
Dmitry Panchenko. A question about the Parisi functional. Electron. Comm. Probab., 10:155–166, 2005.
[43]
Charles Stegall. Optimization of functions on certain subsets of Banach spaces. Math. Ann., 236(2):171–176, 1978.
[44]
Pierre Cardaliaguet. Notes on mean field games. Technical report, Technical report, 2010.

  1. This proposition gives semi-concavity jointly in \((t,q)\) which requires the additional condition that \(t>c\). Since here we have fixed \(t\) and only need semi-concavity in \(q\), there is no condition needed on \(t\).↩︎

  2. This proposition gives semi-concavity jointly in \((t,q)\), which requires an additional condition on \(t\). Here, \(t\) is fixed and we only need semi-concavity in \(q\), so no such condition is needed on \(t\).↩︎