July 16, 2026
This paper develops a categorical framework – Learning in Infinitesimal Non-Compositional Sketches (Lincs ) – that reframes machine learning (ML) as the repair of non-compositionality: failures of diagrams to factor through their intended quotient sketches lifted to the tangent category setting. ML problems are specified as sketches (graphs with commutativity conditions \(\mathcal{D}\), limit cones \(\mathcal{L}\), and colimit cocones \(\mathcal{K}\)), generalizing the usual scalarization of loss functions or vector space assumptions. Non-compositionality is defined purely as failure of a universal factorization problem, not as arithmetic error between the desired and actual predictions. The central object is Infinitesimal Non-Compositionality (INC): given a learning sketch \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\), whose underlying graph is \(S\), and a model \(D:J \rightarrow C\), the base defect is the obstruction to factorization \(Obs(Fact_{\mathbb{S}}(D))\). The tangent lift applies the tangent functor \(T\) to obtain \(TD:J \rightarrow C\), and INC is the obstruction \(Obs(Fact_{\mathbb{S}}(TD))\) —asking whether infinitesimal perturbations preserve the compositionality constraints.
The paper also introduces Tangent Learning Sketches, which are sketches equipped with Cockett-Cruttwell tangent structure, ensuring that if \(D\) is admissible, so is \(TD\). This allows the definition of Lincs categories where learning data includes the pair \((Fact_{\mathbb{S}}(D),Fact_{\mathbb{S}}(TD))\). Beyond tangent factorization, the framework admits sketch-specific interaction enrichments. Lie-bracket closure is the intrinsic antisymmetric specialization; when a connection is declared, the full second-order jet also contains connection-dependent symmetric acceleration. Parameterized realizations must descend through presentation redundancies, and computational tangent signals are admitted contingently rather than assigned mandatory weight. The paper defines the INC endofunctor \(T_{INC}\), which iterates the tangent lift, producing a tower \(D,TD,T^2D, \cdots\) of factorization problems. ML is thereby formulated as the search for a coalgebraic fixed point where successive tangent unfoldings stabilize (\(\nu T_{INC}\)). Using the Aczel–Mendler theorem, we prove existence of a final INC coalgebra whenever \(T_{INC}\) admits a set-based class realization that creates its final carrier. Barr’s theorem yields a set-sized alternative for accessible realizations and a regular-cardinal bound on the final carrier. For complete metric realizations in which \(T_{INC}\) is contractive, we also prove existence and uniqueness of the stabilized INC behavior, geometric convergence of the exact tower, and a finite-error bound for approximate unfoldings. A detailed experimental evaluation of Lincs is underway in a number of concrete ML settings, including deep learning, large language models, and reinforcement learning, and is described in companion papers.
The dominant language of machine learning (ML) is optimization: choose a loss function and minimize it [1]–[3]. This language is powerful, but it hides a common structure shared across many learning objectives. A loss often scalarizes a failure of composition. A supervised loss scalarizes a failure of a predictor to compose input with target behavior. A Bellman residual scalarizes a failure of a value function to commute with the Bellman operator. A contrastive loss scalarizes failure of representation invariance across views. A sheaf loss scalarizes failure of local sections to glue. Diagrammatic Backpropagation (DB) made this viewpoint explicit: learning can be driven by failures of diagrammatic compositionality [4]. A DB loss scalarizes failure of a diagram of computations to commute.
The paradigmatic Transformer model used in large language models (LLMs) provides a suggestive example. After embedding, a length-\(m\) token sequence is represented as a point of a Euclidean array, and the content-only Transformer map \(F\) is permutation equivariant: for a permutation matrix \(P\), the intended sketch contains the commuting condition \(F(PX)=P F(X)\). Thus “scramble the input, then apply the model” and “apply the model, then scramble the output” are two paths that should agree, and an equivariance loss scalarizes their failure to compose. This statement deliberately factors out positional encodings, causal masks, and other order-dependent structure, which break or refine the permutation symmetry in an implemented language model. From the Lincs viewpoint the scalar loss is only the base-level shadow: one can also ask whether this equivariance square remains coherent under perturbations of embeddings, attention maps, and parameters, and whether new obstructions appear under the iterated lifts \(\mathsf{T}^2,\mathsf{T}^3,\ldots\). This suggests that Lincs may expose structural properties of language models that are invisible to the ordinary scalar objective. Section 4.0.0.1 answers this question explicitly: exact smooth equivariance propagates through every tangent order, whereas a nonzero higher obstruction localizes where approximate or deliberately broken equivariance fails to survive perturbation.
Using this paradigmatic example as a theme, Lincs explores the result of formulating a wide range of ML problems, from deep learning to large language models and reinforcement learning, as a categorical compositionality problem lifted by the tangent functor. We can therefore ask not only whether a base factorization problem is solved, but whether its infinitesimal transport is coherent. The central thesis is that every learning compositionality problem has a tangent lift. Figure 1 depicts this passage at the level of the factorization problem itself. The lift defines a new learning signal – Infinitesimal Non-Compositionality (INC). The usual ML formulation asks: is the scalarized defect small? Lincs asks: is the defect small, and does its tangent factorization behave correctly? This paper develops Lincs as a mathematical framework and illustrates the framework in a number of practical settings, from diagrammatic backpropagation in deep learning [4], Lie-algebraic LoRA adapters (Allora) for fine-tuning Transformer models [5], Lie-algebroidal skill optimization methods (Lasko) [6], and latent-confounded causal discovery using Lie-brackets [7].
The main contributions of this paper include the following:
It defines Infinitesimal Non-Compositionality (INC) as the tangent lift of diagrammatic factorization failure.
It formulates obstruction localization, a functorial decomposition of global non-compositionality into compatible local learning signals, and shows that this decomposition is preserved by tangent lift.
It formulates Lincs objects, Lincs morphisms, and INC categories using tangent-category structure.
It introduces interaction-enriched INC: bracket closure is the intrinsic antisymmetric specialization, while connection-equipped sketches may also retain symmetric acceleration and full second-order jet data.
It distinguishes the categorical tangent lift from its parameterized realization by requiring optimizer fields to descend through presentation quotients or to be supplied with an equivariant horizontal lift.
It gives a coalgebraic view of Lincs , proves existence of final INC coalgebras under set-based class or accessible set semantics, bounds the set-sized carrier at a regular cardinal, and proves geometric convergence for contractive metric realizations.
It proposes functoriality and universal-completion principles for Lincs categories.
It relates Lincs to Kan-invariant learning, tangent categories, infinitesimal causality, Lie-bracket learning, and homotopical repair.
It sketches how GIRL, Differential KET, Diagrammatic Backpropagation, causal Lie-bracket learning, ALLORA, and LASKO instantiate the same core axioms with domain-specific interaction signatures and contingent computational admission.
The use of sketches to present structured theories goes back to Ehresmann’s work on sketches and algebraic structures [8]. Sketches were later developed as a flexible categorical language for theories and models, notably in the work of Barr and Wells [9], Makkai and Paré [10], and Adámek and Rosický [11]. Following the Makkai-Paré presentation, we regard a sketch as a quadruple \((S,\mathcal{D},\mathcal{L},\mathcal{K})\), where \(S\) is an underlying graph, \(\mathcal{D}\) is a class of commutativity conditions, \(\mathcal{L}\) is a class of distinguished cones, and \(\mathcal{K}\) is a class of distinguished cocones. Lincs uses sketches in this spirit: a learning problem is specified by a graph of formal computations together with the commutative, limiting, and colimiting constraints that a strict learning model would satisfy.
Accessible-category theory provides a natural size-controlled setting for this sketch semantics. Under standard smallness hypotheses, many categories of models presented by sketches are accessible or locally presentable; conversely, accessible categories admit presentation results in categorical model theory [10], [11]. This connection is relevant to Lincs because accessibility supplies set-sized families of presentable models and closure under filtered colimits, offering a plausible technical setting for constructing categories of learning models and studying tangent or Lincs completions without uncontrolled size growth.
Rosický introduced abstract tangent functors, and Cockett and Cruttwell developed tangent categories as an axiomatic account of tangent bundle structure [12], [13]. The subsequent theory of differential bundles, tangent fibrations, and connections provides a categorical setting in which vector fields, curvature, and transport can be studied without choosing coordinates [14], [15]. Lincs builds directly on this tangent-categorical substrate by treating the Cockett-Cruttwell structure itself as sketch-presentable data acting on learning sketches and their factorization problems.
Leung gives a functorial classification of the Cockett–Cruttwell axioms in terms of Weil algebras [16]. If \(\mathcal{M}\) is a category, specifying tangent structure on \(\mathcal{M}\) is equivalent, up to isomorphism, to specifying a strong monoidal functor \[F:(\mathbb{N}\text{-}\mathsf{Weil}_1,\otimes,\mathbb{N}) \longrightarrow (\operatorname{End}(\mathcal{M}),\circ,1_{\mathcal{M}})\] that preserves the foundational pullbacks and the equalizer encoding the universality of vertical lift. The dual-number algebra \(W=\mathbb{N}[x]/(x^2)\) is sent to the tangent functor \(T=F(W)\), while the structural maps of \(W\) are sent to the projection, zero, addition, vertical lift, and canonical flip. Thus \(\mathbb{N}\text{-}\mathsf{Weil}_1\) acts as a classifying theory, or initial tangent structure, rather than merely providing examples of tangent functors. This result supplies the precise functorial semantics behind the tangent action used by Lincs; the additional Lincs data are the learning sketches, their admissible models, and the factorization obstructions transported by that action.
MacAdam’s thesis reconnects two strands of Ehresmann’s work—sketch theory and many-object Lie theory—through tangent categories [17]. It presents Lie algebroids by involution algebroids, a tangent-categorical sketch whose models in smooth manifolds form the category of Lie algebroids, and then identifies involution algebroids with suitably exact tangent functors out of the classifying category \(\mathsf{Weil}_1\). It also places Lie differentiation in a nerve–realization context induced by an infinitesimal groupoid object. This is directly relevant to Lincs: it supplies a rigorous precedent for both sketch-presented tangent structure and Lie-algebroidal semantics. The distinction is that MacAdam classifies infinitesimal geometric structure, whereas Lincs studies the obstruction to a learning model and its tangent lift satisfying a chosen sketch.
Several lines of work have used category theory to describe learning compositionally. Backpropagation has been formulated functorially [18], Universal Decision Learners formulate reinforcement learning and function approximation in terms of Kan-invariant extensions [19], and Kan Extension Transformers use Kan-extension structure to unify attention, diffusion-style completion, and predict-detach self-conditioning [20]. Diagrammatic Backpropagation treats noncommuting diagrams as learning signals [4]. Lincs extends this viewpoint by studying not only base non-compositionality, but also tangent obstructions, sketch-specific interaction profiles and closure, coalgebraic stabilization, and homotopical repair.
Universal Decision Learners (UDL) formulate decision learning in terms of Kan-invariant extensions of local decision data [19]. In this view, a learner extends partial information along a functor and seeks invariance under a universal extension. Bellman equations, policy evaluation, and function approximation become forms of local-to-global coherence. Lincs adds a tangent refinement: \[\text{Kan invariance in the base category} \quad\leadsto\quad \text{Kan invariance in the tangent category}.\] If a learned extension is a left or right Kan extension in \(\mathcal{C}\), then Lincs asks whether its tangent lift satisfies the corresponding universal property in \(\mathsf{T}\mathcal{C}\). This suggests a combined principle: learn by universal extension, then require infinitesimal coherence of the extension. In this sense, Lincs can be viewed as tangent Kan-invariant learning.
We introduce the core notions of learning sketches and tangent learning sketches in this section. Let \(\mathcal{C}\) be a category whose objects are states, representations, hypotheses, local models, sections, policies, or world-model fragments. Its morphisms are computations, transitions, encoders, decoders, interventions, update rules, or gluing maps. A diagram \(D:J\to\mathcal{C}\) expresses a desired compositional relationship. To motivate the sketch-based formalism, note that in a bare category, an arithmetic loss function cannot be encoded by an expression such as \(g\circ f-f\circ g\). Lincs translates these numerical losses into a categorical notion of non-compositionality, without assuming additive, metric, Hilbert, or vector-space enrichment.
We begin with a sketch-theoretic formulation. Let \[\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\] be a sketch in the sense of Makkai and Paré: \(S\) is a graph, \(\mathcal{D}\) is a class of commutativity conditions in \(S\), \(\mathcal{L}\) is a class of cones, and \(\mathcal{K}\) is a class of cocones. Write \(J=\operatorname{Path}(S)\) for the free category on \(S\). The commutativity data \(\mathcal{D}\) generate a congruence \(\sim_{\mathcal{D}}\) on the morphisms of \(J\), and hence a quotient functor \[q_{\mathcal{D}}:J\to J/{\sim_{\mathcal{D}}}.\] The cone and cocone data specify the universal constraints a strict model is expected to realize. A diagram \(D:J\to\mathcal{C}\) satisfies the commutativity part of the sketch precisely when it factors through \(q_{\mathcal{D}}\): \[\begin{array}{ccc} J & \xrightarrow{D} & \mathcal{C}\\ \downarrow q_{\mathcal{D}} & \nearrow_{\bar D}\\ J/{\sim_{\mathcal{D}}} \end{array} \qquad D=\bar D q_{\mathcal{D}}.\] Thus non-compositionality is not an arithmetic difference. It is the failure of a universal factorization problem, enriched by the relevant cone and cocone constraints, to have a solution.
Definition 1 (Learning sketch). A learning sketch is a quadruple \[\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K}),\] where \(S\) is a graph of formal learning operations, \(\mathcal{D}\) is a class of path-equations expressing intended commutativity, \(\mathcal{L}\) is a class of cones expressing limiting constraints, and \(\mathcal{K}\) is a class of cocones expressing colimiting constraints. If \(J=\operatorname{Path}(S)\), the equations in \(\mathcal{D}\) generate a quotient \(q_{\mathcal{D}}:J\to J/{\sim_{\mathcal{D}}}\).
The passage from categories to sketches gains expressive power but weakens automatic transport. Spivak makes this tradeoff explicit for database schemas: specified limit and colimit cones can express constraints such as one table being the product of two others, but the resulting sketch formalism no longer inherits the full collection of built-in data-migration functors available for unconstrained categorical schemas [21]. The same issue matters for Lincs . A map of the underlying learning graphs need not preserve the designated cones, cocones, admissible models, or their repair spaces. Accordingly, transport between learning sketches is additional structure: a Lincs morphism or change of sketch must state which constraints and factorization problems it preserves. This is why the later functoriality results impose preservation of learning sketches and quotient factorization problems rather than deriving it from an arbitrary schema map.
There is also a limitation at the level of presentation itself. Barr and Wells show that not every natural category of structured objects and structure-preserving morphisms is the category of Set-valued models of an ordinary sketch: for example, certain categories defined by preservation of subinitial objects, and groups with center-preserving homomorphisms, are not sketchable in this sense [22]. They also indicate how higher-order sketches can recover some structures beyond this boundary. Thus the Lincs definitions are relative to a chosen sketch-presentable class of learning models and morphisms. When admissibility or preservation conditions quantify over structure that an ordinary sketch cannot present, a higher-order, enriched, or fibrational replacement may be required. The tangent action on factorization problems is already formulated in a way that permits such a refinement.
Definition 2 (Model of a learning sketch). Given a category \(\mathcal{C}\), a candidate model of a learning sketch \(\mathbb{S}\) in \(\mathcal{C}\) is a functor \(D:J\to\mathcal{C}\), where \(J=\operatorname{Path}(S)\). It is strict, or compositional, when there exists a functor \(\bar D:J/{\sim_{\mathcal{D}}}\to\mathcal{C}\) such that \(D=\bar Dq_{\mathcal{D}}\), and the images of the distinguished cones and cocones satisfy the universal requirements specified by \(\mathcal{L}\) and \(\mathcal{K}\).
Definition 3 (Non-compositionality as factorization failure). The non-compositionality of a model \(D:J\to\mathcal{C}\) of a learning sketch is the factorization problem \[\operatorname{Fact}_{\mathbb{S}}(D)=\{\bar D:J/{\sim_{\mathcal{D}}}\to\mathcal{C}\mid D=\bar Dq_{\mathcal{D}}\text{ and }\bar D\text{ realizes }\mathcal{L},\mathcal{K}\}.\] The model is compositional exactly when \(\operatorname{Fact}_{\mathbb{S}}(D)\) is inhabited. When only the commutativity component is under discussion, we write this as \(\operatorname{Fact}_{q_{\mathcal{D}}}(D)\).
Definition 4 (Tangent sketch). A tangent sketch is a sketch \[\mathbb{T}=(S_T,\mathcal{D}_T,\mathcal{L}_T,\mathcal{K}_T)\] whose graph contains formal operations for a tangent endofunctor \(T\), projection, zero, addition, vertical lift, and canonical flip, and whose commutativity, cone, and cocone data present the Cockett-Cruttwell tangent-category axioms. A model of \(\mathbb{T}\) in a category \(\mathcal{C}\) is precisely a choice of tangent-category structure on \(\mathcal{C}\), up to the level of strictness encoded by the sketch.
Definition 5 (Tangent learning sketch). A tangent learning sketch is a learning sketch \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\) equipped with an action of a tangent sketch on its factorization problem. Concretely, if \(J=\operatorname{Path}(S)\) and \(D:J\to\mathcal{C}\) is admissible in a model \((\mathcal{C},\mathsf{T})\) of the tangent sketch, then \(\mathsf{T}D:J\to\mathcal{C}\) is again admissible and the base factorization problem \[\operatorname{Fact}_{\mathbb{S}}(D)\] is transported to the tangent factorization problem \[\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D).\] Thus a tangent learning sketch is not merely a learning sketch interpreted in a tangent category; it is a sketch whose intended learning constraints are stable under the Cockett-Cruttwell tangent structure.
Remark 1 (Infinitesimal objects and representable tangent semantics). Leung’s classification identifies general tangent structure on \(\mathcal{C}\) with a strong monoidal functor from \(\mathbb{N}\text{-}\mathsf{Weil}_1\) to \(\operatorname{End}(\mathcal{C})\) preserving the designated foundational pullbacks and vertical-lift equalizer [16]. MacAdam gives a complementary representable realization of this functorial semantics and uses it in the semantics of Lie theory [17]. Following Cockett and Cruttwell, an infinitesimal object in a symmetric monoidal category is an object \(\mathbb{D}\) equipped with zero, augmentation, multiplication, and coaddition maps satisfying the stated (co)universality axioms. Equivalently, in the symmetric monoidal closed setting it determines a strict symmetric monoidal functor \[\mathbb{D}^{(-)}:\mathsf{Weil}_1\longrightarrow\mathcal{C}.\] It induces the representable tangent functor \(T=[\mathbb{D},-]\) on \(\mathcal{C}\) and the dual tangent functor \(T=\mathbb{D}\otimes(-)\) on \(\mathcal{C}^{\mathrm{op}}\). More generally, tangent structure on \(\mathcal{C}\) is equivalently expressed by a \(\mathsf{Weil}_1\) sketch action \[\mathsf{Weil}_1\times\mathcal{C}\longrightarrow\mathcal{C}.\] Consequently, a representable Lincs model admits a concrete reading: \(TD\) probes the learning diagram \(D\) by the infinitesimal object \(\mathbb{D}\), and \(\operatorname{INC}(D)\) asks whether this infinitesimal probe still realizes the factorization, limit, and colimit constraints of the learning sketch. MacAdam’s infinitesimal object is therefore not itself an INC obstruction; it represents the tangent structure with which the obstruction is formed.
Remark 2 (Lie-algebroidal realization of a tangent learning sketch). When a tangent learning sketch is realized over smooth state or parameter spaces, it can admit a more structured, Lie-algebroidal interpretation. MacAdam makes this presentation precise: involution algebroids form a tangent-categorical sketch, and their category in smooth manifolds is isomorphic to the category of Lie algebroids [17]. For each sketch object \(x\), let \(A_x\to M_x\) be a Lie algebroid over the realized object \(M_x=D(x)\), with anchor \[\rho_x:A_x\longrightarrow TM_x.\] The bundle \(A_x\) represents the admissible infinitesimal learning operations, whereas the anchor sends them to the actual tangent directions along which the realized model can change. A sketch arrow \(f:x\to y\) is equipped, when defined, with an algebroid transport \(A_f:A_x\to A_y\) over \(D(f)\) satisfying the anchor square \[\begin{array}{ccc} A_x & \xrightarrow{A_f} & A_y\\ \downarrow\rho_x && \downarrow\rho_y\\ TM_x & \xrightarrow{T(Df)} & TM_y. \end{array} \qquad T(Df)\rho_x=\rho_yA_f.\] Thus the path equations of the learning sketch constrain not only the base maps \(D(f)\) but also their induced transports of admissible infinitesimal operations. For two parallel sketch paths, compositionality requires the corresponding anchored transports to agree; tangent non-compositionality measures failure of this compatibility after passage through the anchors. The Lie-algebroid identity \[\rho_x([s,t]_{A_x})=[\rho_x(s),\rho_x(t)]\] then relates bracket closure of abstract learning operations to closure of their realized vector fields. This is an additional realization of a tangent learning sketch, not a claim that every tangent sketch canonically carries a Lie algebroid. MacAdam’s result provides the appropriate sketch semantics for this additional structure; the anchor and bracket conditions below specify how that structure acts on a particular learning diagram. It connects Lincs directly to LASKO, where skill edits are modeled as anchored sections and order-sensitive skill interactions are detected by their Lie brackets [6], [17].
A failed factorization may indicate a hidden variable, a missing morphism, a defective representation, an unmodeled constraint, a failure of gluing, or a missing causal direction. The learning problem is not merely to reduce error, but to repair structure so that a universal property becomes closer to being satisfied.
To make the Lincs formalization more concrete, we now list several concrete instances of the Lincs pattern. In each case, the base learning system has a compositionality defect, and the infinitesimal version asks whether that defect remains controlled after tangent lift. We spell out the first example in detail, since it is the running template for the later architectures.
The question posed in the introduction has a precise answer. Let \(F_\theta:\mathbb{R}^{m\times d}\to\mathbb{R}^{m\times e}\) be a smooth content-only Transformer and let a permutation matrix \(P\) act on the token axis. Define the base equivariance defect \[E_{P,\theta}(X)=F_\theta(PX)-PF_\theta(X).\] This is the additive scalarizable representative of the obstruction to the equivariance square. Its first tangent lift, evaluated on an input perturbation \(V\), is \[D E_{P,\theta}(X)[V] =D F_\theta(PX)[PV]-P D F_\theta(X)[V].\] If parameters are also perturbed by \(\dot{\theta}\), the full tangent defect adds \[\partial_\theta F_\theta(PX)[\dot{\theta}] -P\partial_\theta F_\theta(X)[\dot{\theta}].\] Consequently, tangent INC tests whether the local sensitivity of the Transformer intertwines the permutation action, rather than merely whether the two finite outputs happen to agree.
More generally, the \(n\)th input-level prolongation is represented by \[D^nF_\theta(PX)[PV_1,\ldots,PV_n] -P D^nF_\theta(X)[V_1,\ldots,V_n].\] Hence, if \(F_\theta(PX)=PF_\theta(X)\) holds identically on a smooth invariant domain, differentiating the identity shows that every displayed tangent and higher-order obstruction vanishes. The iterated Lincs question is therefore not mysterious in the ideal equivariant model: exact equivariance is inherited by all tangent orders. It becomes informative for learned or approximate equivariance, restricted data support, finite-precision implementations, and architectures containing positional encodings, causal masks, routing, or other order-dependent components. In those cases the base defect measures output-level symmetry breaking, the first lift measures its sensitivity, and higher lifts distinguish curvature and interaction effects that a small base loss can conceal. Thus the INC tower provides a graded diagnostic of where and at what differential order a language model departs from its intended equivariance sketch.
Gradient Infinitesimal Reinforcement Learning (GIRL) is the Lincs lift of gradient temporal-difference learning. Its base learning problem is policy evaluation in a Markov reward process: a value representation should be compatible with the Bellman update, and the tangent learning problem asks whether infinitesimal perturbations of states, values, parameters, or rewards preserve that compatibility.
Let \(\mathcal{X}\) denote the state object of an MRP, \(P^\pi:\mathcal{X}\to\mathcal{X}\) the transition morphism under policy \(\pi\), \(V_\theta:\mathcal{X}\to\mathbb{R}\) a parameterized value representation, and \[B_\pi:\mathbb{R}\to\mathbb{R}, \qquad B_\pi(v)=r+\gamma v,\] the scalar Bellman update induced by the reward and discount. The GIRL base square is \[\begin{array}{ccc} \mathcal{X} & \xrightarrow{\;P^\pi\;} & \mathcal{X}\\ \downarrow V_\theta && \downarrow V_\theta\\ \mathbb{R}& \xrightarrow{\;B_\pi\;} & \mathbb{R}. \end{array}\]
As a learning sketch, GIRL is the quadruple \[\mathbb{S}_{\mathrm{GIRL}} = (S_{\mathrm{GIRL}}, \mathcal{D}_{\mathrm{GIRL}}, \mathcal{L}_{\mathrm{GIRL}}, \mathcal{K}_{\mathrm{GIRL}}).\] The graph \(S_{\mathrm{GIRL}}\) has two formal objects \(x\) and \(v\), standing for states and values, and generating arrows \[p:x\to x, \qquad u:x\to v, \qquad b:v\to v.\] Under a model \(D_\theta:\operatorname{Path}(S_{\mathrm{GIRL}})\to\mathcal{C}\), these are interpreted as \[D_\theta(x)=\mathcal{X},\quad D_\theta(v)=\mathbb{R},\quad D_\theta(p)=P^\pi,\quad D_\theta(u)=V_\theta,\quad D_\theta(b)=B_\pi.\] The commutativity component is the single Bellman equation \[\mathcal{D}_{\mathrm{GIRL}} = \{\,u\circ p \sim b\circ u\,\}.\] Equivalently, the quotient \(q_{\mathcal{D}}:\operatorname{Path}(S_{\mathrm{GIRL}})\to \operatorname{Path}(S_{\mathrm{GIRL}})/{\sim_{\mathcal{D}}}\) identifies the two paths \[x\xrightarrow{p}x\xrightarrow{u}v, \qquad x\xrightarrow{u}v\xrightarrow{b}v.\] The limiting component \(\mathcal{L}_{\mathrm{GIRL}}\) records the admissible feature/value representation structure, for example the finite-dimensional parameter or feature cone through which \(V_\theta\) is required to factor in linear TD. The colimiting component \(\mathcal{K}_{\mathrm{GIRL}}\) records the sampling or empirical aggregation structure used to form the TD estimating equations, such as the finite-sample cocone that aggregates transition observations into the stochastic approximation objective. In the minimal Bellman sketch these two classes may be empty; in GTD and GTD-MP they carry the extra representation and empirical averaging structure needed by the saddle objective.
The base non-compositionality is therefore not the arithmetic Bellman residual itself. It is the obstruction \[\operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}_{\mathrm{GIRL}}}(D_\theta)\big)\] to realizing the Bellman sketch. A scalar TD, GTD, or GTD-MP loss is obtained only after applying a scalarization to this obstruction.
The corresponding tangent learning sketch equips \(\mathbb{S}_{\mathrm{GIRL}}\) with the Cockett-Cruttwell tangent action. Its model sends \(D_\theta\) to \[\mathsf{T}D_\theta:\operatorname{Path}(S_{\mathrm{GIRL}})\to\mathcal{C},\] whose interpreted arrows are \(\mathsf{T}P^\pi\), \(\mathsf{T}V_\theta\), and \(\mathsf{T}B_\pi\). The tangent Bellman square is \[\begin{array}{ccc} \mathsf{T}\mathcal{X} & \xrightarrow{\;\mathsf{T}P^\pi\;} & \mathsf{T}\mathcal{X}\\ \downarrow \mathsf{T}V_\theta && \downarrow \mathsf{T}V_\theta\\ \mathsf{T}\mathbb{R}& \xrightarrow{\;\mathsf{T}B_\pi\;} & \mathsf{T}\mathbb{R}. \end{array}\] The GIRL infinitesimal non-compositionality is \[\mathsf{INC}_{\mathrm{GIRL}}(D_\theta) = \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}_{\mathrm{GIRL}}}(\mathsf{T}D_\theta)\big).\] After scalarization, this yields the tangent Bellman error developed in the companion GIRL paper [23]. At the categorical level considered here, GIRL augments the base Bellman factorization problem with an infinitesimal Bellman-closure term; the concrete LINCS-GTD-MP saddle formulation is introduced in that companion work.
| Problem class | Representative obstruction or loss |
|---|---|
| GIRL [23] | Bellman and tangent Bellman loss |
| DB [4] | compositional backpropagation and tangent diagram loss |
| BRIDGE/SKFM/IC [7] | causal Lie-bracket closure loss |
| ALLORA [5] | LoRA matrix commutator and quotient interaction profiles |
| LASKO [6] | Markdown-category skill-composition loss |
A detailed experimental evaluation of Lincs across these problem classes—GIRL, DB, BRIDGE/SKFM/IC, ALLORA, and LASKO—is currently underway and will be reported in future work.
Kan Extension Transformers learn by extending local neighborhoods into global representations [20]. The base defect is a failure of neighborhood extension or Kan invariance; the INC lift asks whether the extension varies coherently under infinitesimal perturbations of tokens, embeddings, or neighborhoods.
Diagrammatic Backpropagation repairs noncommuting computational diagrams, and is the canonical example from which Lincs grows. A useful concrete instance is Sudoku solving. A candidate Sudoku grid determines many local views: its rows, columns, blocks, and individual cells. A correct solution is not merely a vector of predicted digits; it is a diagram whose overlapping local views agree and whose rows, columns, and blocks satisfy the Sudoku constraints.
Let \(X\) be a formal object for a candidate grid, \(R_i\) the \(i\)-th row object, \(K_j\) the \(j\)-th column object, \(B_b\) the \(b\)-th block object, and \(C_{ij}\) the cell object at position \((i,j)\). The Sudoku DB learning sketch is \[\mathbb{S}_{\mathrm{DB}} = (S_{\mathrm{DB}}, \mathcal{D}_{\mathrm{DB}}, \mathcal{L}_{\mathrm{DB}}, \mathcal{K}_{\mathrm{DB}}).\] The graph \(S_{\mathrm{DB}}\) contains the view maps \[\rho_i:X\to R_i,\qquad \kappa_j:X\to K_j,\qquad \beta_b:X\to B_b,\] and the cell-projection maps \[r_{ij}:R_i\to C_{ij},\qquad k_{ij}:K_j\to C_{ij},\qquad b_{ij}:B_b\to C_{ij},\] where \(b\) is the block containing cell \((i,j)\). The commutativity component \(\mathcal{D}_{\mathrm{DB}}\) says that every overlapping view gives the same cell: \[r_{ij}\rho_i \sim k_{ij}\kappa_j \sim b_{ij}\beta_b \qquad \text{for all }(i,j).\] The limiting component \(\mathcal{L}_{\mathrm{DB}}\) records that a grid is assembled from compatible local cell assignments, for example as a product-like cone of cell predictions. The colimiting component \(\mathcal{K}_{\mathrm{DB}}\) records gluing: row, column, and block views are identified along their shared cells. Additional Sudoku validity maps can be included in \(S_{\mathrm{DB}}\), such as maps \(R_i,K_j,B_b\to \mathsf{Perm}_9\), whose sketch constraints require each row, column, and block to realize the digit set exactly once.
A neural Sudoku solver is then a candidate model \[D_\theta:\operatorname{Path}(S_{\mathrm{DB}})\to\mathcal{C}\] whose objects may be soft digit distributions, logits, constraint states, or learned local representations. The DB obstruction \[\operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}_{\mathrm{DB}}}(D_\theta)\big)\] measures failure of the predicted local views to glue into a globally consistent Sudoku solution. A scalar DB loss is obtained by measuring these overlap and constraint obstructions.
The tangent learning sketch for Differential DB applies the tangent structure to the same Sudoku factorization problem: \[\mathsf{T}D_\theta:\operatorname{Path}(S_{\mathrm{DB}})\to\mathcal{C}.\] Its INC term is \[\mathsf{INC}_{\mathrm{DB}}(D_\theta) = \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}_{\mathrm{DB}}}(\mathsf{T}D_\theta)\big).\] This asks whether infinitesimal changes in logits, givens, local cell beliefs, or constraint messages preserve row-column-block compatibility. In a crossword puzzle, the analogous sketch replaces Sudoku rows, columns, and blocks by across clues, down clues, and shared letter cells. The Berkeley Crossword Solver uses neural candidate generation followed by loopy belief propagation and local search to enforce such overlap constraints among potential answers [24]. In Lincs terms, DB measures failure of clue-wise word assignments to agree on overlaps, while Differential DB measures whether that agreement is stable under infinitesimal changes in clue embeddings or letter beliefs.
ALLORA trains low-rank neural adapters with Lie-algebraic commutator penalties so independently useful adapters compose more predictably [5]. Its base defect is adapter order-sensitivity; its reflective Lincs version studies quotient-projectable adapter-flow interactions, including both bracket obstructions and connection-dependent symmetric acceleration in the representation bundle.
The low-rank presentation \(\Delta=BA\) has a \(\mathrm{GL}(r)\) redundancy, \((B,A)\mapsto(BQ,Q^{-1}A)\). Consequently, an optimizer field in factor coordinates is not automatically a vector field on the quotient of effective updates. A valid tangent realization must either fix a balanced gauge or provide an equivariant horizontal lift through the presentation map \(\pi(B,A)=BA\). Once this descent datum is fixed, two task/commutator directional interactions may be retained separately. The Lie bracket records their antisymmetric difference; a declared connection also defines their symmetric acceleration. Which component is useful for predicting adapter composition is a sketch- and realization-specific question, not a categorical preference for antisymmetry.
LASKO models agentic skill optimization over controlled Lie algebroids, where edits to prompts, schemas, tools, validators, and workflow artifacts are treated as anchored sections whose brackets reveal order-sensitive repair interactions [6]. Its Lincs version studies vector-bundle bracket defects for latent knowledge and skill-update manifolds.
Diagrammatic Backpropagation can be expressed as the repair of factorization failures [4]. Let \(D_\theta:J\to\mathcal{C}\) be a learned diagram depending on parameters \(\theta\), obtained from the path category of a learning sketch \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\), and let \(q=q_{\mathcal{D}}:J\to J/{\sim_{\mathcal{D}}}\) encode the intended commutativity constraints. DB attempts to adjust \(\theta\) so that \(D_\theta\) factors through \(q\), possibly together with the limit and colimit constraints specified by \(\mathcal{L}\) and \(\mathcal{K}\).
In enriched settings, this factorization problem is often scalarized by a loss: \[\mathcal{L}_{DB}(\theta)=\Phi(\operatorname{Fact}_q(D_\theta)),\] where \(\Phi\) is an application-specific measure of factorization failure, such as a norm, energy, likelihood, divergence, Bregman distance, or empirical risk. Such scalarizations are important computationally, but they are not primitive in the categorical definition.
DB therefore replaces pointwise error with compositional error. The learning signal is no longer only “prediction minus target”; it is a failure of a structured diagram to satisfy a universal compositionality condition.
Remark 3. Ordinary losses fit this pattern after scalarization. Supervised learning uses a diagram in which an input is mapped by a model and compared with a target map. Autoencoding compares an input with the reconstruction composite. Bellman residual minimization compares a value function with its Bellman transform. Contrastive learning compares two representation paths induced by augmentations. Sheaf learning compares restrictions along overlaps.
Diagrammatic Backpropagation can also be read as a localization principle. A global learning diagram is covered by smaller computational diagrams, and its global failure of compositionality is restricted to failures attached to those local pieces. This suggests a categorical generalization of the role played by the chain rule in ordinary backpropagation.
Let \(\{i_a:J_a\to J\}_{a\in A}\) be a family of subsketch inclusions whose images cover the objects, generating arrows, and specified constraints of a learning sketch \(\mathbb{S}\). Write \(\mathbb{S}_a\) for the induced local sketch and \(D_a=D i_a\) for the restriction of a model \(D:J\to\mathcal{C}\).
Definition 6 (Obstruction localization). An obstruction localization for the cover \(\{J_a\}_{a\in A}\) is a natural assignment \[\Lambda_D: \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}}(D)\big) \longrightarrow \mathsf{Comp}\!\left( \{\operatorname{Obs}(\operatorname{Fact}_{\mathbb{S}_a}(D_a))\}_{a\in A} \right),\] where \(\mathsf{Comp}\) denotes families of local obstruction data satisfying the required compatibility conditions on overlaps \(J_a\times_JJ_b\). The localization is complete* when a compatible family of inhabited local factorization problems glues to an inhabited global factorization problem.*
The compatibility term is essential. Vanishing of each isolated local defect need not imply global compositionality unless the chosen local repairs agree on their shared objects, paths, cones, and cocones. Thus obstruction localization is a descent statement for factorization problems, rather than an additive decomposition of a numerical error.
Proposition 1 (Tangent stability of obstruction localization). Suppose restriction along each \(i_a\) preserves admissible models and factorization problems, the obstruction assignment is natural under these restrictions, and tangent lift commutes with restriction: \[(\mathsf{T}D)i_a\cong\mathsf{T}(Di_a).\] Then every obstruction localization \(\Lambda_D\) has a tangent localization \[\Lambda_{\mathsf{T}D}: \mathsf{INC}(D) \longrightarrow \mathsf{Comp}\!\left( \{\mathsf{INC}(D_a)\}_{a\in A} \right).\] If the base localization is complete and tangent lift preserves the overlap descent data, the tangent localization is complete as well.
Proof. Restricting the tangent model to \(J_a\) gives \((\mathsf{T}D)i_a\cong\mathsf{T}D_a\). Naturality of the factorization and obstruction assignments therefore sends the global tangent obstruction \(\operatorname{Obs}(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D))\) to the compatible family \(\{\operatorname{Obs}(\operatorname{Fact}_{\mathbb{S}_a}(\mathsf{T}D_a))\}_{a\in A}\), which is precisely the displayed family of local INC objects. Preservation of overlap descent transports the local-to-global gluing property to the tangent level. ◻
For a feedforward network, the indexing category is a chain of layer maps and the terminal supervised error is a scalarization of a global factorization obstruction. Reverse-mode differentiation applies the chain rule to transport the sensitivity of that scalarization through the chain, producing a local parameter-update signal at each layer. In this sense, ordinary backpropagation is the scalarized, additive instance of obstruction localization. Lincs retains the same global-to-local architecture before scalarization: it localizes base obstructions, tangent obstructions, and, when defined, interaction-profile or higher-order obstructions. This opens the possibility of “backpropagating” structured obstruction objects even when subtraction, norms, or scalar losses are unavailable.
We now assume that \(\mathcal{C}\) carries tangent structure. Tangent categories axiomatize the behavior of tangent bundles in a categorical setting [13]. A tangent category has an endofunctor \[\mathsf{T}:\mathcal{C}\to\mathcal{C}\] together with structure maps such as projection, zero, addition, vertical lift, and canonical flip, satisfying axioms abstracting the tangent bundle of a smooth manifold.
In this paper, tangent learning sketches are the bridge between these two levels: they specify ordinary learning constraints and require those constraints to remain meaningful after applying the tangent functor. Thus the tangent functor lifts not only objects and morphisms in \(\mathcal{C}\), but also the sketch-theoretic factorization problems that define compositional learning.
The tangent-category axioms also support a notion of vector field and, in the standard tangent-categorical setting, a Lie bracket of vector fields. This is important for Lincs because infinitesimal coherence is not exhausted by the existence of \(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\). A learning diagram may generate tangent directions that are individually admissible, while their bracket lies outside the proper admissible distribution represented by the current architecture or repair language. In that case the learned infinitesimal dynamics are not closed relative to that distribution. A connection, when additionally declared, exposes symmetric as well as antisymmetric second-order interaction.
Definition 7 (Tangent model). Let \(D:J\to\mathcal{C}\) be a model of a learning sketch \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\), with \(J=\operatorname{Path}(S)\). Its tangent model is \[\mathsf{T}D:J\to\mathcal{C},\] obtained by applying the tangent functor objectwise and morphismwise: \[(\mathsf{T}D)(j)=\mathsf{T}(Dj), \qquad (\mathsf{T}D)(u)=\mathsf{T}(Du).\]
Remark 4 (Weil-algebra indexing of tangent models). Leung’s classifier makes the iteration in this definition explicit [16]. For the dual-number object \(W=\mathbb{N}[x]/(x^2)\) and the classifying functor \(F:\mathbb{N}\text{-}\mathsf{Weil}_1\to\operatorname{End}(\mathcal{C})\), one has \(T=F(W)\). Strong monoidality identifies the \(n\)-fold iterate with \[T^n\cong F(nW),\] where \(nW\) is the \(n\)-fold coproduct of \(W\), whereas the fiber-product power \(T^{(n)}\) used in the tangent axioms is represented by \(F(W^n)\). Consequently \(\operatorname{INC}^{(n)}(D)\) may be read as the obstruction to the learning factorization problem after the Weil prolongation indexed by \(nW\). The distinction between \(nW\) and \(W^n\) separates iterated or mixed infinitesimal directions from the pullback powers required for additive tangent bundles.
The base factorization problem asks whether computations compose: \[\operatorname{Fact}_{\mathbb{S}}(D)\neq\varnothing.\] The tangent factorization problem asks whether infinitesimal perturbations compose: \[\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\neq\varnothing.\]
Remark 5 (Tangent structure and quotient sketches). The Cockett-Cruttwell axioms require the tangent functor to preserve the finite limits used in the tangent structure, together with compatibility of the projection, zero, addition, vertical lift, and canonical flip. The quotient \(q_{\mathcal{D}}:J\to J/{\sim_{\mathcal{D}}}\), however, is induced by the commutativity component of a sketch and may involve colimit-like data in the category of indexing shapes. The cone and cocone components \(\mathcal{L},\mathcal{K}\) add further universal constraints. Lincs therefore does not assume that \(\mathsf{T}\) literally preserves the quotient construction or all sketch data as colimits. Instead, it assumes that the factorization problem induced by the sketch* is stable under tangent lift: whenever \(D:J\to\mathcal{C}\) is admissible, \(\mathsf{T}D\) is again an admissible model of the same learning sketch, and \(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\) is the transported tangent factorization problem.*
Condition 1 (Tangent-stable factorization fibration). The factorization fibration \(p:\mathsf{Fact}(\mathcal{C})\to\mathsf{Learn}(\mathcal{C})\) is tangent-stable when there is a lift of the tangent functor to factorization problems, \[\begin{array}{ccc} \mathsf{Fact}(\mathcal{C}) & \xrightarrow{\mathsf{T}_{\mathsf{Fact}}} & \mathsf{Fact}(\mathcal{C})\\ \downarrow p && \downarrow p\\ \mathsf{Learn}(\mathcal{C}) & \xrightarrow{\mathsf{T}} & \mathsf{Learn}(\mathcal{C}), \end{array}\] so that the fiber over \(D\) is sent to the fiber over \(\mathsf{T}D\). This is the fibrational compatibility condition replacing any blanket assumption that \(\mathsf{T}\) preserves all quotient sketches as colimits.
Definition 8 (Scalarized Lincs objective). When scalarizations are available, a Lincs objective associated with a diagram \(D_\theta\) is \[\mathcal{L}_{LINCS}(\theta) = \mathcal{L}_{base}\big(\operatorname{Obs}(\operatorname{Fact}_q(D_\theta))\big) + \lambda\mathcal{L}_{tan}\big(\mathsf{INC}(D_\theta)\big),\] where \(\lambda=0\) is permitted. More generally, scalarized Lincs may include higher-order tangent, bracket, connection, curvature, or jet terms. These are candidate signals supplied by the categorical realization; their nonzero computational admission is an additional validation decision rather than an axiom of tangent compositionality.
Thus Lincs is not a new optimizer. It is a rule for lifting learning compositionality problems into tangent structure.
In this section, we propose an axiomatic structure for Lincs . First, we state the underlying theoretical object more formally.
Definition 9 (Tangent compositionality problem). Let \(D:J\to\mathcal{C}\) be a model of a learning sketch \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\), with commutativity quotient \(q=q_{\mathcal{D}}:J\to J/{\sim_{\mathcal{D}}}\). The tangent compositionality problem of \(D\) is \[\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D),\] or \(\operatorname{Fact}_q(\mathsf{T}D)\) when only the commutativity quotient is under discussion. It asks whether the tangent-lifted model \(\mathsf{T}D\) satisfies the same sketch-theoretic factorization problem as \(D\).
Definition 10 (Infinitesimal Non-Compositionality). The infinitesimal non-compositionality of \(D\) is the obstruction to inhabiting its tangent compositionality problem: \[\mathsf{INC}(D) := \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\big).\] When higher-order tangent structure is available, the \(n\)-th order INC is \[\mathsf{INC}^{(n)}(D) := \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}^n D)\big).\]
Thus INC has a factorization form. A learning diagram may additionally determine vector fields, tangent sections, a connection, or other prolonged operations. These data refine tangent INC, but they do not replace its factorization definition.
Definition 11 (Interaction signature). An interaction signature \(\Omega_D\) for an admissible model \(D\) is a declared family of operations on an admissible tangent distribution \(\mathcal{A}_D\subseteq\operatorname{Vect}_D\). It may contain the Lie bracket, covariant directional derivatives for a specified connection, curvature or torsion, canonical-flip comparisons, or higher jet operations. The signature is part of the learning sketch or its realization; no single second-order operation is required for every sketch.
Definition 12 (Connection-aware second-order profile). Suppose the realization of \(D\) carries a connection \(\nabla\) and generates admissible fields \(X,Y\). Its ordered second-order profile is \[J^2_{\nabla,D}(X,Y) = \big(\nabla_XY,\nabla_YX\big).\] The associated antisymmetric and symmetric components are \[A_\nabla(X,Y) =\frac{1}{2}\big(\nabla_XY-\nabla_YX\big), \qquad S_\nabla(X,Y) =\frac{1}{2}\big(\nabla_XY+\nabla_YX\big).\] For a torsion-free connection, \(2A_\nabla(X,Y)=[X,Y]\). In contrast, \(S_\nabla\) depends on the declared connection and is not primitive tangent category structure.
Definition 13 (Bracket-closure INC). Let \(\operatorname{Vect}_D\) denote the class of tangent directions, vector fields, or tangent sections generated by an admissible learning model \(D\), and let \(\mathcal{A}_D\subseteq\operatorname{Vect}_D\) be the directions declared admissible for the current architecture or repair language. The bracket-closure INC of \(D\) is the closure problem \[\operatorname{Cl}_{[,]}(\mathcal{A}_D): \qquad \{\, [X,Y]\mid X,Y\in\mathcal{A}_D\,\} \subseteq \mathcal{A}_D.\] The model is bracket-closed relative to \(\mathcal{A}_D\) when this inclusion holds. Failure of the inclusion is a second-order infinitesimal non-compositionality. Taking \(\mathcal{A}_D\) to be the entire tangent bundle would make this test vacuous for genuine smooth vector fields, whose bracket is automatically tangent; structural nonclosure is meaningful relative to a proper admissible distribution such as a fixed adapter placement, shared factor subspace, or repair vocabulary.
This definition avoids subtracting morphisms in the base category. The primitive obstruction is not a residual \(g\circ f-f\circ g\). It is the failure of tangent directions generated by non-compositional learning data to be involutive under the Lie bracket supplied by the tangent structure. Bracket nonclosure is one interaction obstruction. A connection-aware realization may instead or additionally observe \(S_\nabla\), \(A_\nabla\), or the full ordered profile \(J^2_\nabla\) without asserting that antisymmetry is the unique carrier of useful tangent information.
If \(\operatorname{Fact}_q(D)\) is scalarized by a loss, then \(\operatorname{Obs}(\operatorname{Fact}_q(\mathsf{T}D))\) may induce a gradient-like or Jacobian-like regularizer. But Lincs is not merely gradient regularization. The object being lifted is not necessarily a scalar objective; it is the universal compositionality problem whose obstruction produced the loss.
Remark 6. Backpropagation differentiates a scalar loss. Lincs lifts the categorical factorization problem whose scalarization produced the loss. This distinction matters because the tangent lift can preserve structure that scalarization discards.
We now propose an axiomatization of Lincs categories.
Definition 14 (Lincs object). A Lincs object is a pair \[(X,\mathcal{S}_X),\] where \(X\in\operatorname{Ob}(\mathcal{C})\) and \(\mathcal{S}_X\) is a specified class of learning sketches whose models land in, are indexed by, or are interpreted around \(X\). Informally, \(X\) is a state, representation, policy, local model, or world-model object together with the compositionality problems it is expected to satisfy.
Definition 15 (Lincs morphism). A Lincs morphism \[f:(X,\mathcal{S}_X)\to(Y,\mathcal{S}_Y)\] is a morphism \(f:X\to Y\) in \(\mathcal{C}\) together with a transport of learning sketches and their models from \(\mathcal{S}_X\) to \(\mathcal{S}_Y\), such that tangent lift commutes with this transport. Concretely, if \(D:J\to\mathcal{C}\) is a transported model, then transporting \(\mathsf{T}D\) agrees with tangent-lifting the transported model.
Definition 16 (INC category). An INC category is a tangent category \((\mathcal{C},\mathsf{T})\) equipped with:
a class \(\mathsf{Sk}_{\mathcal{C}}\) of tangent learning sketches \(\mathbb{S}=(S,\mathcal{D},\mathcal{L},\mathcal{K})\);
for each \(\mathbb{S}\), with \(J=\operatorname{Path}(S)\), a class of admissible models \(D:J\to\mathcal{C}\);
for each sketch \(\mathbb{S}\), the associated base factorization problem \(\operatorname{Fact}_{\mathbb{S}}(D)\), including the quotient induced by \(\mathcal{D}\) and the cone/cocone constraints induced by \(\mathcal{L},\mathcal{K}\);
for each admissible model \(D\), the tangent model \(\mathsf{T}D:J\to\mathcal{C}\) and tangent factorization problem \(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\);
when higher interaction data are assigned to learning models, an interaction signature \(\Omega_D\), an admissible distribution \(\mathcal{A}_D\), and the corresponding closure or profile problem; bracket closure \(\operatorname{Cl}_{[,]}(\mathcal{A}_D)\) is the intrinsic antisymmetric specialization.
Axiom 1 (Base compositionality). For every admissible model \(D:J\to\mathcal{C}\) of a learning sketch \(\mathbb{S}\), \(D\) is compositional if and only if \(\operatorname{Fact}_{\mathbb{S}}(D)\) is inhabited.
Axiom 2 (Tangent admissibility). If \(D:J\to\mathcal{C}\) is an admissible model of a tangent learning sketch \(\mathbb{S}\), then \(\mathsf{T}D:J\to\mathcal{C}\) is also an admissible model of \(\mathbb{S}\), and the assignment \(D\mapsto \mathsf{T}D\) agrees with the tangent action specified by the sketch.
Axiom 3 (Presentation descent). Suppose a computational realization is expressed in a parameter presentation \(\pi:P\to M\) with redundant representatives. An optimizer or repair field \(V_P:P\to TP\) is admissible as a field on the model object \(M\) only when it is \(\pi\)-projectable: there is a field \(V_M:M\to TM\) such that \[T\pi\circ V_P=V_M\circ\pi.\] Alternatively, the realization must declare a gauge fixing or an equivariant horizontal lift \(h\) satisfying \(T\pi\circ h(V_M)=V_M\). Tangent obstruction signals that fail this descent condition are presentation artifacts and are not INC data on \(M\).
Axiom 4 (Tangent compositionality). For every admissible model \(D:J\to\mathcal{C}\) of a learning sketch \(\mathbb{S}\), infinitesimal compositionality is the factorization property \[\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D)\neq\varnothing.\] Thus tangent compositionality is defined by the same universal property as base compositionality, but applied after the tangent functor. INC is the obstruction \(\operatorname{Obs}(\operatorname{Fact}_{\mathbb{S}}(\mathsf{T}D))\) to this property.
Axiom 5 (Sketch-specific interaction). For every admissible model \(D\) equipped with an interaction signature \(\Omega_D\) and admissible tangent distribution \(\mathcal{A}_D\), each operation declared by \(\Omega_D\) determines a closure, factorization, or profile problem. Failure of a declared closure or factorization property is an admissible INC signal. When \([,]\in\Omega_D\), this includes the relative bracket-closure problem \[\operatorname{Cl}_{[,]}(\mathcal{A}_D): \qquad [X,Y]\in\mathcal{A}_D \quad \text{for all }X,Y\in\mathcal{A}_D.\] When a connection belongs to the realization, \(J^2_\nabla\), \(S_\nabla\), and \(A_\nabla\) are admissible profile data. The sketch does not categorically mandate that the antisymmetric projection be primary.
Axiom 6 (Conditional non-compositionality transport). For a model and sketch carrying an interaction signature, a declared transport is a natural assignment \[\mathfrak t_{D,\mathbb{S}}: \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}}(D)\big) \rightsquigarrow \operatorname{Obs}_{\Omega,\mathbb{S}}(\mathsf{T}D).\] The dashed arrow emphasizes that transport is additional sketch-relative data, not an equality between base failure and bracket closure. An admissible transport must be natural under model transformations, descend through any parameter presentation, and preserve the semantics of the factorization problem being repaired. Bracket transport is recovered when \(\Omega_D=\{[,]\}\); its existence alone does not imply that its scalarization is informative for a particular repair target.
Axiom 7 (Functoriality of repair). If a transformation of models \(\alpha:D\to D'\) is an admissible repair, then \(\mathsf{T}\alpha:\mathsf{T}D\to\mathsf{T}D'\) is an admissible infinitesimal repair. Moreover, repair preserves factorization: if \(D'\) factors through \(q\), then repaired models factor through \(q\) whenever the repair is declared compositionality-preserving. For a cover by local subsketches, a repair declared descent-compatible must also commute with restriction up to the specified coherence, \[\operatorname{res}_U\circ R_G \;\cong\; R_U\circ\operatorname{res}_U,\] and satisfy the corresponding cocycle conditions on overlaps. Functorial repair, descent-compatible repair, and empirically useful repair are distinct notions.
Axiom 8 (Optional scalarization). An INC category may be equipped with scalarization maps \[\Phi_q:\{\text{obstructions to factorization problems over }q\}\to\mathbb{R}_{\ge 0},\] but such maps are additional computational structure, not part of the bare categorical definition. When present, \(\Phi_q\) should vanish on inhabited factorization problems: \[\operatorname{Fact}_q(D)\neq\varnothing \quad\Rightarrow\quad \Phi_q\big(\operatorname{Obs}(\operatorname{Fact}_q(D))\big)=0.\]
Condition 2 (Observation specificity and identifiability). A computational realization may retain a profile-valued observation \(\Psi_{\mathbb{S}}(D,e)\) before scalarization, containing local, overlap, counterfactual, or downstream effects of a candidate repair \(e\). Structural identification from this profile requires the separate condition \[\Psi_{\mathbb{S}}(D,e)=\Psi_{\mathbb{S}}(D,e') \quad\Longrightarrow\quad e\simeq e'.\] When this implication fails, the sketch identifies only an equivalence class or moduli space of repairs. Defect reduction alone does not imply recovery of a privileged architecture.
Definition 17 (Validated scalarized realization). A validated scalarized Lincs realization consists of profile or obstruction scalarizations together with an admission rule, fitted without test leakage, that may assign zero weight to any auxiliary tangent signal. A typical base-first objective is \[\mathcal{L}_D^{\mathrm{val}} = \Phi_q\big(\operatorname{Obs}(\operatorname{Fact}_q(D))\big) + \sum_{k\in\Omega_D}g_k(\mathcal{V})\lambda_k\Phi_k(\mathsf{INC}_k(D)),\] where \(\mathcal{V}\) is validation data, \(g_k(\mathcal{V})\in\{0,1\}\) or \(\mathbb{R}_{\geq0}\), and sparse solutions with \(g_k=0\) are admissible. For a connection-aware two-field realization the learned coefficients may be written \((\mu_s,\mu_a)\) for symmetric and antisymmetric profiles. If these profiles are inserted directly into a vector update rather than a scalar loss, signed regularized coefficients and the appropriate step-size scaling are allowed.
Condition 3 (Stochastic consistency). Suppose an interaction profile is estimated from minibatches by \(\widehat\Psi_K\). A stochastic Lincs realization is consistent when its aggregated estimator converges to the profile of the expected admissible field, \[\widehat\Psi_K \longrightarrow \Psi_{\mathbb{E}}\] in the declared probabilistic or metric sense. A finite-sample certificate may take the form \[\mathbb{E}\left\lVert \widehat\Psi_K-\Psi_{\mathbb{E}} \right\rVert^2 \leq \frac{C}{K}+b_K^2, \qquad b_K\to0.\] Same-minibatch and independently crossed directional terms may have different variance because their covariance differs, even when they converge to the same expected-field profile. This estimator convergence is distinct from the contractivity of the coalgebraic INC endofunctor.
Definition 18 (Lincs category). A Lincs category is an INC category together with a rule that, for every admissible model \(D:J\to\mathcal{C}\), regards the pair \[\big(\operatorname{Fact}_q(D),\operatorname{Fact}_q(\mathsf{T}D)\big)\] as the basic learning datum. When an interaction signature is present, the datum is refined to \[\big(\operatorname{Fact}_q(D),\operatorname{Fact}_q(\mathsf{T}D),\operatorname{Obs}_{\Omega,D}(\mathsf{T}D)\big),\] with \(\operatorname{Cl}_{[,]}(\mathcal{A}_D)\) one possible component. If optional scalarizations are present, this datum may be converted into an objective \[\mathcal{L}_D = \Phi_q\big(\operatorname{Obs}(\operatorname{Fact}_q(D))\big) + \lambda\Phi_q^T\big(\mathsf{INC}(D)\big) + \sum_{k\in\Omega_D}\mu_k\Phi_q^k\big(\mathsf{INC}_k(D)\big).\] The bare category supplies candidate interaction data; a validated scalarized realization determines which coefficients \(\mu_k\) are nonzero.
Proposition 2 (Functoriality of INC data). Let \(F:\mathcal{C}\to\mathcal{D}\) be a tangent functor between tangent categories, so that \(F\mathsf{T}_{\mathcal{C}}\cong \mathsf{T}_{\mathcal{D}}F\). Suppose \(F\) preserves learning sketches, admissible models, and quotient factorization problems. Then \(F\) maps INC data in \(\mathcal{C}\) to INC data in \(\mathcal{D}\): \[F\big(\operatorname{Obs}(\operatorname{Fact}_q(\mathsf{T}_{\mathcal{C}}D))\big) \longmapsto \operatorname{Obs}\big(\operatorname{Fact}_{Fq}(\mathsf{T}_{\mathcal{D}}(FD))\big).\] In particular, tangent functors preserving the learning structure preserve tangent compositionality problems and their obstructions. If interaction signatures, connections, admissible distributions, or presentation quotients are included, preservation of those additional data is a separate hypothesis; it does not follow from tangent functoriality alone.
Proof. Since \(F\) preserves the learning sketch and quotient, the base factorization problem \(\operatorname{Fact}_q(D)\) is sent to the corresponding factorization problem \(\operatorname{Fact}_{Fq}(FD)\). Since \(F\) is tangent, \(F(\mathsf{T}_{\mathcal{C}}D)\cong \mathsf{T}_{\mathcal{D}}(FD)\). Therefore the image of the tangent factorization problem \(\operatorname{Fact}_q(\mathsf{T}_{\mathcal{C}}D)\) is the tangent factorization problem \(\operatorname{Fact}_{Fq}(\mathsf{T}_{\mathcal{D}}(FD))\). Applying the obstruction assignment gives the claimed map on INC data. ◻
The universal property question is: what is the minimal tangent learning structure generated by a category of base learning diagrams?
Definition 19 (Lincs completion, informal). Let \(\mathcal{C}\) be a category equipped with learning sketches and admissible models. A Lincs completion of \(\mathcal{C}\) is a tangent category \(\mathsf{LINCS}(\mathcal{C})\) together with an embedding \[i:\mathcal{C}\to\mathsf{LINCS}(\mathcal{C})\] such that base factorization problems in \(\mathcal{C}\) acquire tangent factorization problems in \(\mathsf{LINCS}(\mathcal{C})\), and any sketch/model-preserving functor from \(\mathcal{C}\) into a Lincs category factors through \(i\).
Conjecture 1 (Free Lincs completion). For a suitable class of sketch-equipped categories \(\mathcal{C}\), there exists a free Lincs category \(\mathsf{LINCS}(\mathcal{C})\) satisfying the universal property: \[\operatorname{Hom}_{\mathsf{LINCSCat}}(\mathsf{LINCS}(\mathcal{C}),\mathcal{D}) \cong \operatorname{Hom}_{\mathsf{SkCat}}(\mathcal{C},U\mathcal{D}),\] where \(U\) forgets tangent factorization structure.
This conjecture is the Lincs analogue of free tangent or differential completions. It says that Lincs is not merely an added regularizer; it is a universal completion that freely adds infinitesimal factorization structure to a base learning category. For interaction-enriched Lincs, the universal property is relative to the declared signature \(\Omega\): a bracket-closed completion, a connection-equipped jet completion, and a higher-operation completion are distinct specializations rather than one mandatory Lie-algebraic completion.
There is a second universal perspective on Lincs , related to the standard coalgebraic treatment of state-based systems and final semantics [25]. A tangent category contains an endofunctor \[\mathsf{T}:\mathcal{C}\to\mathcal{C}.\] An endofunctor does not by itself make every object into a coalgebra, but it determines a category of coalgebras once one chooses structure maps \[\gamma:X\to\mathsf{T}X.\] In a tangent category, vector fields are the basic examples: a vector field on \(X\) is a section \(v:X\to\mathsf{T}X\) of the tangent projection \(p_X:\mathsf{T}X\to X\). Thus vector fields can be read as \(T\)-coalgebras compatible with tangent structure.
This gives a coalgebraic reading of INC. A learning model \(D:J\to\mathcal{C}\) has a tangent tower \[D,\quad \mathsf{T}D,\quad \mathsf{T}^2D,\quad \ldots\] and a corresponding tower of factorization problems \[\operatorname{Fact}_q(D),\quad \operatorname{Fact}_q(\mathsf{T}D),\quad \operatorname{Fact}_q(\mathsf{T}^2D),\quad \ldots .\] The sequence resembles a system repeatedly unfolding its own infinitesimal behavior. Each stage asks whether the previous compositionality problem remains coherent after one more application of the tangent functor.
Definition 20 (INC endofunctor). The INC endofunctor is the operation \[\mathsf{T}_{\mathsf{INC}}:\mathsf{INC}(\mathcal{C})\to\mathsf{INC}(\mathcal{C})\] defined on admissible tangent factorization problems by \[\mathsf{T}_{\mathsf{INC}}\big(\operatorname{Fact}_q(\mathsf{T}^nD)\big) = \operatorname{Fact}_q(\mathsf{T}^{n+1}D),\] whenever these iterated tangent models are admissible.
Equivalently, after applying the obstruction assignment, \[\mathsf{T}_{\mathsf{INC}}\big(\operatorname{Obs}(\operatorname{Fact}_q(\mathsf{T}^nD))\big) = \operatorname{Obs}(\operatorname{Fact}_q(\mathsf{T}^{n+1}D)).\]
Definition 21 (Lincs coalgebra). A Lincs coalgebra is an INC object \(A\in\mathsf{INC}(\mathcal{C})\) equipped with a structure map \[\gamma:A\to \mathsf{T}_{\mathsf{INC}}A\] that transports base INC data to its next tangent lift. In concrete learning models, \(\gamma\) may be induced by a vector field, update rule, policy perturbation, local flow, or infinitesimal repair map.
Definition 22 (Coalgebraic Lincs fixed point). A coalgebraic Lincs fixed point is a Lincs coalgebra \((A,\gamma)\) for which the comparison \[A\longrightarrow \mathsf{T}_{\mathsf{INC}}A\] is stable in the chosen categorical sense: isomorphism, equivalence, bisimulation, or convergence under an application-specific scalarization. At such a point, applying the tangent lift produces no essentially new INC data.
For practical learning systems, the most useful notion of stability is likely not literal isomorphism, but enriched convergence: the INC tower stabilizes when the obstruction objects at successive levels are related by an approximate bisimulation and a scalar Lyapunov functional decreases to a fixed tolerance. For a neural network, reaching \(\nu\mathsf{T}_{\mathsf{INC}}\) means that further tangent unfolding does not reveal new out-of-distribution directions, declared interaction defects, or higher-order factorization obstructions not already represented by the learned tangent model.
This formulation says that Lincs can be studied as the stable behavior of iterated infinitesimal non-compositionality. The base category supplies learning diagrams; the tangent functor unfolds their infinitesimal defects; the sketch-specific interaction signature tests whether generated directions remain coherent and internally expressible; and the coalgebraic fixed point is the limit at which these unfoldings become self-consistent.
Definition 23 (Set-based class realization). A set-based class realization of the INC endofunctor consists of a fully faithful semantics \[U:\mathsf{INC}(\mathcal{C})\longrightarrow\mathbf{Class}\] and a set-based endofunctor \(F:\mathbf{Class}\to\mathbf{Class}\) together with a natural isomorphism \[U\mathsf{T}_{\mathsf{INC}}\cong FU.\] Here set-based means that, for every class \(A\) and every \(x\in F(A)\), there are a set \(A_0\subseteq A\) and \(x_0\in F(A_0)\) such that \[x=F(i_{A_0,A})(x_0),\] where \(i_{A_0,A}:A_0\hookrightarrow A\) is inclusion. We say that the realization creates the final carrier* when the carrier and structure map of the final \(F\)-coalgebra lie in the essential image of \(U\), and coalgebra morphisms between realized objects are reflected by \(U\).*
Theorem 1 (Existence of a final INC coalgebra). Let \(\mathsf{T}_{\mathsf{INC}}\) admit a set-based class realization. Then the realizing endofunctor \(F\) has a final coalgebra in \(\mathbf{Class}\). If the realization creates the final carrier, then \(\mathsf{T}_{\mathsf{INC}}\) has a final coalgebra in \(\mathsf{INC}(\mathcal{C})\).
Proof. The first statement is the Final Coalgebra Theorem of Aczel and Mendler: every set-based endofunctor on the category of classes has a final coalgebra [26]. Let \((Z,\zeta:Z\to FZ)\) be this final coalgebra. When the realization creates the final carrier, choose \(A\in\mathsf{INC}(\mathcal{C})\) with \(UA\cong Z\). The natural isomorphism \(U\mathsf{T}_{\mathsf{INC}}\cong FU\) transports \(\zeta\) to a \(\mathsf{T}_{\mathsf{INC}}\)-coalgebra structure on \(A\). For any other realized coalgebra, finality of \((Z,\zeta)\) gives a unique coalgebra morphism into \(Z\); fullness and reflection lift it uniquely to \(A\). Hence \(A\) is final in \(\mathsf{INC}(\mathcal{C})\). ◻
Definition 24 (Accessible set realization). An accessible set realization of \(\mathsf{T}_{\mathsf{INC}}\) consists of a fully faithful functor \[V:\mathsf{INC}(\mathcal{C})\longrightarrow\mathbf{Set},\] an accessible endofunctor \(G:\mathbf{Set}\to\mathbf{Set}\), and a natural isomorphism \(V\mathsf{T}_{\mathsf{INC}}\cong GV\). As above, the realization creates the final carrier* when the final \(G\)-coalgebra lies in the essential image of \(V\) and coalgebra morphisms between realized objects are reflected by \(V\).*
Theorem 2 (Set-sized final INC coalgebra). If \(\mathsf{T}_{\mathsf{INC}}\) admits an accessible set realization, then its realizing endofunctor \(G\) has a final coalgebra in \(\mathbf{Set}\). If the realization creates the final carrier, this coalgebra lifts to a final \(\mathsf{T}_{\mathsf{INC}}\)-coalgebra in \(\mathsf{INC}(\mathcal{C})\).
More quantitatively, let \(\kappa>\aleph_0\) be regular and suppose that \(2^\lambda\leq\kappa\) for every \(\lambda<\kappa\). If \(G\) is \(\kappa\)-accessible and \[|A|<\kappa\quad\Longrightarrow\quad |G A|\leq\kappa,\] then the final \(G\)-coalgebra has cardinality at most \(\kappa\).
Proof. Barr proves that the forgetful functor from coalgebras of any accessible endofunctor on \(\mathbf{Set}\) has a right adjoint, and therefore that its coalgebra category has a terminal object [27]. His regular-cardinal refinement gives the stated bound of \(\kappa\) on the terminal carrier under the displayed hypotheses. The lifting from \(\mathbf{Set}\) to \(\mathsf{INC}(\mathcal{C})\) is the same fully faithful transfer used in the preceding theorem. ◻
Conjecture 2 (Lincs –final-coalgebra comparison). Under the hypotheses of either preceding existence theorem, the universal Lincs completion is equivalent to the resulting final INC coalgebra: \[\mathsf{LINCS}(\mathcal{C}) \simeq \nu \mathsf{T}_{\mathsf{INC}},\] with the equivalence compatible with the embedding of base learning models and their iterated tangent factorization problems.
The Aczel–Mendler theorem discharges existence once the INC endofunctor has a set-based class realization. Barr’s theorem avoids proper classes whenever \(\mathsf{T}_{\mathsf{INC}}\) instead has an accessible realization on sets, and its regular-cardinal form bounds the size of the final carrier. What remains conjectural is the comparison: that the final coalgebra so obtained also satisfies the free-completion universal property proposed for \(\mathsf{LINCS}(\mathcal{C})\). Independently, convergence of the concrete INC tower can be proved under explicit contractivity hypotheses by metric coinduction, which establishes properties of a limit from invariance under a contractive approximation step [28].
Definition 25 (Metric realization of INC). A metric realization of an INC fiber is a complete metric space \((M_D,d_D)\) of obstruction states associated with an admissible model \(D\), together with a map \[F_D:M_D\to M_D\] realizing the action of \(\mathsf{T}_{\mathsf{INC}}\). It is \(\rho\)-contractive when there is a constant \(0\leq \rho<1\) such that \[d_D(F_Dx,F_Dy)\leq \rho d_D(x,y) \qquad\text{for all }x,y\in M_D.\] The realization is bisimulation-conservative* when distance zero identifies precisely the INC states that are bisimilar in the obstruction fiber.*
Theorem 3 (Contractive coalgebraic stabilization). Let \((M_D,d_D,F_D)\) be a \(\rho\)-contractive metric realization of an INC fiber, and let \(x_0\in M_D\) represent the base obstruction \(\operatorname{Obs}(\operatorname{Fact}_q(D))\). Define the realized INC tower by \(x_{n+1}=F_Dx_n\). Then:
there is a unique fixed point \(x_\ast=F_Dx_\ast\);
the tower converges geometrically, with \[d_D(x_n,x_\ast) \leq \frac{\rho^n}{1-\rho}\,d_D(x_1,x_0);\]
if an approximate tower satisfies \(d_D(\widetilde{x}_{n+1},F_D\widetilde{x}_n)\leq\epsilon\) at every stage, then \[d_D(\widetilde{x}_n,x_\ast) \leq \rho^n d_D(\widetilde{x}_0,x_\ast) +\frac{1-\rho^n}{1-\rho}\,\epsilon,\] and hence \(\limsup_n d_D(\widetilde{x}_n,x_\ast)\leq\epsilon/(1-\rho)\).
If, in addition, the realization is bisimulation-conservative, then the exact tower stabilizes at a unique INC behavior up to bisimulation. If this behavior lifts to a final \(\mathsf{T}_{\mathsf{INC}}\)-coalgebra in the obstruction fibration and the universal Lincs embedding is dense and preserved by \(\mathsf{T}_{\mathsf{INC}}\), then it realizes the comparison \[\mathsf{LINCS}(\mathcal{C})\simeq\nu\mathsf{T}_{\mathsf{INC}}.\]
Proof. This is the contractive fixed-point construction underlying metric coinduction [28], specialized to the realized INC tower. For \(m>n\), contractivity gives \[d_D(x_{k+1},x_k) \leq \rho^k d_D(x_1,x_0).\] The triangle inequality therefore yields \[d_D(x_m,x_n) \leq \sum_{k=n}^{m-1}\rho^k d_D(x_1,x_0) \leq \frac{\rho^n}{1-\rho}d_D(x_1,x_0).\] Thus \((x_n)\) is Cauchy. Completeness supplies a limit \(x_\ast\), and the Lipschitz continuity of \(F_D\) gives \(F_Dx_\ast=\lim_nF_Dx_n=\lim_nx_{n+1}=x_\ast\). If \(y_\ast\) is another fixed point, then \[d_D(x_\ast,y_\ast) =d_D(F_Dx_\ast,F_Dy_\ast) \leq\rho d_D(x_\ast,y_\ast),\] so \(d_D(x_\ast,y_\ast)=0\), proving uniqueness. Letting \(m\to\infty\) in the Cauchy estimate proves the geometric bound.
For the approximate tower, \[\begin{align} d_D(\widetilde{x}_{n+1},x_\ast) &\leq d_D(\widetilde{x}_{n+1},F_D\widetilde{x}_n) +d_D(F_D\widetilde{x}_n,F_Dx_\ast)\\ &\leq \epsilon+\rho d_D(\widetilde{x}_n,x_\ast). \end{align}\] Induction solves this recurrence and gives the stated finite-\(n\) and asymptotic bounds. Bisimulation-conservativity turns uniqueness at distance zero into uniqueness up to bisimulation. Under the final lifting and density hypotheses, the lifted fixed behavior has the universal property of \(\nu\mathsf{T}_{\mathsf{INC}}\), while density and preservation extend the comparison from presentable learning models to their Lincs completion. This proves the final conditional statement. ◻
The scalar certificate used in applications fits this theorem when the obstruction energy \[E_n = \Phi\big(\operatorname{Obs}(\operatorname{Fact}_q(\mathsf{T}^nD))\big) + \sum_{k\in\Omega_D}\mu_{k,n}\Phi^k_n + \eta\Phi^{\mathrm h}_n\] is a Lyapunov upper bound for \(d_D(x_n,x_\ast)\). In finite-sample learning, an inequality \(E_{n+1}\leq\rho E_n+\epsilon\) then gives \[E_n\leq\rho^nE_0+\frac{1-\rho^n}{1-\rho}\epsilon,\] which is the scalar counterpart of approximate coalgebraic stabilization. The theorem therefore proves the convergent fixed-point part of the conjecture. Establishing finality without the lifting hypotheses, and proving that the resulting final coalgebra satisfies the free-completion universal property, remain open.
We now collect the preceding ideas into an explicit categorical picture.
Definition 26 (Learning diagram category). A learning diagram category is a category \(\mathsf{Learn}(\mathcal{C})\) whose objects are admissible models \(D:J\to\mathcal{C}\) of learning sketches, and whose morphisms are model transformations preserving the intended learning semantics.
Definition 27 (Factorization fibration). A factorization fibration over \(\mathsf{Learn}(\mathcal{C})\) is a functor \[p:\mathsf{Fact}(\mathcal{C})\to\mathsf{Learn}(\mathcal{C})\] whose fiber over \(D:J\to\mathcal{C}\) is the factorization problem \(\operatorname{Fact}_q(D)\) associated with its learning sketch.
Definition 28 (INC fibration). The INC fibration is the tangent-lifted factorization fibration \[p_T:\mathsf{INC}(\mathcal{C})\to\mathsf{Learn}(\mathsf{T}\mathcal{C}),\] whose fiber over \(\mathsf{T}D\) is the tangent factorization problem \(\operatorname{Fact}_q(\mathsf{T}D)\).
Definition 29 (Interaction-profile fibration). When admissible learning models carry signatures \(\Omega_D\), the interaction-profile fibration is a functor \[p_\Omega:\mathsf{IntINC}(\mathcal{C})\to\mathsf{Learn}(\mathsf{T}\mathcal{C}),\] whose fiber over \(\mathsf{T}D\) is the declared closure, factorization, or profile problem \(\operatorname{Obs}_{\Omega,D}(\mathsf{T}D)\). Connection-equipped fibers include the ordered profile \(J^2_\nabla\) and its symmetric and antisymmetric projections.
Definition 30 (Bracket-closure fibration). When \([,]\in\Omega_D\), the bracket-closure specialization is a functor \[p_{[,]}:\mathsf{BrINC}(\mathcal{C})\to\mathsf{Learn}(\mathsf{T}\mathcal{C}),\] whose fiber over \(\mathsf{T}D\) is the closure problem \(\operatorname{Cl}_{[,]}(\mathcal{A}_D)\).
Definition 31 (Conditional interaction transport). An interaction transport is a functor or, when transport is only partially defined, a fibered correspondence over learning diagrams \[B_\Omega:\mathsf{Fact}(\mathcal{C})\rightsquigarrow\mathsf{IntINC}(\mathcal{C})\] such that the fiber over a base model \(D\) relates the base factorization problem \(\operatorname{Fact}_q(D)\) to the declared interaction profile generated by its tangent lift. It is admissible only under the naturality, presentation descent, and sketch-fidelity requirements of conditional non-compositionality transport. Taking \(\Omega_D=\{[,]\}\) recovers a bracket-transport functor into \(\mathsf{BrINC}(\mathcal{C})\).
A Lincs category can then be seen as a category of learning diagrams equipped with both a factorization fibration and its tangent lift: \[\mathsf{Learn}(\mathcal{C}) \leftarrow \mathsf{Fact}(\mathcal{C}), \qquad \mathsf{Learn}(\mathsf{T}\mathcal{C}) \leftarrow \mathsf{INC}(\mathcal{C}).\] With interaction transport, the picture refines to \[\mathsf{Fact}(\mathcal{C}) \xrightarrow{\;B_\Omega\;} \mathsf{IntINC}(\mathcal{C}) \to \mathsf{Learn}(\mathsf{T}\mathcal{C}).\] Coalgebraically, the same category carries an unfolding operation \[\mathsf{T}_{\mathsf{INC}}:\mathsf{INC}(\mathcal{C})\to\mathsf{INC}(\mathcal{C}),\] so that Lincs learning can also be viewed as constructing coalgebras \[A\to\mathsf{T}_{\mathsf{INC}}A\] whose iterated tangent unfoldings stabilize. Learning is a section-selection or repair problem: choose morphisms, parameters, coalgebra maps, or extensions that make base and tangent factorization problems closer to being inhabited, make the induced directions coherent under the sketch-specific interaction signature, and make the INC tower closer to a fixed point. A computational realization may still assign zero admission weight to an available interaction signal.
The factorization definition of INC captures first-order infinitesimal coherence: does the tangent-lifted diagram satisfy the same universal factorization property as the base diagram? Second-order structure is richer than one distinguished projection. Lie brackets test order-sensitive noncommutativity and involutivity. A connection-equipped realization also retains the ordered derivatives \(\nabla_XY\) and \(\nabla_YX\), whose symmetric sum measures joint acceleration relative to that connection.
In a tangent category, vector fields and their Lie brackets can be defined from tangent structure. Thus, once a learning model \(D\) determines an admissible distribution \(\mathcal{A}_D\), Lincs can ask whether \(\mathcal{A}_D\) is closed under bracket. This is the tangent analogue of asking whether a distribution is involutive. Infinitesimal Causality models interventions as tangent directions and studies their closure and noncommutativity [29]; BRIDGE/SKFM uses Lie-bracket geometry to expose latent confounded causal structure [7]. These applications justify bracket closure as an important specialization, but not as the unique second-order observation for every learning sketch.
Definition 32 (Sketch-relative interaction transport). Let \(D:J\to\mathcal{C}\) be an admissible model with base factorization problem \(\operatorname{Fact}_{\mathbb{S}}(D)\) and interaction signature \(\Omega_D\). An interaction transport for \(D\) is a natural, presentation-descending assignment \[\mathfrak t_{D,\mathbb{S}}: \operatorname{Obs}\big(\operatorname{Fact}_{\mathbb{S}}(D)\big) \rightsquigarrow \operatorname{Obs}_{\Omega,\mathbb{S}}(\mathsf{T}D).\] It maps base non-compositionality to a candidate sketch-specific interaction profile. It does not assert that every component of that profile identifies the base repair or has positive predictive value after scalarization.
Definition 33 (Lie-bracket INC). The Lie-bracket INC of \(D\) relative to \(\mathcal{A}_D\) is the obstruction \[\mathsf{INC}_{[,]}(D) = \{\, [X,Y]\mid X,Y\in\mathcal{A}_D,\;[X,Y]\notin\mathcal{A}_D\,\}.\] The model is bracket-compositional relative to \(\mathcal{A}_D\) when \(\mathsf{INC}_{[,]}(D)\) is empty.
Definition 34 (Connection-profile INC). For a connection-equipped realization, connection-profile INC is the obstruction profile obtained from \[J^2_{\nabla,D}(X,Y) = \big(\nabla_XY,\nabla_YX\big),\] together with any sketch-declared factorization, closure, or observation maps. Its symmetric and antisymmetric projections may be scalarized separately. Neither a nonzero symmetric acceleration nor a nonzero bracket is by itself a defect: defect status is relative to the constraints and admissible repair distribution declared by the sketch.
The distinction matters computationally. The bracket is invariant under coordinate change for projectable fields, whereas the symmetric projection requires the declared connection. Conversely, order-sensitive torque need not be the mechanism that predicts future failure: accumulated joint acceleration may carry more information in a particular sketch. A validated realization therefore admits the two components separately, for example with sparse coefficients \((\mu_s,\mu_a)\), and permits either coefficient to vanish.
This gives a hierarchy: \[\begin{align} &\text{base factorization problems} \to \text{tangent factorization problems} \to \text{interaction profiles}\\ &\to \text{relative closure, curvature, and torsion} \to \text{higher jets}. \end{align}\] Higher-order Lincs studies this hierarchy as successive, signature-relative refinements of compositionality.
Strict INC measures failure of strict commutativity. In many learning systems, however, exact equality of diagrams is too rigid. A representation, policy, world model, or reasoning graph may be correct only up to a controlled deformation. This suggests a homotopical refinement of Lincs .
Strict repair asks for an exact factorization: \[\text{strict repair:}\qquad D=\bar Dq.\] Homotopy repair asks for a coherent deformation from the learned diagram to a factored diagram: \[\text{homotopy repair:}\qquad D\simeq \bar Dq.\] Thus DB minimizes strict diagram defects, Lincs minimizes tangent-lifted defects, and homotopical Lincs asks whether those tangent defects are null-homotopic, deformable, or obstructed.
Definition 35 (Homotopical INC). In a homotopical, model-categorical, or \(\infty\)-categorical enrichment of \(\mathcal{C}\), the homotopical infinitesimal non-compositionality of \(D\) is \[\mathsf{INC}_{\mathrm h}(D) = \operatorname{Obs}\big(\operatorname{Fact}_q(\mathsf{T}D)\;\text{up to homotopy}\big).\] It vanishes when the tangent compositionality problem is inhabited up to coherent homotopy.
Interaction profiles and homotopy describe complementary layers of path dependence. The bracket is the local, infinitesimal shadow of noncommuting flows; connection-dependent symmetric acceleration records joint local bending; homotopy is the global coherence class of finite deformations. This yields an obstruction-theoretic ladder: \[\text{defect} \to \text{tangent defect} \to \text{interaction or closure defect} \to \text{homotopy class or cohomological obstruction}.\]
| Layer | Object | Defect |
|---|---|---|
| Base | category | non-commuting diagram |
| Tangent | tangent category | infinitesimal non-composition |
| Interaction | fields with signature/connection | relative non-closure or jet defect |
| Homotopy | model category or \(\infty\)-category | deformation obstruction |
The results above isolate several concrete problems whose resolution would turn Lincs from a foundations framework into a mature categorical theory of learning.
The central open problem is the Lincs –final-coalgebra comparison. The Aczel–Mendler and Barr theorems establish existence of final INC coalgebras under class-based or accessible set-based realizations, while the contractive stabilization theorem controls a metric realization of the same unfolding. What remains is to construct the canonical comparison \[\mathsf{LINCS}(\mathcal{C})\longrightarrow\nu\mathsf{T}_{\mathsf{INC}}\] and give conditions under which it is fully faithful and essentially surjective. A promising route is to show that admissible learning sketches form an accessible category, that \(\mathsf{T}_{\mathsf{INC}}\) preserves the relevant filtered colimits, and that the presentable objects generate both sides. Such a result would connect the free-completion and final-semantics viewpoints rather than treating them as parallel descriptions.
The contractive theorem assumes a complete metric realization and a constant \(\rho<1\). An important next step is to derive these hypotheses from the learning sketch and tangent structure themselves. This requires identifying when scalarizations of factorization, interaction-profile, closure, and homotopy obstructions define a complete behavioral metric and when tangent lift is contractive or eventually contractive in that metric. Stochastic learning further calls for versions of metric coinduction with martingale noise, biased tangent estimators, and data-dependent contraction factors. These results would turn stabilization from an assumed analytic property into a verifiable certificate for a learning system.
First-order INC tests tangent factorization, whereas interaction profiles detect relations among generated infinitesimal directions. These should not be identified: tangent factorization is the primary first-order condition, while Lie-bracket nonclosure is a derived, antisymmetric second-order obstruction. With a declared connection, the full ordered pair \((\nabla_XY,\nabla_YX)\) and its symmetric acceleration must be retained before selecting a projection. A higher theory should construct prolonged learning sketches \(\mathbb{S}^{(n)}\) whose models are \(\mathsf{T}^nD\) equipped not only with the original factorization constraints, but also with the canonical flips, vertical lifts, and coherence maps of iterated tangent structure. The corresponding hierarchy would take the form \[\mathsf{INC}^{(n)}(D) = \operatorname{Obs}\!\left(\operatorname{Fact}_{\mathbb{S}^{(n)}}(\mathsf{T}^nD)\right), \qquad n\geq 0.\] At level \(\mathsf{T}^2\), the canonical flip and any declared connection should organize both symmetric and antisymmetric infinitesimal interactions, including acceleration, bracket, torsion, and curvature profiles. At level \(\mathsf{T}^3\), the relevant coherence conditions should include Jacobiator- and Bianchi-type obstructions; at still higher levels, jets and higher or \(L_\infty\)-style brackets may provide the appropriate language. In a homotopical or \(\infty\)-categorical setting, one should then determine when these local higher defects integrate to global deformation obstructions and when they vanish up to coherent homotopy. Such a prolongation theory would organize higher INC signals structurally, rather than as an unstructured collection of repeated derivative penalties.
The coalgebraic tower also suggests a “meta” form of DB in which the learning mechanism becomes part of the diagram being tested. Let \(\mathcal{B}\) denote a DB procedure that sends a global obstruction to a compatible family of local obstruction signals and then to parameter or architectural repairs. A reflective DB sketch would include \(\mathcal{B}\), its localization maps, and its repair maps as morphisms. Its commutativity conditions would ask, for example, whether localizing an obstruction and then repairing its local pieces agrees with repairing the global diagram and then restricting the result. Thus the relevant question is not anthropomorphic self-awareness, but a precise structural one: is the backpropagation mechanism itself compositional with respect to the learning problem it is intended to repair?
Ordinary DB detects non-compositionality in a target computation. First-order reflective Lincs-DB would detect instability in how DB transports and repairs that obstruction, while \(\mathsf{T}^2,\mathsf{T}^3,\ldots\) would test interactions among repair directions and expose defects that appear only after the learner changes itself. A nonzero meta-obstruction could then motivate an architectural operation—adding a computational path, module, state variable, skip connection, or compatibility constraint—rather than only a parameter update. This is analogous to BRIDGE/SKFM: those methods use bracket nonclosure to reveal latent causal directions, whereas reflective Lincs-DB may use a sketch-specific interaction profile to reveal latent structure in the learning architecture itself. Developing the corresponding meta-sketch, its admissible architectural edits, and a convergent coalgebraic repair procedure is a natural subject for a separate theoretical and experimental paper.
There is also a more speculative stabilization question. The tower \(D,\mathsf{T}D,\mathsf{T}^2D,\ldots\) is not by itself a spectrum, so repeated tangent lift does not automatically place Lincs in stable homotopy theory. Nevertheless, if a homotopical realization of prolonged sketches supplies compatible structure maps and a regime in which suspension and looping become inverse, then stabilized INC obstructions might define spectrum-valued invariants. This would replace the question of whether a defect vanishes at one finite tangent order by the stable question of which obstruction class persists under all further prolongations. Determining whether natural Lincs models, including Transformer equivariance sketches, admit such a stabilization is an open problem.
There is a complementary route from categorical Lincs to topology. For a fixed learning sketch and diagram \(D\), let \(\mathcal{R}_{\mathsf{INC}}(D)\) denote a category whose objects are admissible base and tangent repairs and whose morphisms are structure-preserving transformations between them. Its nerve \[N\mathcal{R}_{\mathsf{INC}}(D)_n = \operatorname{Fun}([n],\mathcal{R}_{\mathsf{INC}}(D))\] is a simplicial set: vertices are repairs, edges are transformations between repairs, and higher simplices encode coherent chains of transformations. The geometric realization \(|N\mathcal{R}_{\mathsf{INC}}(D)|\) therefore turns the repair category into a classifying space. This construction parallels the use of nerves and classifying spaces to study equivalence classes of categorical causal models in Universal Causality and its higher algebraic \(K\)-theoretic extension [30], [31].
MacAdam’s Weil nerve suggests an infinitesimal refinement of this construction that should be distinguished from the ordinary simplicial nerve above [17]. For an involution algebroid \(A\) in a tangent category \(\mathcal{C}\), the Weil nerve is a fully faithful embedding \[N_{\mathsf{Weil}}: \operatorname{Inv}(\mathcal{C})\longrightarrow[\mathsf{Weil}_1,\mathcal{C}]\] that records \(A\) as a transverse-limit-preserving tangent functor \(V\mapsto A(V)\); Segal-like exactness conditions characterize which such functors arise from involution algebroids. Accordingly, if the admissible infinitesimal repairs of \(D\) assemble into an involution algebroid \(A_{\mathsf{INC}}(D)\) in a category-valued tangent semantics, its Weil nerve should produce repair categories \[\mathcal{R}_{\mathsf{INC}}^{V}(D) :=N_{\mathsf{Weil}}(A_{\mathsf{INC}}(D))(V), \qquad V\in\mathsf{Weil}_1.\] Taking the ordinary nerve and geometric realization objectwise then gives a Weil-indexed family of spaces \[V\longmapsto\left|N\mathcal{R}_{\mathsf{INC}}^{V}(D)\right|.\] The monoidal unit records the base repair topology, the dual-number generator records first-order repair directions, and its Weil composites organize higher and mixed prolongations. Thus tangent information is retained before passing to homotopy type, rather than being forgotten by a single classifying space construction.
Chapter 5 of MacAdam’s thesis supplies a complementary integration step. In the category \(\mathcal{W}\) of Weil spaces, an infinitesimal groupoid \(\partial:\mathsf{Weil}_1^{\mathrm{op}}\to\operatorname{Gpd}(\mathcal{W})\) induces an infinitesimal nerve \(N_{\partial}\) with a left adjoint Lie realization \(|-|_{\partial}\), constructed by left Kan extension. The resulting tangent adjunction \[|-|_{\partial}: \operatorname{Inv}(\mathcal{W}) \; \rightleftarrows \; \operatorname{Gpd}(\mathcal{W}) :N_{\partial}\] preserves products and base spaces [17]. For topological Lincs, the realization \(|A_{\mathsf{INC}}(D)|_{\partial}\) is therefore a natural candidate for a groupoid of finite repairs integrating the infinitesimal repair algebroid. The adjunction unit \(A_{\mathsf{INC}}(D)\to N_{\partial}|A_{\mathsf{INC}}(D)|_{\partial}\) tests whether the infinitesimal repair semantics is recovered after integration. Future work should construct a comparison between the classifying space of this realized groupoid and \(|N\mathcal{R}_{\mathsf{INC}}(D)|\). Failure of the unit, or of that comparison, to be an equivalence would then define an integration obstruction: a local infinitesimal repair calculus that does not assemble into the proposed global topology of finite repairs.
Such a topological Lincs would distinguish more than the existence or scalar cost of a repair. Connected components could classify inequivalent repair regimes, loops could record nontrivial cycles of transformations, and higher homotopy or homology groups could detect coherent higher obstructions. Applying this construction to every prolonged category \(\mathcal{R}_{\mathsf{INC}}^{(n)}(D)\) would produce a tower of spaces associated with \(D,\mathsf{T}D,\mathsf{T}^2D,\ldots\). A central question is whether the tangent lift induces natural maps between these nerves and, under additional delooping or group-completion hypotheses, whether their stabilized homotopy type supplies the spectrum-valued INC invariants envisioned above.
The examples in this paper suggest that Bellman consistency, Kan extension, diagrammatic backpropagation, sheaf gluing, and causal intervention can all be viewed as instances of the same tangent factorization pattern. A stronger result would specify functors between these model categories and prove that they preserve INC, declared interaction transport, and coalgebraic stabilization. Such transfer theorems would clarify which guarantees are genuinely domain independent and which depend on additive, probabilistic, or smooth enrichment.
A practical implementation should compile a learning sketch into its base and tangent factorization problems, verify presentation descent, generate profile-valued observations before scalarization, and expose certificates for declared interaction closure and successive INC stabilization. Empirical work can then test a precise claim: tangent coherence should improve robustness to perturbations that are invisible to the base compositionality loss. Appropriate evaluations should therefore report base error, tangent error, gauge or presentation invariance, one-sided and symmetric/antisymmetric controls, stability under stochastic aggregation, held-out admission, and out-of-distribution consistency, rather than treating INC as an undifferentiated regularizer. The problem classes summarized in Section 4 provide initial domains for such tests, but the longer-term objective is a reusable categorical scientific-computing interface in which sketches, tangent lifts, and obstruction objects are first-class program structures.
Lincs begins with a simple observation: every learning compositionality problem has a tangent lift. But the consequences are broad. If losses are scalarizations of obstructions to factorization, then tangent losses are scalarizations of obstructions to tangent factorization. They reveal how errors move, interact, commute, fail to close, deform, and unfold under repeated tangent lift. Parameterized realizations must first descend through their presentation redundancies, and connection-dependent interaction profiles must declare the geometry that defines them.
Diagrammatic Backpropagation introduced diagrammatic non-compositionalities as learning signals. Lincs introduces infinitesimal non-compositionalities as candidate learning signals. Its coalgebraic form suggests a further refinement: learning is the search for stable tangent unfoldings of non-compositionality. The categorical framework supplies base, tangent, and sketch-specific interaction data; a validated computational realization decides contingently which auxiliary signals to admit. The resulting framework suggests a tangent-categorical reformulation of machine learning: learn not only the function, policy, representation, or world model, but the presentation-invariant infinitesimal geometry and coalgebraic self-consistency of the factorization problems by which it is learned.