Abstract

Coordinating payload transfers between subsystems is a critical challenge in lifelong Multi-Agent Pickup and Delivery (MAPD). We study systems where agents are confined to separate regions and must exchange payloads through shared handover stations. These stations, equipped with single docks and finite buffers, are inherently vulnerable to blocking and starvation. We formalize this problem as Multi-Subsystem MAPD with Buffer-limited Handover Stations (MS-MAPD-BHS). We then propose Handover-Aware Reservation and Routing (HARR), an online controller that couples per-subsystem planners. HARR uses a shared dock reservation calendar and a deterministic rolling-horizon projection of buffer occupancy to coordinate actions. A candidate route is accepted only if its dock interval is free and the resulting buffer occupancy projection remains within capacity. Under perfect execution, these checks ensure collision-free dock use and buffer-safe committed operations within the reservation horizon. In simulation, HARR achieves up to 77% higher throughput and 92% lower backlog than a fixed-dock ablation at moderate load, while also reducing planning time relative to a coupled station-aware Token Passing baseline. These results show that explicit interface coordination substantially improves stability in modular multi-subsystem transport.

1 Introduction↩︎

Multi-Agent Pathfinding (MAPF) and especially its lifelong variants, such as Multi-Agent Pickup and Delivery (MAPD), provide foundational tools for coordinated transport in warehouses, factories, and traffic systems. These frameworks couple task allocation with collision-free routing under continuous task arrivals [1][3]. While powerful, they typically assume a single, globally-coordinated fleet.

However, many real-world deployments are inherently multi-subsystem, where distinct agent fleets operate within separate regions — often under different management — but must collaboratively exchange payloads at shared interfaces to complete end-to-end transport. Examples range from multi-vendor logistics, robotic systems interfacing with conveyors to heterogeneous cooperative teams and interacting subsystems in terminals [4][7]. The primary challenge in such distributed architectures lies in coordinating the interfaces between subsystems without sacrificing modularity or scalability.

Our focus is on the common scenario where subsystems exchange payloads exclusively through fixed handover stations. Unlike in standard MAPD, each handover station is a critical shared resource: it has one dock vertex with exclusive access, non-preemptive operation times, and a finite-capacity buffer. Under realistic load, these constraints can cause upstream blocking (an unload cannot start because the buffer is full) and downstream starvation (a load cannot start because the requested payload is unavailable), even when motion within each individual subsystem is efficient [8], [9]. Here, buffer safety means that no accepted operation causes a station buffer to underflow or exceed its capacity, whereas availability coordination means that a downstream load is reserved only for a payload already present at that station. Consequently, merely running independent MAPD solvers and allowing agents to ‘queue’ at the interface can commit mutually incompatible station operations.

To address this challenge, we formalize MS-MAPD-BHS (Multi-Subsystem MAPD with Buffer-limited Handover Stations) and propose HARR (Handover-Aware Reservation and Routing). HARR schedules two-sided station operations while respecting dock exclusivity and finite-buffer dynamics. Its interface state is a deterministic schedule derived from operations that have already been accepted.

Figure 1: Two-fleet lifelong MAPD with buffer-limited handover stations. The crossed-circle marking on the upper route denotes a dock entry that is inadmissible at the illustrated timestep because the loaded upstream agent would unload into a full buffer; it does not make the entire route permanently forbidden. The agent may wait or replan and enter after capacity becomes available.

The main contributions of this paper are:

  • We formally define MS-MAPD-BHS, a lifelong multi-subsystem pickup-and-delivery problem where agents are confined to regions and inter-subsystem transfers occur only through shared handover stations with single-dock access, non-preemptive load/unload times, and finite-capacity buffers with explicit dynamics (Fig. 1).

  • We propose HARR, an online controller that couples per-subsystem Token Passing (TP) planners [2] using a shared dock calendar and a deterministic rolling-horizon buffer occupancy projection. Candidate plans are accepted only when the dock interval is free and the resulting committed buffer schedule remains feasible.

  • We evaluate mean service time under online task arrivals, comparing HARR against a coupled TP reference and a fixed-dock ablation, measuring service time, throughput, backlog, and planning cost.

2 Related Work↩︎

MAPF methods range from optimal search variants to bounded-suboptimal, large-neighborhood, prioritized, and rolling-horizon approaches [10], [11]. Package-exchange and shared-infrastructure variants also exist [12], [13], but do not address lifelong finite-buffer transfer.

Online Multi-Agent Pickup and Delivery (MAPD), where tasks arrive dynamically, is commonly addressed via Token Passing (TP) and reservation-table methods [2], [14]. Other MAPD variants incorporate richer objectives and constraints like task deadlines  [15], [16], external agents [17], kinematic constraints [14], or exchange coordination (e.g., PERR, MAPD-MP [18], MAPF-E [13], MAPD-HA [19]). These formulations enrich tasks and motion, but do not model a finite-capacity, single-server transfer interface that stores payloads between independently operating fleets.

Cooperation among heterogeneous teams is also studied outside MAPD. For example, decentralized hierarchical planning coordinates aerial and ground vehicles with distinct capabilities [7]. Such work motivates inter-team task decomposition and coordination, but does not address lifelong collision-free payload flow through a shared finite buffer. Conversely, parcel-transshipment research studies terminal capacity, sorting resources, blocking, and combined simulation and optimization [20], [21]. These models provide relevant operational context for handover bottlenecks, but typically aggregate parcel flow rather than plan time-indexed trajectories for individual robots.

Table 1 positions MS-MAPD-BHS along five dimensions: online task arrivals, multiple fleets or environments, explicit payload transfer, finite transfer-point storage, and time windows or deadlines. Existing work covers several of these dimensions separately, but not their combination. In particular, it does not explicitly model the buffer dynamics that create blocking and starvation at an asynchronous handover interface, as highlighted by the Buf column.

HARR is complementary to work on joint task allocation and path planning [22][24]. Rather than redesigning allocation or MAPF solvers, it augments scalable online MAPD with explicit dock and buffer calendars while keeping motion planning subsystem-local.

Table 1: Comparison of related MAPF and MAPD variants.
Variants Online Multi Xfer Buf TW
PDP [25]
PERR [12]
online MAPD [2]
MAPD-D [15]
MAPD-MP [18]
MAPD-EA [17]
DPDTW [16]
MAPF-E [13]
MAPD-HA [19]
MS-MAPD-BHS (ours)

2.2pt

Online: Online tasks. Multi: multiple fleets/environments. Xfer: handover/exchange. Buf: buffer/storage. TW: time windows/deadlines.

3 Problem Statement↩︎

We formally define MS-MAPD-BHS: Multi-Subsystem MAPD with Buffer-limited Handover Stations. We study the two-subsystem, one-way-flow case, which is the smallest setting in which a shared finite buffer induces blocking and starvation. The controller and experiments are limited to this case; reverse flow, bidirectional competition for the same station, and chains with more than two subsystems are outside the evaluated scope. Throughout this section, we use the notation summarized in Table 2.

Table 2: Selected notation used in Sec. [sec:sec:problem].
Symbol Meaning
\(G=(V,E)\) global undirected graph environment
\(V_i\subseteq V\) vertex set of subsystem \(i\)
\(G_i=(V_i,E_i)\) subsystem-\(i\) induced subgraph \(G[V_i]\)
\(H\subseteq V\) handover station vertices
\(A=\bigcup_i A_i\) set of all agents (for all subsystems \(i\))
\(p_a(t)\) vertex of agent \(a\) at timestep \(t\)
\(\tau^{\st{load}},\tau^{\st{unload}}\) load/unload durations [timesteps]
\(B_h\) buffer capacity of dock \(h\in H\)
\(b_h(t)\) buffer occupancy of dock \(h\) at \(t\)
\(o=(s(o),g(o),r(o))\) task (source, destination, release time)
\(c(o)\) completion time of task \(o\)

3.1 Environment and motion model↩︎

As in the standard discrete MAPF/MAPD setting, the environment is an undirected graph \(G=(V,E)\) typically induced by a 4-neighbor grid map: each free grid cell is a vertex and an edge connects horizontally/vertically adjacent free cells. Time is discrete, i.e., \(t\in\mathbb{Z}_{\ge 0}\).

Each subsystem \(i \in \{1, 2\}\) operates within its own dedicated region defined by a vertex set \(V_i \subseteq V\), forming a vertex-induced subgraph \(G_i = G[V_i] = (V_i, E_i)\), with \(E_i=\left\{\{u, v\} \in E: u, v \in V_i\right\}\). These subsystems are geographically disjoint except for a set of shared dock vertices, \(H=\{h_1,\dots,h_{|H|}\}\), which constitute their only overlap (\(V_1\cap V_{2} = H\)) and are otherwise disjoint (\((V_1\setminus H)\cap (V_2\setminus H)=\emptyset\)). Crucially, there are no edges connecting non-dock regions directly across subsystems. This means payload transfers are exclusively conducted via dock vertices in \(H\). Each dock vertex itself represents an isolated station, implying no direct edges exist between distinct dock vertices (\(h \neq h^{\prime} \in H \implies \{h, h^{\prime}\} \notin E\)).

Each subsystem \(i\) has its own set of agents \(A_i\). Let \(p_a(t)\) denote the location (i.e., occupied vertex) of agent \(a\) at the timestep \(t\). Agents are strictly confined to their respective \(G_i\): for any \(a\in A_i\), \(p_a(t) \in V_i, \, \forall t\), and all moves must be along edges in \(E_i\). Also, at each \(t\), an agent executes one action (either wait or move to an adjacent vertex in its subsystem graph), yielding the next position \(p_a(t+1)\in \{p_a(t)\}\cup N_{G_i}(p_a(t))\), where \(N_{G_i}(.)\) denotes neighbor set in \(G_i\). All agents act simultaneously at each \(t\). Let \(A=\bigcup_i A_i\). A vertex collision between agents \(a\neq b\in A\) occurs at timestep \(t\) iff \(p_a(t)=p_b(t)\). An edge collision (swap) occurs at timestep \(t\) iff \(p_a(t)=p_b(t+1)\) and \(p_a(t+1)=p_b(t)\). Agents must avoid collisions. We assume perfect execution.

We define \(\tau^{\textsf{load}},\tau^{\textsf{unload}}\in\mathbb{Z}_{>0}\) as the fixed durations for load/unload operations at task sources/destinations or dock vertices. Operations are non-preemptive and are modeled as consecutive waits at the operation vertex. If an agent arrives at time \(t_0\) and waits for \(\tau\) steps, it occupies that vertex at integer times \(\{t_0, \ldots, t_0+\tau\}\) and may depart at \(t_0+\tau+1\). An agent begins its assigned operation immediately upon arrival at the vertex if preconditions are met (see Section 3.3).

3.2 Handover station interface model↩︎

Subsystems exchange payloads only via handover stations. Each station is represented by a shared dock vertex \(h\in H\) together with a finite buffer of capacity \(B_h\in\mathbb{Z}_{>0}\) (max number of storable payloads). At any timestep \(t\), the dock vertex \(h\) may be occupied by at most one agent.

3.3 Tasks and buffer dynamics↩︎

Tasks arrive online. Each task \(o\) is a triple \((s(o),g(o),r(o))\) with source \(s(o)\in V_1\setminus H\), destination \(g(o)\in V_2\setminus H\), and release time \(r(o)\in\mathbb{Z}_{\ge 0}\). Thus subsystem 1 is upstream and subsystem 2 is downstream. We consider only one-way inter-subsystem tasks from upstream to downstream; reverse and bidirectional flows are not modeled in this paper. At time \(r(o)\), a payload becomes available at \(s(o)\) and remains there until an upstream agent loads it. Payloads do not block agent paths.

The buffer models storage capacity only, holding up to \(B_h\) payloads. By imposing no physical ordering (e.g., FIFO/LIFO), it abstracts a common staging area where any item can be accessed. Buffered payloads retain their task association \(o\) (including destination \(g(o)\)). A downstream agent loading at \(h\) may retrieve any available payload, providing maximum planning flexibility but complicating coordination. Each agent starts empty and carries at most one payload at a time.

Let \(b_h(t)\in\mathbb{Z}_{\geq0}\) denote the buffer occupancy at dock vertex \(h\) at timestep \(t\). All buffers are initially empty (i.e., \(b_h(0) = 0, \forall h \in H\)), and occupancy is always limited by the buffer capacity (i.e., \(0 \leq b_h(t) \leq B_h\) for all \(t\)). An upstream agent performs the following sequence: loads a payload at \(s(o)\) (duration \(\tau^{\textsf{load}}\)), travels to a chosen dock vertex \(h\in H\), and unloads at \(h\) (duration \(\tau^{\textsf{unload}}\)). An upstream agent may enter \(h\) and start the unload operation at timestep \(t\) only if the buffer is not full (\(b_h(t) < B_h\)). If the operation starts at \(t\), the payload enters the buffer, and \(b_h\) increases by one, at timestep \(t + \tau^{\textsf{unload}}\).

A downstream agent performs the following sequence: loads a buffered payload at \(h\) (duration \(\tau^{\textsf{load}}\)), travels to the corresponding \(g(o)\), and unloads it (duration \(\tau^{\textsf{unload}}\)). A downstream agent may enter \(h\) and start the load operation at timestep \(t\) only if the selected payload is present at \(h\); in particular, \(b_h(t) > 0\). If the operation starts at \(t\), that payload is removed from the buffer, and \(b_h\) decreases by one at timestep \(t + \tau^{\textsf{load}}\). The entry guards for upstream and downstream operations apply only at the planned dock-entry time: an agent may wait elsewhere or replan until the operation becomes admissible.

3.4 Service time metric and optimization goal↩︎

Let \(c(o)\) denote the completion time of task \(o\), defined as the timestep at which the downstream agent finishes its unload operation at \(g(o)\). For a horizon \(T\), let \(O_T=\{o:c(o)\leq T\}\). When \(O_T\neq\emptyset\), service time [18] is the mean completion delay: \[\mathrm{ServiceTime}(T) = \frac{1}{\left|O_T\right|} \sum_{o \in O_T} \bigl( c(o) - r(o) \bigr), \label{eq:service95time}\tag{1}\]

Given \(\left(G,\left\{A_i\right\},\left\{B_h\right\}, \tau^{\textsf{load}}, \tau^{\textsf{unload}} \right)\) and an online task stream, a solution to MS-MAPD-BHS is an online policy that assigns tasks, selects handover stations, schedules station usage, and plans collision-free paths. The primary objective is low service time subject to motion and buffer safety; Sec. 6 additionally reports throughput and backlog to diagnose overload.

4 Handover-Aware Reservation and Routing (HARR)↩︎

4.1 Overview and Token Passing↩︎

Token Passing (TP) is an online MAPD scheme in which a token stores every local agent’s committed, time-indexed path and task assignment [2]. An agent requests the token when it reaches the end of its stored path. While holding the token, it selects an unassigned task, computes a space-time path that avoids the other paths stored in the token, writes its new path back, and releases the token. We call this stored sequence a token path; for agent \(a\), it is \(\pi_a=(\pi_a(t),\pi_a(t{+}1),\ldots)\) with \(\pi_a(t)=p_a(t)\).

HARR maintains one TP token per subsystem and a shared station manager that reserves dock occupancy and enforces buffer feasibility. Each inter-subsystem task is decomposed into two subtasks, called legs: an upstream push leg from \(s(o)\) to a selected dock \(h\in H\), followed by a downstream pull leg from the same dock to \(g(o)\). HARR processes pulls before pushes at each timestep to favor buffer drainage. Alg. 3 details the HARR online control loop.

Throughout this section, \(d_{G_i}(u,v)\) denotes the shortest-path distance between \(u,v\in V_i\) in \(G_i\).

Figure 2: HARR runs TP in each subsystem and couples the planners only through shared station state. R_h reserves exclusive dock occupancy, and Q_h is a deterministic projection obtained by applying the events of already committed buffer operations to the observed current occupancy.

4.2 Shared station calendars↩︎

At global time \(t\), HARR maintains per-dock calendars over a rolling horizon \(\Theta=[t,t{+}W]\cap\mathbb{Z}\), where \(W\in\mathbb{Z}_{>0}\) is the window size.

4.2.0.1 Dock reservation calendar

For each dock vertex \(h\in H\), we define its dock reservation calendar as a time-indexed map \(R_h: \mathbb{Z}_{\ge 0} \to A\cup\{\bot\}\). \(R_h(\theta)\in A\) indicates the unique agent reserved to occupy \(h\) at time \(\theta\), or \(R_h(\theta)=\bot\) if \(h\) is unreserved. This calendar \(R_h\) is global; it is queried during planning and updated when a new token path is committed (Alg. 3, ReserveDocks).

4.2.0.2 Committed buffer-event calendar and occupancy projection

For each dock \(h\), the event calendar \(E_h: \mathbb{Z}_{\ge 0} \to \mathbb{Z}\) stores occupancy changes caused by already committed operations. An upstream unload beginning at dock-entry time \(t_0\) adds \(+1\) to \(E_h(t_0+\tau^{\textsf{unload}})\), whereas a downstream load adds \(-1\) to \(E_h(t_0+\tau^{\textsf{load}})\). These events define the deterministic occupancy projection \(Q_h\): \[Q_h(t)=b_h(t),\,\, Q_h(\theta)=Q_h(\theta-1)+E_h(\theta)\;\;\text{for }\theta>t. \label{eq:projection}\tag{2}\] Thus, \(Q_h\) is the time-indexed buffer schedule implied by accepted operations. As the planning horizon advances, past events are discarded and \(Q_h(t)\) is re-anchored to the observed occupancy \(b_h(t)\). Events are committed online via CommitDockAndBuffer (Alg. 3).

4.2.0.3 Dock occupancy interval

Under the operation model defined in Sec. 3, an operation of duration \(\tau\) that begins upon an agent entering \(h\) at time \(t_0\) exclusively occupies the dock vertex at integer times \[I^{\textsf{dock}}(t_0,\tau)=\{t_0,t_0{+}1,\dots,t_0{+}\tau\}.\]

4.2.0.4 Station-feasible insertion of a dock operation

To insert an operation for agent \(a\) at dock \(h\) with dock-entry time \(t_0\), duration \(\tau\), and event sign \(\sigma\in\{+1,-1\}\) (\(+1\) for push/unload, \(-1\) for pull/load), we define the event time \(\theta^{\textsf{evt}}:=t_0+\tau\) with \(\theta^{\textsf{evt}}\in\Theta\). The insertion is station-feasible iff: \[\begin{align} &\forall \theta\in I^{\textsf{dock}}(t_0,\tau):\;\;R_h(\theta)=\bot, \tag{3}\\ &\text{start guard: }\;\; \begin{cases} Q_h(t_0)<B_h & \text{if }\sigma=+1\;(\text{push})\\ Q_h(t_0)>0 & \text{if }\sigma=-1\;(\text{pull}) \end{cases} \tag{4}\\ &\forall \theta\in[\theta^{\textsf{evt}},t{+}W]\cap\mathbb{Z}:\;\; 0\le Q_h(\theta)+\sigma \le B_h. \tag{5} \end{align}\] These conditions require:

  • Condition 3 : The dock must be unreserved (\(R_h(\theta)=\bot\)) throughout the operation’s exclusive interval \(I^{\textsf{dock}}(t_0,\tau)\).

  • Condition 4 : At \(t_0\), the buffer must have space for a push (\(Q_h(t_0)<B_h\)) or contain the selected pull payload; the latter also implies \(Q_h(t_0)>0\).

  • Condition 5 : After inserting the candidate event, the committed occupancy projection must remain within \([0, B_h]\) through the end of the enforced horizon, so the insertion cannot invalidate an already accepted later operation.

4.3 Station-aware Token Passing↩︎

When an agent requests its subsystem token, PlanFirstFeasible runs space-time A* on \(G_i\). The search avoids vertex and edge conflicts with the other token paths in that subsystem, and additionally respects the shared station calendar.

4.3.0.1 Dock constraints

During A* for agent \(a\), a dock state \((h,\theta)\) is unavailable whenever \(R_h(\theta)\notin\{\bot,a\}\). After a path is accepted, ReserveDocks writes every dock occupancy on that path within the horizon to \(R_h\), preventing cross-subsystem conflicts at shared dock vertices.

4.3.0.2 Dock operations

A dock operation beginning \(t_0\) is admissible only if Eqs. 35 hold. If accepted, the corresponding event is posted to \(E_h\) and the occupancy projection \(Q_h\) is updated before the next request is considered.

4.4 Leg paths and unassigned-leg sets↩︎

Let \(\mathcal{E}_i\subseteq V_i\) denote the endpoint set used by TP in subsystem \(i\) (task endpoints plus additional parking endpoints). Parking is restricted to \(\mathcal{E}_i\setminus H\).

HARR uses two sets to track work that is currently available for assignment. \(T^{\uparrow}(t)\) contains released tasks whose push leg is unassigned, and \(T^{\downarrow}(t)\) contains buffered tasks whose pull leg is unassigned. For each \(o\in T^{\downarrow}(t)\), the data structure also stores the dock \(h(o)\) where the payload is present. A task leaves \(T^{\uparrow}\) when its push path is committed, enters \(T^{\downarrow}\) only after the upstream unload completes, leaves \(T^{\downarrow}\) when its pull path is committed, and exits the system after the downstream unload at \(g(o)\). While a leg is in progress, its state is represented by the responsible agent’s token path rather than duplicated in either set.

4.4.0.1 Push template (subsystem 1)

A push for task \(o\) to dock \(h\) plans through \(s(o)\) (wait \(\tau^{\textsf{load}}\)), then \(h\) (wait \(\tau^{\textsf{unload}}\)), and finally a parking endpoint \(e\in\mathcal{E}_1\setminus H\). The dock operation uses \((\sigma,\tau)=(+1,\tau^{\textsf{unload}})\).

4.4.0.2 Pull template (subsystem 2)

A pull for buffered task \(o\) at dock \(h(o)\) plans through \(h(o)\) (wait \(\tau^{\textsf{load}}\)), then \(g(o)\) (wait \(\tau^{\textsf{unload}}\)), and finally a parking endpoint \(e\in\mathcal{E}_2\setminus H\). The dock operation uses \((\sigma,\tau)=(-1,\tau^{\textsf{load}})\).

Figure 3: HARR: station- and buffer-aware decoupled Token Passing.

4.4.0.3 Algorithm helpers

ModeParams selects \((T^{\uparrow},+1,\tau^{\textsf{unload}})\) for pushes and \((T^{\downarrow},-1,\tau^{\textsf{load}})\) for pulls; Candidates applies the ordering below. PlanFirstFeasible runs space-time A* for each pair and enforces \(R\) and Eqs. 35 . ReserveDocks writes accepted dock-time states to \(R\), and CommitDockAndBuffer posts the event to \(E\) and updates \(Q\). Park uses the same path constraints to reach a non-dock endpoint.

4.5 Task and dock selection↩︎

When a downstream agent \(a\in A_2\) requests the token, it considers up to \(M_{\max}\) candidates \(o\in T^{\downarrow}\) in increasing order of \[J_{\downarrow}(a,o)=d_{G_2}\bigl(p_a(t),h(o)\bigr)+d_{G_2}\bigl(h(o),g(o)\bigr).\] When an upstream agent \(a\in A_1\) requests the token, it considers up to \(M_{\max}\) tasks \(o\in T^{\uparrow}\) (oldest first). For each task, it considers up to \(k_{\max}\) docks \(h\in H\) in increasing order of \[J_{\uparrow}(a,o,h)= d_{G_1}\bigl(p_a(t),s(o)\bigr) +d_{G_1}\bigl(s(o),h\bigr) +d_{G_2}\bigl(h,g(o)\bigr).\] Candidates are attempted in the above order; the first candidate for which station-aware A* finds a feasible plan is accepted.

4.6 Computational cost, guarantees, and feasibility↩︎

4.6.0.1 Computational cost

For one token request, a pull attempts at most \(M_{\max}\) task–dock pairs, whereas a push attempts at most \(M_{\max}\min\{k_{\max},|H|\}\) pairs. Each pair invokes one space-time A* search. In addition to TP’s collision checks, HARR examines the \(\tau+1\) dock slots in Eq. 3 and at most \(W+1\) occupancy entries in Eq. 5 . The rolling-horizon arrays \(R\), \(E\), and \(Q\) each store \(|H|(W+1)\) entries. Enumeration stops at the first feasible pair.

4.6.0.2 Collision safety

Within each subsystem, standard TP checks preserve vertex- and edge- collision freedom among committed local paths. Across subsystems, the only shared vertices are docks, and \(R_h(\theta)\) permits at most one agent to occupy a dock at a time. Therefore, under perfect execution, committed dock use is collision-free over the enforced reservation horizon. It does not claim completeness or collision safety beyond \(t+W\), where future paths have not yet been committed.

4.6.0.3 Sequential insertion semantics

Requests are processed sequentially as in Alg. 3. After each accepted plan, CommitDockAndBuffer immediately updates \((E_h,Q_h)\) before the next candidate is checked. The guarantee below therefore assumes this insertion order and perfect execution.

4.6.0.4 Buffer safety

At time \(t\), each occupancy projection is anchored at \(Q_h(t)=b_h(t)\in[0,B_h]\). Committing an operation leaves \(Q_h\) unchanged before its event and shifts it by \(\sigma\) from the event time onward. Condition 5 is exactly the requirement that the updated projection remain in \([0,B_h]\). By induction over sequentially accepted insertions, every committed event calendar is occupancy-consistent over \([t,t+W]\). The guarantee is horizon-local. HARR makes no claim beyond \(t+W\) until the horizon advances and the projection is re-anchored.

4.6.0.5 Feasibility and completeness

MS-MAPD-BHS is not universally solvable. Feasibility depends on subsystem geometry, endpoint availability, reachability between task vertices and admissible docks, staffing balance, and interface load. HARR is not complete: it uses a finite horizon, caps task candidates at \(M_{\max}\), and inherits the limitations of prioritized TP planning. Our domains avoid trivial endpoint deadlocks—agents can park outside \(H\), and the relevant task and dock vertices are reachable—but a full completeness and stability characterization is left to future work.

5 Comparators and Ablations↩︎

We compare HARR with one coupled reference method and two mechanism ablations. The reference evaluates the computational effect of subsystem-local rather than global Token Passing, whereas the ablations isolate online dock selection and forward buffer projection.

5.0.0.1 MonoSBTP (coupled station- and buffer-aware TP)

We run TP with a single global token over all agents \(A\), while restricting each agent’s search space to its subsystem vertices \(V_i\). Dock exclusivity is enforced implicitly by global collision avoidance at shared dock vertices, and buffer feasibility uses the same committed occupancy projection \((E_h,Q_h)\) and capacity guard (Eq. 5 ) as HARR.

5.0.0.2 FixedDock (no online dock selection)

This method is identical to HARR, except that each task is assigned at release to the dock minimizing \(d_{G_1}(s(o),h)+d_{G_2}(h,g(o))\) and cannot change docks online. It is an ablation of adaptive dock selection.

5.0.0.3 StartResBuf negative control (local start-time admission only)

This ablation omits the rolling-horizon occupancy projection: a newly inserted dock operation is checked only against dock availability and its local start guard, without \((E_h,Q_h)\) and Eq. 5 . Because online insertions can occur out of chronological order, a newly accepted earlier event can invalidate an already committed later operation. In our simulator, StartResBuf yielded no valid run in the tested settings, so it is retained as a negative control and excluded from quantitative plots.

Table 3: Comparators and ablations.
Method G-TP \(R\) Projection DynDock
MonoSBTP
FixedDock
StartResBuf
HARR (ours)

5pt

G-TP: token scope in ProcessRequests.
\(R\): written by ReserveDocks.
Projection: updated by CommitDockAndBuffer.
DynDock: dock enumeration in Candidates

.

6 Experiments↩︎

We evaluate HARR in a C++ simulator implementing the two-subsystem MS-MAPD-BHS model from Sec. 3. Unless stated otherwise, all methods use the same motion model, task process, and endpoint sets \(\mathcal{E}_i\) (with parking restricted to \(\mathcal{E}_i\setminus H\)), as well as uniform station parameters \(\tau^{\textsf{load}}=\tau^{\textsf{unload}}=2\) and \(B_h=B\). For HARR, we set \(W=60\), \(M_{\max}=20\), and \(k_{\max}=8\). Because the largest tested configuration has \(|H|=8\), the dock-candidate cap never binds in the reported experiments. Default provisioning is \(|H|=4\), \(B=1\), with \(n_1=n_2=12\) agents.

6.1 Domains and station layouts↩︎

We use two representative grid domains: Empty, an open map (\(40\times20\)) that isolates interface-induced effects (dock contention, blocking, and starvation); and Warehouse, a shelf-like layout (\(34\times26\)) that induces within-subsystem congestion and longer detours.

At each timestep \(t\), the number of new inter-subsystem tasks is \(N_t\sim \mathrm{Poisson}(\rho)\). Each task \(o=(s(o),g(o),r(o))\) samples \(s(o)\) uniformly from a fixed upstream source set \(\mathcal{S}\subset V_1\setminus H\) and \(g(o)\) uniformly from a fixed downstream destination set \(\mathcal{G}\subset V_2\setminus H\). We choose 4 sources and 4 destinations, whose locations are initialized by random seeds.

Handover stations are distributed approximately uniformly along the interface; the released configurations specify their exact coordinates for every tested \(|H|\). To compare runs across different numbers of docks \(|H|\) and operation times, we define the normalized offered dock load \[\varrho \;=\; \rho \cdot \frac{(\tau^{\textsf{unload}}{+}1)+(\tau^{\textsf{load}}{+}1)}{|H|},\] where \(\tau{+}1\) matches the dock-occupancy interval length \(|I^{\textsf{dock}}(\cdot,\tau)|\) used by HARR (Sec. 4). Thus, \(\varrho\) compares requested dock time with nominal aggregate dock capacity. It is an offered-load indicator, not a sufficient stability condition, because path congestion, staffing imbalance, and heterogeneous dock accessibility also affect throughput.

6.2 Protocol and metrics↩︎

Each configuration runs for \(T_{\textsf{tot}}=4000\) timesteps. We discard the first \(T_{\textsf{warm}}=1000\) timesteps (25% of the run) to reduce the common initialization transient caused by initially empty buffers and seeded initial agent positions; the same warm-up is used for every method and configuration. Results are averaged over \(N_{\textsf{seed}}=10\) independent random seeds and reported with 95% confidence intervals.

6.2.0.1 Performance metrics

We report three complementary metrics:

  1. Service time [timesteps]. \(\mathrm{ServiceTime}(T_{\textsf{tot}})\) from Eq. 1 , computed over tasks released after warm-up and completed by \(T_{\textsf{tot}}\).

  2. Throughput [tasks/timestep] (stability). \[\mathrm{Throughput} \;=\; \frac{\left|\left\{o:\; c(o)\in (T_{\textsf{warm}},T_{\textsf{tot}}]\right\}\right|}{T_{\textsf{tot}}-T_{\textsf{warm}}},\] i.e., completed tasks per timestep during the measurement window.

  3. Backlog [tasks] (unserved demand). \[\mathrm{Backlog} = \left|\left\{o:\; T_{\textsf{warm}}<r(o)\le T_{\textsf{tot}},\; c(o)>T_{\textsf{tot}}\right\}\right|.\]

Throughput and backlog remain informative in overload regimes and prevent survivorship bias.

6.3 Results↩︎

The two comparison studies target different mechanisms. The load and provisioning sweeps compare HARR with the FixedDock ablation to isolate adaptive dock selection, whereas the fleet-size sweep compares HARR with the coupled MonoSBTP reference to isolate global-token coupling. They should therefore be read as two controlled comparisons, not as a single three-way ranking.

6.3.1 Adaptive dock selection: HARR vs.FixedDock↩︎

We first study whether online dock selection improves both service time and stability as the interface approaches saturation. We sweep the offered dock load \(\varrho\) on both maps under default provisioning and balanced staffing. For each configuration, we report service time, throughput, and backlog.

Figure 4: Load sweep under default provisioning (|H|=4, B=1). Rows are Empty and Warehouse; columns show service time [timesteps] (lower is better), throughput [tasks/timestep] (higher is better), and backlog [tasks] (lower is better, log scale).

Figure 4 shows that HARR outperforms FixedDock across the tested load range. At moderate load, it achieves higher throughput and substantially lower backlog on both maps (Table 4). Near saturation, throughput and backlog reveal overload more reliably than service time; the largest gains occur on Warehouse, where congestion makes static dock assignments less effective.

Table 4: Moderate-load results (\(\varrho=0.15\); default provisioning). Throughput is measured in tasks/timestep and backlog in tasks.
Throughput \(\uparrow\) Backlog \(\downarrow\)
Map FixedDock HARR Gain FixedDock HARR Reduction
Empty 0.071\(\pm\)0.005 \(\mathbf{0.099\pm0.007}\) +39% 110\(\pm\)34 \(\mathbf{9.2\pm3.6}\) 92%
Warehouse 0.053\(\pm\)0.006 \(\mathbf{0.093\pm0.005}\) +77% 181\(\pm\)33 \(\mathbf{31\pm18}\) 83%

4pt

We next vary the number of docks \(|H|\) and buffer capacity \(B\) separately at an arrival rate near saturation. Figure 5 shows that HARR benefits more from additional docks because it can exploit the currently reachable, buffer-feasible interface. At \(|H|=8\), its throughput is 202% higher on Empty and 245% higher on Warehouse.

Figure 5: Interface provisioning sweeps (throughput). Columns sweep the number of docks |H| and the buffer capacity B.

6.3.2 Fleet-size planning cost: HARR vs.MonoSBTP↩︎

We compare the computational cost of decoupled planning in HARR with the coupled MonoSBTP reference while checking service time. We sweep the total number of agents \(N\in \{5,10,15,20,25,30,35,40,45\}\) with a balanced split \((n_1,n_2)=(\lfloor N/2\rfloor,\lceil N/2\rceil)\). Workload, workspace, and interface provisioning remain fixed, so this is a fleet-size study rather than a workspace-size scaling study.

Figure 6 shows that HARR has lower or comparable mean planning time across the tested fleet sizes, with the clearest advantage on the structured Warehouse map. Service time is non-monotonic: adding agents initially reduces delay, but larger fleets eventually create more path interference and coordination work. On Warehouse, service time rises again beyond the best-performing fleet-size range. Thus, over-provisioning agents can be counterproductive even though demand and workspace are fixed. The comparison supports a narrower conclusion: subsystem-local tokens reduce planning cost relative to a global token over the tested fleet sizes while retaining comparable service quality.

Figure 6: Fleet-size sweep on two fixed workspaces. Mean planning time per step [s] and service time [timesteps] are both lower when better; curves summarize ten seeds.

6.4 Scope and limitations↩︎

The evaluation covers two fixed workspaces and does not establish workspace-size or asymptotic scalability. The A* expansion term \(S_i\) in Sec. 4 can grow substantially with map size, congestion, and reservation horizon. Sensitivity to \(W\), \(M_{\max}\), and \(k_{\max}\) is not swept; all are held constant to isolate the interface mechanisms. Since \(k_{\max}=8\) and every tested configuration has \(|H|\leq 8\), the cap never binds, so the experiments do not measure the effect of dock-candidate truncation in larger interfaces. The two comparator studies use different independent variables because they isolate different mechanisms, and no unified three-way ranking is claimed. Longer or hierarchical subsystem networks, reverse or bidirectional flow, deadlines and priorities, execution uncertainty, broader parameter sweeps, and spatial scaling remain future work.

7 Conclusion↩︎

We introduce MS-MAPD-BHS, a lifelong pickup-and-delivery problem in which region-confined fleets exchange payloads through buffer-limited handover stations. HARR coordinates subsystem-local Token Passing planners through shared dock reservations and a deterministic rolling-horizon projection of committed buffer events. Under perfect execution, accepted dock operations are collision-free and buffer-safe within the enforced horizon, although the method is explicitly incomplete. In simulation, HARR achieves up to 77% higher throughput and 92% lower backlog than FixedDock at moderate load and reduces planning time relative to MonoSBTP at comparable service time.

Future work includes implementing and evaluating longer and hierarchical subsystem chains, incorporating deadlines and priority-aware assignment, handling execution uncertainty and bidirectional transfers, and studying workspace-size, parameter-sensitivity, and stability scaling.

References↩︎

[1]
J. Li et al., “Scalable rail planning and replanning: Winning the 2020 flatland challenge,” in International conference on automated planning and scheduling (ICAPS), 2021, pp. 477–485, [Online]. Available: https://ojs.aaai.org/index.php/ICAPS/article/view/15994.
[2]
H. Ma, J. Li, T. K. S. Kumar, and S. Koenig, “Lifelong multi-agent path finding for online pickup and delivery tasks,” in International conference on autonomous agents and multiagent systems (AAMAS), 2017, pp. 837–845, [Online]. Available: http://dl.acm.org/citation.cfm?id=3091243.
[3]
J. He, Y. Zhang, R. Veerapaneni, and J. Li, “Scaling lifelong multi-agent path finding to more realistic settings: Research challenges and opportunities,” in International symposium on combinatorial search (SOCS), 2024, pp. 234–242, doi: 10.1609/SOCS.V17I1.31565.
[4]
X. Chen, S. He, Y. Zhang, L. C. Tong, P. Shang, and X. Zhou, “Yard crane and AGV scheduling in automated container terminal: A multi-robot task allocation framework,” Transportation Research Part C: Emerging Technologies, vol. 114, pp. 241–271, 2020.
[5]
G. Fragapane, R. de Koster, F. Sgarbossa, and J. O. Strandhagen, “Planning and control of autonomous mobile robots for intralogistics: Literature review and research agenda,” European Journal of Operational Research (EJOR), vol. 294, no. 2, pp. 405–426, 2021, doi: 10.1016/J.EJOR.2021.01.019.
[6]
F. Menebröker, J. Stadtler, A. Böckenkamp, D. Lünsch, and S. Franke, “Mobile robot collaboration in industrial applications: A structured survey,” in International conference on automation science and engineering (CASE), 2025, pp. 2428–2435, doi: 10.1109/CASE58245.2025.11163885.
[7]
B. Arbanas, A. Ivanovic, M. Car, M. Orsag, T. Petrovic, and S. Bogdan, “Decentralized planning and control for UAV–UGV cooperative teams,” Autonomous Robots, vol. 42, no. 8, pp. 1601–1618, 2018, doi: 10.1007/s10514-018-9712-y.
[8]
A. Bonetti, S. Proia, S. Guidetti, and L. Sabattini, AGV traffic management in automated industrial plants: An enhanced lifelong multi-agent path finding approach,” in International conference on automation science and engineering (CASE), 2024, pp. 626–632, doi: 10.1109/CASE59546.2024.10711842.
[9]
C. H. Chung and Y. J. Jang, “Deadlock prevention and multi agent path finding algorithm considering physical constraint for a massive fleet AGV system,” Applied Soft Computing, vol. 161, p. 111725, 2024, doi: 10.1016/J.ASOC.2024.111725.
[10]
R. Stern et al., “Multi-agent pathfinding: Definitions, variants, and benchmarks,” in International symposium on combinatorial search (SOCS), 2019, pp. 151–158, doi: 10.1609/SOCS.V10I1.18510.
[11]
J. Gao, Y. Li, X. Li, K. Yan, K. Lin, and X. Wu, “A review of graph-based multi-agent pathfinding solvers: From classical to beyond classical,” Knowledge-based Systems, vol. 283, p. 111121, 2024, doi: 10.1016/J.KNOSYS.2023.111121.
[12]
H. Ma, C. A. Tovey, G. Sharon, T. K. S. Kumar, and S. Koenig, “Multi-agent path finding with payload transfers and the package-exchange robot-routing problem,” in AAAI conference on artificial intelligence (AAAI), 2016, pp. 3166–3173, doi: 10.1609/AAAI.V30I1.10409.
[13]
H. He, X. Wu, S. Zhao, and Z. Ren, “Conflict-based search for multi-agent path finding with elevators,” CoRR, vol. abs/2602.20512, 2026, doi: 10.48550/ARXIV.2602.20512.
[14]
H. Ma, W. Hönig, T. K. S. Kumar, N. Ayanian, and S. Koenig, “Lifelong path planning with kinematic constraints for multi-agent pickup and delivery,” in AAAI conference on artificial intelligence (AAAI), 2019, pp. 7651–7658, doi: 10.1609/AAAI.V33I01.33017651.
[15]
H. Makino and S. Ito, “Online multi-agent pickup and delivery with task deadlines,” in International conference on intelligent robots and systems (IROS), 2024, pp. 8428–8434, doi: 10.1109/IROS58592.2024.10802597.
[16]
H. Huang, Q. Zhang, B. Deng, X. Zhu, W. Mei, and H. Zhu, “Distributed and transferable task assignment for dynamic pickup-and-delivery with time windows,” IEEE Robotics and Automation Letters (RA-L), vol. 11, no. 2, pp. 1442–1449, 2026, doi: 10.1109/LRA.2025.3642658.
[17]
L. Bonalumi, B. Flammini, D. Azzalini, and F. Amigoni, “Multi-agent pickup and delivery with external agents,” Robotics and Autonomous Systems, vol. 191, p. 105000, 2025, doi: 10.1016/J.ROBOT.2025.105000.
[18]
B. Flammini, N. Hawes, and B. Lacerda, “Multi-agent pickup and delivery with mobile pickups,” in International conference on intelligent robots and systems (IROS), 2025, pp. 10525–10531, doi: 10.1109/IROS60139.2025.11246210.
[19]
B. Flammini, F. Amigoni, and B. Lacerda, “Multi-agent pickup and delivery with heterogeneous agents,” in International conference on autonomous agents and multiagent systems (AAMAS), 2026, pp. 2356–2364, doi: 10.65109/GKGU6726.
[20]
D. McWilliams, “Performance modelling and analysis of transshipment terminals in the parcel delivery industry,” International Journal of Industrial and Systems Engineering (IJISE), vol. 16, no. 4, pp. 493–522, 2014, doi: 10.1504/IJISE.2014.060656.
[21]
U. Clausen, D. Diekmann, M. Pöting, and C. Schumacher, “Operating parcel transshipment terminals: A combined simulation and optimization approach,” Journal of Simulation, vol. 11, no. 1, pp. 2–10, 2017, doi: 10.1057/s41273-016-0032-y.
[22]
W. Hönig, S. Kiesel, A. Tinka, J. W. Durham, and N. Ayanian, “Conflict-based search with optimal task assignment,” in International conference on autonomous agents and multiagent systems (AAMAS), 2018, pp. 757–765, [Online]. Available: http://dl.acm.org/citation.cfm?id=3237495.
[23]
H. Fan et al., “Joint optimization of multi-agent task allocation and path planning for continuous pickup and delivery tasks,” in International conference on intelligent robots and systems (IROS), 2025, pp. 20014–20019, doi: 10.1109/IROS60139.2025.11246606.
[24]
Z. Chen, J. Alonso-Mora, X. Bai, D. D. Harabor, and P. J. Stuckey, “Integrated task assignment and path planning for capacitated multi-agent pickup and delivery,” IEEE Robotics and Automation Letters (RA-L), vol. 6, no. 3, pp. 5816–5823, 2021, doi: 10.1109/LRA.2021.3074883.
[25]
B. Coltin and M. M. Veloso, “Online pickup and delivery planning with transfers for mobile robots,” in International conference on robotics and automation (ICRA), 2014, pp. 5786–5791, doi: 10.1109/ICRA.2014.6907709.

  1. \(^{1}\)Robert Bosch GmbH, Corporate Research, Stuttgart, Germany. Chuanlong.Zang@de.bosch.com↩︎

  2. \(^{2}\)Technical University of Berlin, Berlin, Germany.↩︎

  3. \(^{3}\)Robotics Institute Germany (RIG).↩︎