June 30, 2026
The rapid expansion of sensor-based networks introduces major challenges in scalability, adaptability, and knowledge transfer, especially in open environments where new subsystems can dynamically join or leave. In this work, we propose a Holonic Active Distillation architecture within a HMAS to address these issues. Our approach integrates CSBAD, a framework in which specialized student models collect local data, query pseudo-labels from teacher models, and cluster into groups of similar sensors.
Results show that the holonic organization balances local specialization with global generalization, while efficiently adapting to sensor departures and re-integrations. We also analyzed trade-offs among incremental model updates, system reorganization, and scalability limits.
Our findings highlight the advantages of holonic learning for multi-sensor systems while identifying key challenges related to model drift and long-term adaptation.
In recent years, sensor systems have evolved from isolated and manageable units to expansive and interconnected networks [1]. This transformation, while enabling broader coverage, challenges the traditional approach of deploying a single, universal DNN across all sensors [2]. The dynamic nature of real-world deployments, characterized by stochastic changes and the continuous addition of new sensors, introduces diverse contexts that demand ever larger training datasets and models [3]. This upscaling not only incurs significant costs, but also accumulates hidden technical debt, complicating the maintenance required to adapt to distribution shifts in sensor data [4], [5].
Traditional methods have relied on centralized, monolithic DNNs that struggle to scale with the increasing complexity and diversity of sensor networks. These approaches often lead to inefficiencies and increased maintenance challenges. Recent advances, such as the HoL framework, offer a promising alternative by embracing the agent paradigm to improve scalability and flexibility [6]. HoL leverages self-nested structures of agents, known as holons, to integrate local and global perspectives, facilitating easier subsystem integration and preventing the propagation of disturbances [7]–[9]. This hierarchical learning approach improves the efficiency of data and algorithm handling, particularly for large distributed datasets [10]. A question remains related to the design of a scalable distributed learning framework that supports continuous DNN refinement with minimal refactoring, while allowing each unit to update itself online, self-organize with its peers, and transfer knowledge as the system scales.
This work builds upon the HoL framework by introducing strategies for aggregation, communication, and commitment between learning holons. The contributions are twofold:
We augment HoL with standardized organizations and roles, allowing newcomers to integrate knowing only their role and the associated protocol, inspired by active learning and distillation of knowledge [2], [9], [11].
We propose holonification mechanisms in which agents cluster horizontally and vertically based on the similarity of their sensor streams, preserving confidentiality and balancing specificity and diversity. This recursive process improves the accuracy and resilience of the system, allowing seamless expansion or contraction without disruption [12], [13].
This further advances the adaptability of multisensor holonic systems [14], materializing continuous learning in dynamic environments.
The remainder of this paper is structured as follows. Section 2.2 provides background and current related works. Section 3 presents the high-level formulation of the organizations for the HAD architecture and the relationships between super- and subholons. Section 4 introduces a distributed, multi-tiered, self-nested structure for DNNs and the self-organization mechanisms that realize the specificity–diversity trade-off. Section 5 describes the materials used in the experiment, while Section 6 reports the results on sensor addition and removal, comparing partial reorganizations with complete retraining and measuring knowledge-transfer speed. Finally, Section 7 discusses the insights, limitations, and perspectives, followed by the conclusion in Section 8.
We set the foundational machine learning frameworks to continuously adapt to incoming data. Next, we discuss the landscape of learning in MAS motivated by the ability of agent-oriented design to minimize refactoring and support isolated updates. The section is then concluded by reviewing organizational methodologies for seamless integration of a new sensor, model, or more generally, a subsystem of sensors and models in MAS.
Adapting machine learning models at test-time is crucial to preserve their performance [15]–[17]. SBAD [18] addresses the challenges of the lack of labeled data at test time by selecting, from sensor streams, samples to constitute a training set representative of the sensor’s characteristics,i.e., features space. To alleviate annotation costs, SBAD relies on annotation by other models within the system in a Teacher-Student scheme. Fine-tuning a model per device does not scale well, as it requires maintaining a separate model for each additional sensor [4], [19].
Clustered SBAD [2] diminishes the number of models by grouping sensors using a similarity distance of their features and by training one model per cluster. This also improves the accuracy of models by striking a balance between tailoring models to their data streams and generalization capabilities by training on enough diverse samples [20]. CSBAD’s limitation is not to retain knowledge for successive re-training of current models, nor provide knowledge transfer mechanisms to new sensors.
Inspired by human organizations, this paper proposes a design where higher layers of systems build structural knowledge to seamlessly integrate agents and avoid the pitfalls of abrupt failures, environmental changes, or knowledge loss, especially with new or varied data classes [21], [22].
Adaptive MAS networks leverage online learning strategies to dynamically respond to environmental changes, highlighting the importance of distributed and collaborative learning [23].
[24] introduce a system utilizing reinforcement learning to align agent actions with collective goals, minimizing human oversight. Agents are organized into “sub-worlds” for focused collaboration, yet the application of reinforcement learning in complex scenarios with varied sensors and methods encounters obstacles such as unclear rewards and limited exploration, which hinders the required diversity of learning [24]–[26].
Organizational learning considers agents evolving through both personal and collective learning efforts, enhancing agents’ abilities in MAS through management mediated interactions and task alignment to boost system efficiency [27], [28]. This model emphasizes the role of knowledge sharing in improving workflows and establishing structural knowledge, crucial for system resilience. Social science research [29] reflects on the applicability of this framework to understand the impact of staff turnover on management, analogous to agent dynamics in open MAS.
Hierarchical learning [30] uses hierarchical MAS to streamline model training in various geographical locations. By modeling challenges as a hypergraph, the system organizes agents, each with unique skills and knowledge, into a structured multitiered network. This design not only facilitates the decentralized handling of ML algorithms and data, but also significantly improves the efficiency and scalability of processing large distributed datasets.
In the context of distributed ML, [31] pioneered Federated Learning (FL) to train neural networks in distributed datasets, prioritizing data privacy and computational efficiency. However, FL faces hurdles in communication and training reliability. Hierarchical FL addresses these by grouping users to improve FL security and efficiency through group-specific updates [32]. Personalized FL [33] methods aim to produce personalized models for different users or groups of users [34] to keep track of their individualized requirements. Hierarchy has also been instrumental in Fog Learning. Unlike FL, which is based on a star topology of device-server interactions, Fog Learning explicitly considers the network and topology structures among devices and enables intelligent device collaborations through data and parameter offloading [35].
[6] abstract FL and CSBAD with HoL, applying holonic principles to a collaborative learning framework. In that sense, FL and CSBAD can be seen as a first-order HoL. HoL enhances model cooperation with specific strategies for aggregation, communication, and commitment within holons, facilitating complex yet intuitive collaboration of nodes compared to Fog Learning. In this balance between local autonomy and coordinated decision making, holonic systems are better equipped to tackle challenges such as adaptability, and scalability.
HoL does not specify how learning agents should (re)organize, nor how a system can seamlessly expand to new domains or safely unlearn obsolete ones; shortcomings that become acute in applications requiring auto-scaling and auto-tuning [6], [36].
Agent-oriented software engineering addresses the limitations of traditional methods like UML in managing complex, distributed, expanding and self-adaptive systems [5], [8], [11], [14], [36]–[39]. Organizational theory from social science inspired software designers who developed methodologies for the development of MAS to break down design complexity via 1) the use of metaphors that are more accessible to software engineers and 2) a focus on high levels of abstraction to enable the integration of new agents, even when they differ significantly from existing ones [40]–[42]. In fact, MASs are best viewed as organizational structures of autonomous, proactive agents interacting to achieve shared or individual goals [40].
Many agent-oriented methodologies have been developed last decades, such as, ADELFE [39], [43], ASPECS [44], Gaia [45], INGENIAS [46], PASSI [47], Pro-metheus [48], SODA [49], Tropos [50], MOISE [51]. Each has its own specificities: ADELFE is dedicated to adaptive system and cooperative agents design, ASPECS is dedicated to holonic multi-agent systems, Gaia focuses on static organization and roles, whereas PASSI focuses on agent social aspects thanks to ontology, SODA highlights the notion of environment. MOISE focuses on explicit organisational modelling—defining roles, groups, missions, and deontic norms—to balance agent autonomy and coordinated behaviour.
Given our choice of the holonic learning paradigm, we adopt the ASPECS methodology [44].
We address scalability limitations of continuous adaptation in machine learning systems by enriching the holonic learning paradigm with organizations and roles. These concepts provide an abstract interaction pattern that improves the architecture’s robustness and flexibility. Furthermore, our Teacher–Student stream-based distillation scheme supplies pseudo-labels that calibrate online incoming Students, thereby enabling auto-tuning. Finally, self-organization emerges from a specificity–diversity trade-off among Students, while integration and deletion protocols dynamically scale sensor subsystems. Collectively, these mechanisms yield the first HoL variant that supports self-organization and auto-scaling.
We seek a design that minimizes refactoring and supports isolated updates, simplifying the integration of a new sensor, model, or more generally a subsystem of sensors and models [4], [19]. From the literature, we derived five main recommendations to design scalable, multimethod learning systems:
Establish standardized interaction protocols, aggregation strategies, commitment, and communication patterns within components. This facilitates the integration of new units, as they only need to understand their role and communication methods within the system, regardless of their operating mode [9], [11].
Render a method, a sensor, or by construction a subsystem as independent and self-contained as possible to limit the complexity between units. This aims to simplify a local update or maintenance [11], [37], [39].
Recursively divide a system into subsystems based on a key criterion. This prevents the propagation of disturbances [9]. Furthermore, integration of a new component requires less communication as it requires only coordination with the upper layers of the system instead of with each subsystem [8].
Place units at certain levels of the hierarchy and provide representations of how other levels can contribute “information” or “models”. This division simplifies the complexity of programming, allowing designers to focus on each module and facilitating reuse between different systems [8].
Exploit Active Distillation, where each Student unit collects data on the fly from its streams to train on them. Training is performed by querying a model Teacher [18].
Given our choice of the organizational holonic paradigm, we adopt the ASPECS methodology [44]. The latter starts by defining an Organization, which denotes a subsystem in which components play a role and interact to achieve a shared goal in the context of this organization. Next, the Roles which are both expected behaviors to fulfill (part of) requirements, and status to the role’s agent in the organization (Section 3.1). The subsequent activity (Section 3.2) is the definition of relationships between superholons (higher-level entities) and subholons (lower-level entities). As a reference later, a holarchy denotes the hierarchy of self-regulating holons.
Building on the Active Distillation framework and the specificity-diversity trade-off from [2], we developed an organizational model that incorporates the roles of Specialized Student and Teacher, as illustrated in Fig. 2.
The Specialized Student role is designed to continuously collect data on subparts of the system’s deployment environment. Under the oversight of a higher-order Teacher entity, these Students learn from these data, adapting their models’ weights accordingly.
The section begins with introducing a new notation. Then we present an example of a three-tiered holarchy structure. Each level of this holarchy is a possible instance of an organization defined in Section 3.1. To provide a more holistic perspective, we depict the Cyber-Physical Platform (CPP) data processing organization (see our previous work [14]) alongside the TSS but CPP is not the main focus of this paper1.
A holarchy \(\mathcal{H}^L_{\boldsymbol{\textit{O}}}\) includes up to \(L\) vertical layers instantiating an organization O. A holon \(i\) in layer \(l\), where \(l\) ranges from \(0\) to \(L\), is denoted by \(\hbar^l_i\) and comprises:
\(\mathbf{\mathrm{X}}^l_i\): Set of operating data streams of a holon \(\hbar^l_i\).
\(\mathcal{T}^l_i\): Training set of a holon \(\hbar^l_i\).
\(\mathcal{V}^l_i\): Validation set of a holon \(\hbar^l_i\).
\(\theta^{\hbar^l_i}\): Processing model of a holon \(\hbar^l_i\).
\(\mathsf{SUB}^l_i\): Inner members corresponding to layer \(l-1\) of a holon \(\hbar^l_i\).
\(\mathsf{SUP}^l_i\): Superior holon of a holon \(\hbar^l_i\).
The system architecture, shown in Fig. 3, includes two holarchies: \(\mathcal{H}^3_{\boldsymbol{\textit{CPP}}}\) that processes data on three levels and \(\mathcal{H}^2_{\boldsymbol{\textit{TSS}}}\) managing knowledge on two levels.
At level 0: agents are the primary functional layer. They employ models designed for specific data streams. Proximity to other agents, geographically or related to the task, allows them to merge outputs and reduce errors. For example, \(\hbar^0_1\) and \(\hbar^0_2\) form Group G1 to fuse their outputs to feed the data request of a higher-order holon \(\hbar^1_1\).
However, agents monitoring the same area may employ different models if their functions require learning different features. Consequently, \(\hbar^0_2\) and \(\hbar^0_3\), as Specialized Students, form Group G4 to learn a shared model under the supervision of a Teacher holon via Group G5.
At levels 1 and 2: higher levels above the agents integrate and synthesize data from specific areas of the system (e.g., data streams that share attributes). The holons in the role Observer, such as \(\hbar^1_1\) and \(\hbar^2_1\), elevate the collected data to a new semantic level.
Holon \(\hbar^1_2\), a higher order Specialized Student, aggregates validation sets from \(\hbar^0_2\) and \(\hbar^0_3\) (i.e.,\(\mathcal{T}^1_2 = \mathcal{V}^0_2 \cup \mathcal{V}^0_3\)), to create a broader and generalized model.
Generally, each semantic level consolidates knowledge across broader areas of the system, fostering a holistic view, such as city-scale tracking. Meanwhile, intermediate layers consisting of Specialized Students synthesize knowledge from lower levels, to deepen collective task understanding and increase holons’ universality.
This section presents mechanisms to create a multilevel learning framework. Next, it introduces a mechanism to incorporate new nodes by coordinating with the top layers and assigning each new node to the group whose DNN model is most accurate in its data stream.
In the holonic terminology, holonification is the process of grouping agents into a holarchy, resembling complex clustering based on criteria like capabilities and resource access [12], [13].
In this Section, we propose a multi-tiered learning structure (illustrated in Fig. 1), comprising a portfolio of models that range from sensor-specific to universal, deployable across the entire network. Specifically, upper-layer models are trained on larger datasets for broader coverage, while lower-layer models use smaller, more similar datasets for increased specificity. Having intermediate models at various levels of granularity not only ensures adaptability, but also supports robust knowledge organization. For example, city-wide vehicle detection may require multiple models specializing in certain domain representations [2]. However, these domain-specific models benefit from interactions with peer models or a more fundamental model that develops a fundamental understanding of object detection tasks [20]. Our agent-based modeling offers this flexibility to develop these vertical and horizontal interactions.
Formally, each holon in a layer \(l > 0\) is allocated a budget \(B^l\;= B_0 \cdot 10^l\), where \(B_0\) represents the number of images used for model fine-tuning. This budget limits the training of each layer to at most \(10^l\) from the preceding levels, ensuring that the size of the data set of any holon \(\hbar^l_i\) does not exceed \(B^l\),i.e.,\(|\mathcal{T}^l_i|\leq B^l\).
To merge holons, we adopt the premise from [2] that models with similar performance have learned from comparable data.
The remainder of this section describes the holonification process.
Assuming holons can transfer their model weights to each other within the same layer. Each holon \(\hbar^l_i\) computes a performance vector \(P_i\) by evaluating the effectiveness of models from other holons and itself in the same layer on its own validation data \(\mathcal{V}^{l}_i\), according to Equation 1 . \[\label{eq:crossperformancevector} P^{l}_i := \left[\begin{array}{c} f\left(\theta^{l}_1, \mathcal{V}^{l}_{i}\right); \cdots ; f\left(\theta^{l}_{N^l}, \mathcal{V}^{l}_{i}\right) \end{array}\right]^{T}\tag{1}\]
Where \(\theta_j\) denotes the model parameters of the \(j\)-th holon \(\hbar^l_j\), \(j \in 1,\cdots, N^l\) and \(f(\theta, \mathcal{V})\) the score of a model performance \(\theta\) against a validation set \(\mathcal{V}\).
To quantify the differences between models trained in different domains, holons broadcast their cross-perfor-mance vectors \(P^l_i\) defined in Equation 1 and compute a pairwise distance between their performance in the datasets and the performance of the other holons. Generally, for a holon \(\hbar^l_i\), the distance to a holon \(\hbar^l_j\) is given by Equation 2 . \[\label{eq:distancematrixHolonic} D_i(\hbar^l_j) = \sqrt{\sum_{k=1}^{N^l} (P^l_{ik} - P^l_{jk})^2}\tag{2}\]
The merging of the holons is an iterative process. The set of holons \(\{\hbar^l_1,\cdots,\hbar^l_{N^l} \}\) creates a higher-order holarchy \(\mathcal{H}^{l+1}\) to which they belong.
At each iteration, the set of holons \(\hbar^{l}\) transmits their smallest linkage distance. This is defined as the minimal distance between the inner members of the holons. Formally, for two holons \(\hbar^{l}_A\) and \(\hbar^{l}_B\), the single link distance \(L(\hbar^{l}_A, \hbar^{l}_B)\) is given by Equation 3 . \[\label{eq:linkageHolonic} L(\hbar^{l}_A, \hbar^{l}_B) = \min \{ D_{ij} : \hbar^{l-1}_i \in \mathsf{SUB}(\hbar^{l}_A), \; \hbar^{l-1}_j \in \mathsf{SUB}(\hbar^{l}_B) \}\tag{3}\]
After all linkages are evaluated, the pair with the smallest distance merges, involving a combination of their datasets. After merging, the set of holons has decreased, \(\{\hbar^l_1,\cdots,\hbar^l_{N^l-1} \}\), and the linkage distances are updated for all agents.
The process ends if there remains only one holon or if the previous merge leads to a holon with a dataset size that exceeds \(B^{l+1}\). In the second scenario, the process goes back to STEP 1 for the set \(\{\hbar^{l+1}_1,\cdots,\hbar^l_{N^{l+1}}\}\).
The final steps consist in training the cluster models on the aggregated data sets.
A new holon \(\hbar_+\) joins a holarchy \(\mathcal{H}^L\) of \(L\) levels. Its integration starts at the highest hierarchical level, \(L\), and progresses downward to the level \(1\). At each level, \(\hbar_+\) is associated with the holon \(\hbar^1_*\) that shows the highest performance in the new set of unit validations, \(\mathcal{V}_+\), subject to meeting budget constraints, i.e.,\(|\mathcal{T}^{l}_* \cup \mathcal{T}_+| \leq B^l\). Once integrated, \(\hbar_+\)’s dataset merges with that of the selected holon, \(\hbar^l_*\), necessitating a retraining of the aggregated dataset. If no appropriate holons are available at a required level, the system can initiate reholonification, integrating \(\hbar_+\) with the set \(\{\hbar^l_1,\cdots,\hbar^l_{N^l}\}\). A pseudocode is provided in Algorithm 4.
The cost of holonification is compared to integration on-the-fly on the basis of the amount of communication between the holons. It is built on a single linkage-Hierarchical Clustering, with a complexity of \(\mathcal{O}\left(N^2\right)\) [53].
On the other hand, the on-the-fly mechanism has a \(\mathcal{O}(N+L)\) complexity. This corresponds to the worst-case scenario in which the new agent is compared to all holons from the upper layer \(L\) to layer 0. This mechanism thus offers a cost-effective integration in comparison with a reholonification.
From the setup and challenges described above, we formulate the following research questions:
Given a new data stream, how can we determine the most suitable existing model for fine-tuning?
Assume an effective integration of new sensors based on similarity with a group of sensors from the system:
What are the consequences on model accuracy upon the integration of a new agent?
How does the accuracy of the model scale when incrementally integrating \(N_+\) new agents versus performing a full system reorganization?
What are the long-term accuracy trade-offs between retaining versus discarding data from removed sensors?
The datasets, the training procedure, and the evaluation protocol are presented in this Section.
We used two city-focused video datasets for a total of 16 cameras.
features footage from nine static cameras over 1–4 weeks. Sampling rates vary (5,000–40,000 frames/week), with temporal bursts and diverse weather conditions (snow, rain, day/night).
features seven annotated videos, each approximately five minutes at 10 FPS. Camera angles and sensor types vary (vertical, dome, PTZ), ensuring coverage of multiple representation contexts.
We follow SBAD [2] sampling 256 images per camera. A large YOLOv8x6 Teacher (261.1 GFLOPs) pseudolabels these samples. Each Student model is a YOLOv8n (8.7 GFLOPs), initialized with COCO weights [56], then fine-tuned at a learning rate of 0.01 (unless otherwise indicated).
We report the “mAP50-95" as the mean Average Precision across various intersection over union thresholds, spanning from 0.50 to 0.95 in increments of 0.05 . We evaluated the holon’s performance on its associated datasets.
We begin by evaluating our holonification approach under different budgets and then proceed with incremental integration, departure handling, and knowledge-transfer experiments.
We conducted a holonification, as proposed in Section 4.1, on a dataset comprising sixteen cameras. We set a multilayer budget framework \(B^l = 256 \cdot 10^l\), implying that layer 0 holons do not exceed 256 training samples, and successive layers cannot exceed \(10^l\) sub-holons for a holon \(\hbar^l\).
| Layer | \(\mathbf{B^l}\) | mAP50-95 | Holonic Structure |
|---|---|---|---|
| 2 | 25600 | 0.65 | \(\mathcal{H}^2:\{\hbar^1_0, \hbar^{1}_{1},\hbar^{1}_{2}\}\) |
| 2560 | 0.66 | \(\begin{aligned} &\mathcal{H}^1_0:\{\hbar^0_0, \hbar^{0}_{1}, \hbar^{0}_{2},\hbar^{0}_{8}\} \\ \addlinespace &\mathcal{H}^1_1:\{\hbar^0_3, \hbar^{0}_{4}, \hbar^{0}_{5},\hbar^{0}_{6},\hbar^{0}_{7}\} \\ \addlinespace &\mathcal{H}^1_2:\{\hbar^0_{9}, \hbar^{0}_{10}, \hbar^{0}_{11},\hbar^{0}_{12},\hbar^{0}_{13},\hbar^{0}_{14},\hbar^{0}_{15}\} \end{aligned}\) | |
| 0 | 256 | 0.67 | \(\mathcal{H}^1:\{\hbar^0_0,\ldots, \hbar^{0}_{15}\}\) |
| \(\text{YOLOv8n}^{\text{COCO}}\) | N.A | 0.498 | N.A |
Table 1 confirms that the models require specificity to achieve maximum performance.
The transferability of holons across new, although similar, domains is investigated. Table 2 details the performance results for models trained in an all-but-one combination of domains as well as across all domains.
| \(f(\theta, \mathcal{V}_i)\) | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2-5 Cluster | \(\mathcal{V}^0_0\) | \(\mathcal{V}^0_1\) | \(\mathcal{V}^0_2\) | \(\mathcal{V}^0_3\) | ||||||||
| \(\theta^{\mathcal{H}^1_1 \; \backslash \; \{\hbar^0_0\}}\) | 0.38 | 0.65 | 0.65 | 0.47 | ||||||||
| \(\theta^{\mathcal{H}^1_1 \; \backslash \; \{\hbar^0_1\}}\) | 0.46 | 0.57 | 0.66 | 0.46 | ||||||||
| \(\theta^{\mathcal{H}^1_1 \; \backslash \; \{\hbar^0_2\}}\) | 0.49 | 0.66 | 0.65 | 0.48 | ||||||||
| \(\theta^{\mathcal{H}^1_1 \; \backslash \; \{\hbar^0_8\}}\) | 0.47 | 0.64 | 0.66 | 0.42 | ||||||||
| \(\theta^{\mathcal{H}^1_1}\) | 0.46 | 0.65 | 0.66 | 0.47 | ||||||||
The results indicate that models struggle to transfer, even across similar camera domains, reinforcing the need to integrate the newcomer in a cluster, and the local retraining the cluster.
We evaluated the impact of integrating \(N_+\) new units into a holonified system, structured with budget limits of \(B^l= 256 \cdot 10^l\). Using our integration mechanism described in Algorithm 4, we evaluated two scenarios: integrating one (\(N_+\)= 1) and three (\(N_+\)= 3) additional agents.
In 16 agent configurations, the incremental integration maintained an average mAP50-95 of \(0.66 \pm 0.003\) (\(N_+\)= 1) and \(0.66 \pm 0.006\) (\(N_+\)= 3), showing no degradation compared to the baseline in Table 1.
When a sensor \(\hbar^0_i\) leaves, its data \(\mathcal{T}_i\) may be retained or discarded. We successively simulate the exit of each agent and track the accuracy of the global model on (i) remaining and (ii) left sensors. As Fig. 5 shows, removing a sensor’s data yields small gains for the remaining sensors, but severely reduces performance if that sensor later re-enters the system. Note that, upon the departure of an agent, their data set \(\mathcal{T}^0_i\) is removed from the collective data set \(\mathcal{T}^2\), and the model is re-trained for 10,000 iterations at a learning rate of 0.005.
We test how effectively a holon trained on existing cameras can accelerate training and improve the peak accuracy of a newcomer domain. Specifically, we conducted 16 trials, each excluding one camera from the data set to simulate a “newcomer”. The following pre-trained models serve as initial weights:
\(\theta^2\): Global holon (trained on 15 cameras),
\(\theta^1_*\): Group-specific holon,
YOLOv8n\(^\text{COCO}\): General-purpose off-the-shelf model.
Fig. 6 shows that \(\theta^2\) or \(\theta^1_*\) consistently outperform the generic COCO baseline when fine-tuning the newcomer camera. Training spanned 5 epochs with a learning rate of 0.005.
Our experiments confirm that a certain level of domain specificity improves accuracy (Section 6.1), though it also increases the number of models to maintain. Budget constraints help contain this growth but can reduce performance gains from specialized holons. Meanwhile, leveraging broader universal models accelerates learning for new domains (Section 6.3).
In the context of open systems (Section 6.2), our sanity check shows that a straightforward model transfer performs under, even when the model comes from similar domains. The observed performance gap motivated the development of integration mechanisms, which proved effective, but the experiments do not provide conclusive evidence regarding the maximum number of agents that can be integrated without a performance decline. Finally, agent departure highlights a trade-off between short-term gains and relearning costs if the environment reappears. In other words, discarding data should be considered in terms of agents’ turnover rate.
Machine learning based models are also subject to feedback loops, where data and interactions with the external world influence their behavior in unintentional ways [4]. The subsequent design of machine learning systems should account for the fact that their behavior evolves with environmental data and user interactions. This includes providing control mechanisms to avoid the accumulation of errors due to the self-supervised nature of the system.
We need to further stress test the system; that is, starting with a system of size \(N\), stress tests can evaluate how many new components (\(N_+\)) can be integrated without compromising the quality of service.
Modern systems integrate heterogeneous approaches (e.g., physics-based modeling vs. deep learning) and diverse sensing modalities (e.g., cameras, radar), producing richer analytics [14], [57]. Our architecture abstracts the holonic paradigm sufficiently to accommodate such heterogeneity. However, specialized coordination modules could further optimize collaborative performance among different modalities.
We present an organizational holonic learning design coupled with active learning to address the challenges of scaling learning in multisensor networks. Our self-organization mechanism, grounded in the specificity-diversity trade-off, allows for the establishment of various granularity levels and handles sensor addition and removal while maintaining strong predictive performance. Experimental results highlight the benefits of vertical and horizontal knowledge transfer, although more stress testing is needed to refine the upper limits on system growth. We also note that self-supervised processes risk model drift without robust monitoring, which may cause issues in autoscaling and autotuning. Future work aims to design colearning mechanisms for heterogeneous methods.
This work was partially funded by PIT ATMP - Convention 8881. T. Bary is funded by the MedReSyst project, supported by FEDER and the Walloon Region.
The authors have no competing interests to declare that are relevant to the content of this article.
As a more detailed context, CPP is designed to respond to external requests with perceptions and to manage its finite resources to ensure fair access across multiple surveillance operations. The Resource Provider role ensures a fair distribution of the resources among all parties. The Observer role has the ability to produce perceptions thanks to the data acquired by the Sensor role. The data acquisition could be based on another CPP.↩︎