A Bearing-Strength Method for Motion Estimation
of Unknown Energy Emitters


Abstract

This paper studies motion estimation of moving energy emitters using passive sensors. The emitters may be light, acoustic, or radio sources. While the bearing vector pointing from the sensor to the emitter can be easily obtained, existing approaches mainly rely on the bearing-only motion estimation method. However, this method suffers from a fundamental limitation that the sensor must have lateral motion to ensure observability. Unfortunately, this lateral motion requirement often conflicts with the sensor’s desired motion in many tasks. In this paper, we point out that the received signal strength, which can also be obtained easily in many ways, can greatly enhance motion estimation. Surprisingly, this strength information has not been well explored so far. Here, we propose a new bearing-strength method to fully exploit both the bearing and strength measurements. Our theoretical analysis shows that the system observability is significantly enhanced in the sense that the lateral motion condition is not required anymore. Real-world experimental results verify the proposed method and the theoretical analysis. It is notable that the benefit of the proposed method comes with no additional cost since it simply utilizes the received strength information that has not been fully exploited in the past.

1 INTRODUCTION↩︎

This paper studies the problem of estimating the motion of a moving emitter using a moving passive sensor. The emitter may be a light, acoustic, or radio source, whose true transmit power is unknown in advance. The specific motivation for our study is aerial target pursuit, where one flying MAV (micro aerial vehicle) uses its onboard device to detect, localize, and capture another flying target MAV [1], [2]. Our recent works proposed motion estimation methods based on RGB vision detection of MAVs [3]. However, it is nontrivial to obtain highly reliable RGB vision detection results in complex scenarios [4][6]. We therefore have been exploring other types of measurements, such as signal strength for target motion estimation. Beyond aerial target pursuit, the study in this paper is also applicable to other tasks since emitter localization is a fundamental problem that widely exists in many applications [7], [8].

A passive sensor usually can obtain two types of valuable information about emitters (see Fig. 1).

The first is the bearing vector pointing from the sensor to the emitter. For acoustic and radio sources, the bearing vector can be obtained based on sensor arrays  [9], [10]. For light sources, the bearing vector can be obtained from the pixel coordinate of the emitter’s image [3]. Using the bearing vector to estimate the emitter’s motion is known as the bearing-only method, which was initially developed for estimating the motion of ships [7] and regained attention in recent years in vision-based motion estimation [3], [11], [12]. A limitation of the traditional bearing-only method is that the sensor must move in the lateral direction that is orthogonal to the bearing vector [13]. Such lateral motion usually conflicts with the desired motion of the sensor in many tasks [12]. It is therefore important to study other ways that can ensure observability while avoiding unfavorable lateral motion.

Our recent work [3] explored a bearing-angle approach to address the observability deficiency in radial directions by utilizing the target’s apparent orientation. While effective, the bearing-angle method [3] necessitates sophisticated image recognition to extract the target’s geometric features, which imposes a significant computational burden on resource-constrained MAV platforms. Furthermore, the reliability of angle extraction degrades substantially in low-light environments or complex backgrounds where target silhouettes are blurred.

Figure 1: A moving camera observes a moving light source. The bearing \tilde{g} and gray value \tilde{n} can be obtained based on the brightest optical flare in the image.

The second type of information is the received signal strength (RSS). For a point-like emitter, the received strength is inversely proportional to the square of the distance to the emitter [14] (see Fig. 2). As a result, the received strength is jointly determined by the emitter’s distance and transmit power. The RSS measurement has been widely used in node localization problems within wireless sensor networks, where multiple sensor devices are used simultaneously [8], [15], [16]. However, they cannot handle the case where there is only one passive sensor. Also, surprisingly, the RSS-like measurement has not been adopted to estimate the motion of light sources up to now, to the best of our knowledge.

Figure 2: The strength of point-like energy emitters measured by passive sensors is inversely proportional to the square of their distance.

This paper proposes a novel bearing-strength method that exploits both bearing and received strength measurements. Compared to our recent bearing-angle approach [3], which enhances observability through geometric features, the proposed method offers several distinct advantages. First, by relying on pixel intensity (RSS) rather than complex geometry, it significantly reduces the computational overhead, making it more suitable for resource-constrained MAVs. Second, detecting a light spot for strength measurement is inherently more robust in low-light conditions, where high contrast facilitates detection even when the target’s silhouette is indiscernible. Finally, we theoretically demonstrate that the bearing-strength method provides a direct physical constraint on the radial distance, ensuring observability without the need for lateral motion.

The technical novelties of this framework are detailed as follows:

First, the strength measurement does not directly infer the emitter’s distance, as the original emitter’s power is unknown. It is therefore nontrivial to utilize the received strength measurement. The key here is to convert the nonlinear strength measurement to be pseudo-linear. Moreover, we augment the state vector that consists of the emitter’s position and velocity by a new strength variable corresponding to the unknown transmit power of the emitter. Then, pseudo-linear Kalman filtering is applied to fuse the measurements and estimate the emitter’s motion.

Second, although a new strength measurement is introduced to the estimator, an additional unknown about the emitter’s power should also be estimated. It is therefore nontrivial to see how the additional strength measurement can help improve the system’s observability. We conduct a theoretical analysis and show that the observability is ensured if and only if the sensor has higher-order motion than the emitter. This condition does not require the sensor to move in the lateral direction that is orthogonal to the bearing vector, significantly weakening the observability condition.

Third, our method is general in the sense that it can apply to various energy emitters such as acoustic, radio, and light sources. However, this paper considers a special yet important energy emitter: light sources. We show that a grayscale camera can be used as a luminance meter to sense the strength of the light source. Our experiments show that the gray value of the light source’s image is proportional to the received light strength [17]. Moreover, the detection of the optical flare in a grayscale image is usually much easier than detecting a complex object in an RGB image.

Real-world experiments have verified the effectiveness of the bearing-strength method and the theoretical observability analysis. It is notable that the benefit of the proposed method comes with no additional cost since it simply exploits the received strength information that has not been fully exploited in the past.

2 Problem Statement↩︎

Energy emitters exhibit different radiation patterns depending on their physical nature. Acoustic and radio sources are often treated as isotropic point sources in many applications. In contrast, light sources typically exhibit anisotropy. However, our proposed bearing-strength framework is designed to be general enough to handle both cases.

We consider a special yet important type of emitters, light sources, in the rest of the paper, although the proposed method is also applicable to other types of emitters. Consider a light source that moves in 3D space. We suppose the light source is a point mass. Even if the light source occupies a certain volume, it can still be approximated as a point mass when observed from a distance. Denote the emitter’s position and velocity as \(p_e\in\mathbb{R}^3\) and \(v_e\in\mathbb{R}^3\), respectively. They are the two unknowns that we aim to estimate.

The passive sensor is a monocular grayscale camera. When a camera observes a light source, an optical flare appears in the image. The optical flare can be detected in the image in various ways. For example, we can select the brightest pixel. In general, it is easier to detect the optimal flare than to detect a complex object in an RGB image [5], [6]. Notably, the use of optical flares offers the advantage of handling low-light conditions. Optical filters may be used under challenging lighting conditions, which is not in the scope of this paper. Moreover, the sensor’s pose is assumed to be available. This is a reasonable assumption in many applications where it can be either obtained via RTK GPS [3], [12] or estimated by visual inertial odometry [18].

Two types of useful information can be extracted from the optical flare in the image. The first information is the bearing measurement. Let the unit vector \(\tilde{g}\in\mathbb{R}^3\) represent the bearing vector pointing from the camera to the emitter. It can be calculated based on the pixel coordinate of the optical flare in the image \(q_\mathrm{pix}=[x_\mathrm{pix}, y_\mathrm{pix}, 1]^\mathrm{T}\in\mathbb{R}^3\), the intrinsic parameter matrix of the camera \(P_\mathrm{cam}\), and the attitude of the camera \(R_\mathrm{c}^\mathrm{w}\in\mathbb{R}^3\) [3]: \[\begin{align} \tilde{g}=\dfrac{R_\mathrm{c}^\mathrm{w}P_\mathrm{cam}^{-1}q_\mathrm{pix}}{\|R_\mathrm{c}^\mathrm{w}P_\mathrm{cam}^{-1}q_\mathrm{pix}\|}\in\mathbb{R}^3. \end{align}\] The second piece of information is the received strength measurement. In particular, let \[\begin{align} \tilde{n}>0 \end{align}\] be the gray value of the pixel of the optical flare in the image. We will show later that \(\tilde{n}\) is proportional to the received light strength.

Our goal is to estimate the emitter’s position \(p_e\) and velocity \(v_e\) based on the noisy bearing vector \(\tilde{g}\), and the strength measurement \(\tilde{n}\), together with the sensor’s position \(p_s\).

3 Bearing-Strength Motion Estimator↩︎

This section presents the new bearing-strength motion estimator. The key is to establish appropriate measurement equations and state transition equations.

Figure 3: The architecture of the proposed bearing-strength method.

3.1 State transition equation↩︎

The emitter’s state vector is designed as \[\begin{align} x=\begin{bmatrix} p_e^\mathrm{T},v_e^\mathrm{T},\sqrt{n_e} \end{bmatrix}^\mathrm{T}\in\mathbb{R}^7. \end{align}\] Here \(n_e>0\) is an unknown scalar corresponding to the emitter’s power. Specifically, it equals the gray value of the optical flare in the image when the camera is one meter away from the light source. The square root for \(n_e\) is introduced to facilitate the subsequent pseudo-linearization of the nonlinear measurement equations.

It is common to model the emitter’s motion as a noise-driven discrete-time double integrator [3], [12]: \[\begin{align} \label{eq95state95transition} x(t_{k+1})=Fx(t_k)+Bq(t_k), \end{align}\tag{1}\] where \[\begin{align} F&=\begin{bmatrix} I_{3\times3} & \delta tI_{3\times3} & 0_{3\times 1} \\ 0_{3\times3} & I_{3\times3} & 0_{3\times 1} \\ 0_{1\times3} &0_{1\times3} &1 \end{bmatrix}\in\mathbb{R}^{7\times7},\\ B&=\begin{bmatrix} \dfrac{1}{2}\delta t^2I_{3\times3} & 0_{3\times 1} \\ \delta tI_{3\times 3} & 0_{3\times 1} \\ 0_{1\times 3} & 1 \end{bmatrix}\in\mathbb{R}^{7\times 4}. \end{align}\] Here, \(\delta t\) is the sampling time, and \(I\) and \(0\) are identity and zero matrices, respectively. Moreover, \(q\sim\mathcal{N}(0, \Sigma_q)\in\mathbb{R}^4\) is the process noise, whose covariance matrix is \(\Sigma_q = \text{diag}(\sigma_a^2, \sigma_a^2,\sigma_a^2,\sigma_{n}^2)\in\mathbb{R}^{4\times 4}\).

3.2 Nonlinear measurement equations↩︎

The bearing vector \(\tilde{g}\) and the gray value \(\tilde{n}\) are both nonlinear functions of the emitter’s position. In particular, \[\begin{align} \tilde{g}&=\dfrac{p_e-p_s}{r}+\mu_g,\tag{2}\\ \sqrt{\tilde{n}}&=\dfrac{\sqrt{n_e}}{r}+\mu_n, \tag{3} \end{align}\] where \(r=\|p_e-p_s\|\in\mathbb{R}\) is the distance between the emitter and the sensor. Here, \(\mu_g\sim\mathcal{N}(0,\sigma^2_gI_{3\times3})\in\mathbb{R}^3\) and \(\mu_n\sim\mathcal{N}(0, \sigma^2_n)\in\mathbb{R}\) are measurement noises. Noted that the additive noise \(\mu_g\) in 3 is obtained by transforming the original productive noise [12] and can be approximately treated as a Gaussian noise [3], [12].

Some remarks about 3 are given below. First, the camera parameters must be fixed all the time so that the gray values are proportional to the measured light strength [17], [19]. Second, the light strength obeys the inverse distance square law [14] (see Fig. 2). Detailed tests are shown in Fig. 5 (b).

3.3 Pseudo-linear measurement equations↩︎

First, we convert the nonlinear bearing measurement in 2 to be pseudo-linear. To do that, multiplying \(r(I-\tilde{g}\tilde{g}^\mathrm{T})\) on both sides of 2 yields \[\begin{align} \label{eq95g95pseudo} P_{\tilde{g}}p_s=P_{\tilde{g}}p_e + rP_{\tilde{g}}\mu_g, \end{align}\tag{4}\] where \(P_{\tilde{g}}=I-\tilde{g}\tilde{g}^\mathrm{T}\in\mathbb{R}^{3\times3}\) is an orthogonal projection matrix, which plays an important role in the bearing-based estimation problems [20]. Detailed pseudo-linear transformation of the bearing measurement in 2 is omitted due to space limitations and can be found in our previous works [3], [12], [21].

Second, we convert the nonlinear strength measurement in 3 to be pseudo-linear. Multiplying \(r\tilde{g}\) on both sides of 3 yields \[\begin{align} \label{eq95nd95tem2} r\tilde{g}\sqrt{\tilde{n}}=\tilde{g}\sqrt{n_e}+r\tilde{g}\mu_n. \end{align}\tag{5}\] It follows from 2 that \(r\tilde{g}=p_e-p_s+r\mu_g\), substituting which into the left side of 5 and reorganizing it gives \[\begin{align} \label{eq95nd95pseudo} \sqrt{\tilde{n}}p_s=\sqrt{\tilde{n}}p_e-\tilde{g}\sqrt{n_e} + r\left(\sqrt{\tilde{n}}\mu_g-\mu_n\tilde{g}\right). \end{align}\tag{6}\] Equations 4 and 6 are called “pseudo-linear” because the measurements also appear on the right-hand side of equations.

Combining 4 and 6 gives a compact matrix-vector form of the pseudo-linear measurement equation: \[\begin{align} \label{eq95final95measurement95eq} z=Hx+\nu, \end{align}\tag{7}\] where \[\begin{align} z&=\begin{bmatrix} P_{\tilde{g}}p_s \\ \sqrt{\tilde{n}}p_s \end{bmatrix}\in\mathbb{R}^6, \\ H&=\begin{bmatrix} P_{\tilde{g}} & 0_{3\times3} & 0_{3\times 1}\\ \sqrt{\tilde{n}}I_{3\times3} & 0_{3\times3} & -\tilde{g} \end{bmatrix}\in\mathbb{R}^{6\times 7}, \\ \nu&=r\begin{bmatrix} P_{\tilde{g}}\mu_g \\ \sqrt{\tilde{n}}\mu_g-\mu_n\tilde{g} \end{bmatrix}=E \begin{bmatrix} \mu_g \\ \mu_n \end{bmatrix}\in\mathbb{R}^{6}. \end{align}\] Here, \(\nu\) can be treated as a linear transformation of Gaussian noises with \[\begin{align} E = r\begin{bmatrix} P_{\tilde{g}}\mu_g & 0_{3\times 1}\\ \sqrt{\tilde{n}}I_{3\times 3} & -\tilde{g} \end{bmatrix}\in\mathbb{R}^{6\times 4}. \end{align}\] The covariance matrix of \(\nu\) can be calculated as \[\begin{align} \Sigma_\nu = E \begin{bmatrix} \sigma_g^2 I_{3\times3} & 0_{3\times 1}\\ 0_{1\times 3} & \sigma_n^2 \end{bmatrix}E^\mathrm{T}\in\mathbb{R}^{6\times 6}. \end{align}\]

With the state transition equation in 1 and the measurement equation in 7 , the bearing-strength estimator can be obtained based on the pseudo-linear Kalman filter framework [3], [21], [22].

4 Observability analysis↩︎

It is important to theoretically derive the observability condition of the bearing-strength method to determine whether the additional bearing-related measurement can enhance the system’s observability.

4.1 Problem formulation↩︎

The observability problem that we aim to solve is whether \(p_e(t)\) can be recovered from \(p_s(t)\), \(g(t)\), and \(n(t)\). We consider a general case where the motion of the emitter and the sensor can be described by \(k\)th-order polynomials: \[\begin{align} p_e(t) &= b_0 +b_1t +\cdots +b_kt^k,\\ p_s(t) & = c_0 + c_1t +\cdots +c_kt^k +h(t), \end{align}\] where, \(\{b_i\}^k_{i=0}\in\mathbb{R}^3\) are unknown constant vectors, \(\{c_i\}^k_{i=0}\in\mathbb{R}^3\) are known constant parameters, and \[\begin{align} \label{eq95ht} h(t) = d_1t^{k+1} + d_2t^{k+2} + \cdots \end{align}\tag{8}\] represents higher-order motion, where \(\{d_i\}^\infty_{i=k}\in\mathbb{R}^3\) are constant vectors. Let \(s(t)\in\mathbb{R}^3\) be the relative motion between the target and the observer: \[\begin{align} \label{eq95st} s(t)\dot{=}p_e(t)-p_s(t)=s_0+s_1t+\cdots+s_kt^k+h(t), \end{align}\tag{9}\] where \(s_i=b_i-c_i\in\mathbb{R}^3\).

If we can determine the values of \(\{s_i\}^k_{i=0}\), then \(\{b_i\}^k_{i=0}\) and hence the emitter’s motion can be determined. It follows from 2 and 3 that \(p_e(t) - p_s(t) = g(t)\sqrt{n_e/n(t)}\). Substituting it into 9 yields \[\begin{align} \label{eq95linear95eqs} s_0+s_1t+\cdots+s_kt^k+h(t)=g(t)\sqrt{n_e/n(t)}. \end{align}\tag{10}\] Here, \(s_i\) and \(n\) are unknowns to be determined and \(g(t)\), \(n(t)\), \(h(t)\) are known. Equation 10 can be reorganized into a matrix form: \[\begin{align} \label{eq95Linear95eq95matrix} A(t)X=h(t), \end{align}\tag{11}\] where \[\begin{align} A(t) &=\begin{bmatrix} I, tI, \cdots, t^kI, \rho(t) \end{bmatrix}\in\mathbb{R}^{3\times(3k+4)}, \label{eq95A2}\\ X &=\begin{bmatrix} s_0^\mathrm{T}, \cdots, s_k^\mathrm{T}, \sqrt{n_e} \end{bmatrix}^\mathrm{T}\in\mathbb{R}^{3k+4}. \end{align}\tag{12}\] Here, \(\rho(t)=-g(t)/\sqrt{n(t)}\in\mathbb{R}^3\). Therefore, the observability analysis problem becomes solving the linear equations 11 .

4.2 Observability condition↩︎

Equation 11 is under-determined. Continuously taking derivation on both sides of  11 , and combining them gives an over-determined system: \[\begin{align} \label{eq95barA95linear95eq} \bar{A}(t)X=\bar{h}(t), \end{align}\tag{13}\] where \[\begin{align} \bar{A} =\begin{bmatrix} A(t) \\ A^{'}(t) \\ \vdots \\ A^{(K)}(t) \end{bmatrix}, && \bar{h}(t) = \begin{bmatrix} h(t) \\ h^{'}(t) \\ \vdots \\ h^{(K)}(t) \end{bmatrix}. \end{align}\] Substituting 12 into \(\bar{A}(t)\) yields \[\begin{align} \bar{A}(t)\rightarrow \left[\begin{array}{cccc:c} I & tI & \cdots & t^kI & \rho(t) \\ 0 & I & \cdots & kt^{k-1}I & \rho^{'}{t}\\ \vdots & \vdots & \ddots & \vdots & \vdots \\ 0 & 0 & \cdots & k!I & \rho^{(k)}{t} \\ \hdashline 0 & 0 & \cdots & 0 & \rho^{(k+1)}{t} \\ \vdots & \vdots & \ddots & \vdots & \vdots \\ 0 & 0 & \cdots & 0 & \rho^{(K)}{t}\end{array}\right]. \end{align}\] As a result, \(\bar{A}(t)\) has full column rank if and only if there exists \(i\in\{k+1, \cdots, K\}\) such that \[\begin{align} \label{eq95condition1} \rho^{(i)}(t)\neq 0. \end{align}\tag{14}\] Since \(\rho(t)=-g(t)\sqrt{1/n(t)}\) as shown in 12 and \(g(t)\sqrt{n_e/n(t)}=s_0+s_1t+\cdots+s_kt^k+h(t)\) as shown in 10 , we can rewrite 14 to \[\begin{align} -\dfrac{1}{\sqrt{n_e}}(s_0+\cdots+s_kt^k+h(t))^{(i)}\neq 0_{3\times1}. \end{align}\] Since \(i\geq k+1\), the above equation is equivalent to \[\begin{align} \label{eq95condition2} h^{(i)}(t)\neq 0. \end{align}\tag{15}\] According to the definition of \(h(t)\) in 8 , the obsevability condition is \[\begin{align} h(t)\neq 0. \end{align}\]

a

b

Figure 4: Numerical simulation results..

In summary, the observability condition of the bearing-strength method is that the sensor has a higher-order motion than the emitter. A key improvement over the traditional bearing-only method is that this higher-order motion is no longer required to be orthogonal to the bearing vector. This added flexibility allows the bearing-strength method to estimate the emitter’s motion even in challenging scenarios, such as when the sensor moves directly towards the emitter.

Beyond the relaxed geometric requirements, this property also enhances the system’s robustness against the physical characteristics of the emitter. For instance, although some emitters like LEDs exhibit anisotropic radiation patterns (i.e., \(n = G(\theta, \phi) \cdot n_e / d^2\)), the relative orientation \((\theta, \phi)\) remains constant during the aforementioned radial trajectories. In such cases, the directional gain \(G(\theta, \phi)\) can be lumped into the unknown constant \(n'_e\). Since our filter is designed to estimate the unknown power online, it naturally compensates for the directional gain in these geometrically degenerate scenarios, where the bearing-only method typically fails.

5 Numerical Simulation Results↩︎

This section presents a set of numerical simulation results to demonstrate the effectiveness of the proposed bearing-strength approach.

The values of the parameters in the two estimators are selected as \(\sigma_v = 10^{-3}\), \(\sigma_n = 0.01\), and \(\sigma_\mu = 0.01\). The initial covariance matrix of the estimated states is set to \(P(t_0) = 0.1I\) for both methods. The target is modeled as a stationary light source with a normalized true emission power of \(n_e = 1\). The update rate of the system is \(50\text{ Hz}\). We perform \(N_x = 100\) Monte Carlo simulations for each scenario.

We use the normalized estimation error squared (NEES)[23] to analyze the consistency of the estimation algorithms. In particular, the value of the average NEES is \[\bar{\epsilon}_{\text{NEES}} = \frac{1}{N_x}\sum_{i=1}^{N_x} (x - \hat{x}_i)^T P_i^{-1} (x - \hat{x}_i),\] where \(\hat{x}_i\) is the estimated state vector in the \(i\)-th simulation, and \(P_i\) is the covariance matrix obtained from the estimator in the \(i\)-th simulation.

5.1 Scenario 1: Circular motion around the target↩︎

In the first scenario, the target is stationary and located at \(p_T = [0, 10]^T\). The observer moves on a circle centered at the target with a speed of \(3\text{ m/s}\) (see Fig.4 (a)). The radius of the circle is \(5\text{ m}\). The initial estimates of the observer’s states are \(\hat{p}_o(t_0) = [0, 13]^T\) and \(\hat{v}_o(t_0) = [0, 0]^T\). The initial guess for the square root of the target’s emission power is set to \(\sqrt{\hat{n}_e(t_0)} = \sqrt{1.6}\). During this process, the bearing vector varies continuously due to the circular trajectory, while the received signal strength varies slightly around a mean value due to the measurement noise. This scenario is favorable to the conventional bearing-only approach because its fundamental observability condition — viewing the target from different angles — is well satisfied.

Fig.4 (a) shows the estimation results obtained by the bearing-only and bearing-strength approaches. As can be seen, both algorithms perform well under this sufficient lateral excitation. The convergence of the bearing-strength approach is stable, and it successfully estimates the emission power of the target alongside its kinematic states.

5.2 Scenario 2: Straight motion towards the target↩︎

In the second scenario, the target is also stationary, but the observer moves along a straight line towards the target (see Fig.4 (b)). During this process, the bearing vector remains strictly constant, while the received signal strength increases rapidly as the distance decreases. This scenario is widely known as the most challenging case for the bearing-only approach because its observability condition (i.e., the requirement for lateral motion) is completely unfulfilled.

In this simulation scenario, the observer moves along a straight line towards the target with a constant acceleration of \(2\text{ m/s}^2\). The initial conditions are \(v_o(t_0) = [0, 4]^T\) and \(p_o(t_0) = [0, 5]^T\). The initial estimates are the same as those in Scenario 1. In this scenario, the true bearing of the target relative to the observer remains unchanged, causing a severe geometric singularity in traditional methods.

Fig.4 (b) shows the estimation results of the bearing-only and bearing-strength approaches. As theoretically expected, the conventional bearing-only approach diverges rapidly since its fundamental observability condition is not satisfied. By contrast, the proposed bearing-strength approach converges effectively. It is able to localize the target and precisely estimate its emission power, demonstrating the strong observability enhancement of the bearing-strength approach even under pure radial motion.

a

b

Figure 5: Experimental validation of sensor characteristics and the real-world tracking setup..

6 Real-World Experimental Results↩︎

This section presents two sets of real-world experimental results to verify the effectiveness of the proposed method.

6.1 Experimental setup↩︎

We intentionally selected light sources as the representative energy emitters for our real-world experiments. Light sources represent a more challenging case due to their inherent anisotropy and susceptibility to environmental light compared to other sources. If the bearing-strength method can effectively estimate the motion of such complex and non-ideal emitters, its performance on more isotropic sources, like acoustic or omnidirectional radio signals, can be reasonably expected to be even more robust, as the constant-power assumption would be more naturally satisfied across various observation angles.

The camera and the light source used in the experiments are shown in Fig. 5 (a). The sensor is a grayscale camera with a resolution of 640\(\times\)​480 pixels. The lens provides a 90-degree field of view with little distortion. The camera’s intrinsic parameters are calibrated beforehand. The camera’s exposure parameters, including ISO, aperture, and exposure time, are manually set in advance and remain fixed during the experiments, ensuring that the gray values are influenced only by received light strength. The Vicon motion capture system is used to provide the pose of the camera. This can be replaced by other positioning systems in practice. The position of the light source provided by Vicon is treated as the ground-truth value for calculating measurement noises (see the right subfigures of Fig. 6).

The experimental setup is shown in Fig. 5 (b). The camera is handheld by a human operator. The light source is mounted on a ground robot. The robot is manually controlled via a remote controller. Its speed ranges from 0.1 to 0.7 m/s, with an average speed of 0.2 m/s.

6.2 Image gray value vs. received light strength↩︎

Before conducting the experiments, we performed a preliminary test to verify the linear relationship between gray values and the received light strength. Both grayscale and RGB cameras are tested for comparison. The experimental setup is shown in Fig. 5 (a). The cameras are positioned in front of the light source, and their exposure times are adjusted to simulate a linear increase in the received light strength.

Fig. 5 (b) shows the curves that represent the relationship between gray values and exposure times. As can be seen, the gray value of the grayscale camera is proportional to the received strength, whereas the RGB camera does not follow this rule. This is because the ISP processing in RGB cameras, including white balance and gamma correction, alters the original gray values. These factors make the inverse square law invalid for the RGB camera. As a result, we use the grayscale camera in the following experiments.

6.3 Experimental results↩︎

a

b

Figure 6: Two experimental results..

Two sets of experiments have been conducted. Both bearing-only and bearing-strength estimators are implemented for comparison. We use the same parameter values in both estimators and across two experiments. The variances are selected as \(\sigma_a = 0.01\), \(\sigma_\text{strength}=10^{-4}\), \(\sigma_g = 0.2\), and \(\sigma_n = 2\). The initial covariance matrix of the estimated states is set to \(P(t_0)=4I\). The update rate of the estimator is 50 Hz. Regarding computational efficiency, the proposed bearing-strength method exhibits a sub-millisecond latency, offering a significant advantage over both conventional vision-based bearing-only and bearing-angle approaches [3]. While those baseline methods typically necessitate computationally heavy image recognition to identify the full target or extract complex geometric features, our approach simply tracks the brightest optical flare. This effectively eliminates the overhead of complex visual processing, making it highly efficient for resource-constrained platforms. Better performances can be achieved if the parameters are well-tuned for specific scenarios. This experiment is conducted in a low-light environment, allowing the light source to be detected by identifying the brightest point in the image.

The experimental results are shown in Fig. 6.

In the first experiment, the camera is held about 1.5 m above the ground and moves around the emitter. The distance between the sensor and the light source varies from 1.7 to 2.6 m. In this experiment, the bearing vector varies sufficiently, and hence the observability conditions for the bearing-only and bearing-strength methods are both well satisfied. As shown in Fig. 6 (a), both methods perform well, and the bearing-strength method performs slightly better than the bearing-only one.

In the second experiment, the camera moves approximately along the bearing vector close to and far from the light source periodically.

To quantitatively evaluate the stability and accuracy of the proposed bearing-strength method, the Root Mean Square Errors (RMSE) of the measurement residuals for both real-world experiments are summarized in Table ¿tbl:tab:real95rmse?.

Measurement Residual RMSE of the Bearing-Strength Method in Real-World Experiments
Scenario Bearing Error (\(^\circ\)) Pixel Value Error
Experiment 1 (Circular Motion) 2.02 23.2
Experiment 2 (Radial Motion) 2.51 24.3

In this experiment, the strength measurement \(\tilde{n}\) varies significantly, while the bearing does not. Without surprise, the bearing-only method performs unstably due to weak observability (Fig. 6 (b)). By contrast, the bearing-strength method performs stably due to its enhanced observability.

7 Discussion↩︎

While the proposed framework demonstrates strong performance, practical implementations must account for certain nonidealities.

First, regarding the RSS-distance mismatch, commercial cameras often introduce nonlinearities due to internal ISP algorithms. As validated in Section V-B, we mitigate this by employing a grayscale camera with fixed exposure. Other environmental nonidealities, such as light scattering or target anisotropy, could be addressed in future work by incorporating an environmental scattering coefficient into the measurement equations.

Second, regarding the unknown transmit power \(n_e\), if the emitter experiences slow power fluctuations like battery degradation, the estimator naturally tracks these changes as \(\sqrt{n_e}\) is explicitly estimated online. Rapid, high-frequency power variations would manifest as additional measurement noise, which the filter accommodates through the tuning of the noise covariance matrix \(\Sigma_\nu\).

8 Conclusion↩︎

Motivated by the limitations of the traditional bearing-only method, this paper proposed a novel bearing-strength method to estimate the motion of the moving energy emitter. We showed that the bearing-strength method significantly enhanced the system’s observability compared to the bearing-only method. The sensor’s extra lateral motion can be significantly relaxed. As shown in real-world experiments, the bearing-strength method can successfully estimate the emitter’s motion while the bearing-only method fails. The enhanced observability of the bearing-strength method comes with no additional costs since the received strength measurement inherently exists in passive sensors. Moreover, the proposed bearing-strength estimator is a unified method that can be applied to light, acoustic, and radio emitters.

References↩︎

[1]
M. Pliska, M. Vrba, T. Báča, and M. Saska, “Towards safe mid-air drone interception: Strategies for tracking & capture,” IEEE Robotics and Automation Letters, vol. 9, no. 10, pp. 8810–8817, 2024, doi: 10.1109/LRA.2024.3451768.
[2]
Z. Ning, Y. Zhang, X. Lin, and S. Zhao, “A real-to-sim-to-real approach for vision-based autonomous MAV-catching-MAV,” Unmanned Systems, vol. 12, no. 4, pp. 787–798, May 2024, doi: 10.1142/s2301385025500360.
[3]
Z. Ning, Y. Zhang, J. Li, Z. Chen, and S. Zhao, “A bearing-angle approach for unknown target motion analysis based on visual measurements,” The International Journal of Robotics Research, vol. 43, no. 8, pp. 1228–1249, Jul. 2024, doi: 10.1177/02783649241229172.
[4]
M. Vrba and M. Saska, “Marker-less micro aerial vehicle detection and localization using convolutional neural networks,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 2459–2466, Apr. 2020, doi: 10.1109/lra.2020.2972819.
[5]
H. Guo, Y. Zheng, Y. Zhang, Z. Gao, and S. Zhao, “Global-local MAV detection under challenging conditions based on appearance and motion,” IEEE Transactions on Intelligent Transportation Systems, 2024.
[6]
Y. Zhang, J. Deng, P. Liu, W. Li, and S. Zhao, “Domain adaptive detection of MAVs: A benchmark and noise suppression network,” IEEE Transactions on Automation Science and Engineering, 2024.
[7]
H. Hoelzer, G. Johnson, and A. Cohen, “Modified polar coordinates-the key to well behaved bearings only ranging,” IR & D Report, pp. 78–M19, 1978.
[8]
A. Zanella, “Best practice in RSS measurements and ranging,” IEEE Communications Surveys & Tutorials, vol. 18, no. 4, pp. 2662–2686, 2016.
[9]
L. Dressel and M. J. Kochenderfer, “Hunting drones with other drones: Tracking a moving radio target,” in 2019 international conference on robotics and automation (ICRA), May 2019, doi: 10.1109/icra.2019.8794243.
[10]
X. Shi, C. Yang, W. Xie, C. Liang, Z. Shi, and J. Chen, “Anti-drone system with multiple surveillance technologies: Architecture, implementation, and challenges,” IEEE Communications Magazine, vol. 56, no. 4, pp. 68–74, Apr. 2018, doi: 10.1109/mcom.2018.1700430.
[11]
S. He, H.-S. Shin, and A. Tsourdos, “Trajectory optimization for target localization with bearing-only measurement,” IEEE Transactions on Robotics, vol. 35, no. 3, pp. 653–668, Jun. 2019, doi: 10.1109/tro.2019.2896436.
[12]
J. Li, Z. Ning, S. He, C.-H. Lee, and S. Zhao, “Three-dimensional bearing-only target following via observability-enhanced helical guidance,” IEEE Transactions on Robotics, vol. 39, no. 2, pp. 1509–1526, Apr. 2023, doi: 10.1109/tro.2022.3218268.
[13]
E. Fogel and M. Gavish, “Nth-order dynamics target observability from angle measurements,” IEEE Transactions on Aerospace and Electronic Systems, vol. 24, no. 3, pp. 305–308, May 1988, doi: 10.1109/7.192098.
[14]
N. Voudoukis and S. Oikonomidis, “Inverse square law for light and radiation: A unifying educational approach,” vol. 2, pp. 23–27, Nov. 2017, doi: 10.24018/ejeng.2017.2.11.517.
[15]
G. Wang and K. Yang, “A new approach to sensor node localization using RSS measurements in wireless sensor networks,” IEEE Transactions on Wireless Communications, vol. 10, no. 5, pp. 1389–1395, 2011.
[16]
S. Tomic, M. Beko, and R. Dinis, 3-D target localization in wireless sensor networks using RSS and AoA measurements,” IEEE Transactions on Vehicular Technology, vol. 66, no. 4, pp. 3197–3210, 2016.
[17]
D. Wüller and H. Gabele, “The usage of digital cameras as luminance meters,” in Digital photography III, Feb. 2007, vol. 6502, p. 65020U, doi: 10.1117/12.703205.
[18]
K. Qiu, T. Qin, W. Gao, and S. Shen, “Tracking 3-D motion of dynamic objects using monocular visual-inertial sensing,” IEEE Transactions on Robotics, vol. 35, no. 4, pp. 799–816, Aug. 2019, doi: 10.1109/tro.2019.2909085.
[19]
P. D. Hiscocks and P. Eng, “Measuring luminance with a digital camera,” Syscomp Electronic Design Limited, vol. 2, 2011.
[20]
S. Zhao and D. Zelazo, “Bearing rigidity theory and its applications for control and estimation of network systems: Life beyond distance rigidity,” IEEE Control Systems Magazine, vol. 39, no. 2, pp. 66–83, Apr. 2019, doi: 10.1109/mcs.2018.2888681.
[21]
Z. Ning, Y. Zhang, and S. Zhao, “Comparison of different pseudo-linear estimators for vision-based target motion estimation,” Control Theory and Technology, vol. 21, no. 3, pp. 448–457, Aug. 2023, doi: 10.1007/s11768-023-00161-y.
[22]
G. Yu. Kulikov and M. V. Kulikova, “Moore-penrose-pseudo-inverse-based kalman-like filtering methods for estimation of stiff continuous-discrete stochastic systems with ill-conditioned measurements,” IET Control Theory & Applications, vol. 12, no. 16, pp. 2205–2212, Sep. 2018, doi: 10.1049/iet-cta.2018.5404.
[23]
Y. Bar-Shalom and X.-R. Li, “Estimation and tracking: Principles, techniques, and software,” IEEE Antennas and Propagation Magazine, vol. 38, no. 1, pp. 62–, 1996, doi: 10.1109/MAP.1996.491294.

  1. \(^\dagger\) Corresponding author↩︎

  2. All the authors are with the WINDY Lab in the School of Engineering at Westlake University, Hangzhou, China. S. Zhao is also with the Research Center for Industries of the Future, Westlake University, Hangzhou, China. {ningzian, chenhaoyu, zhangyin, zhaoshiyu}westlake.edu.cn?↩︎