Safety Quantitative Metrics for Military Drone Systems: An Equivalent Level of Safety Approach

The rapid and relentless advancement of military drone technology has fundamentally reshaped the modern battlespace. These systems have become indispensable components of contemporary warfare and military operations, inevitably altering the methods of military engagement and the patterns of military actions. However, a critical challenge persists: the accident rate for unmanned systems remains significantly higher than that for manned civil aviation. This reality confines most military drone operations to restricted airspace—within the bounds of testing and training ranges—or to active combat zones, where they must be carefully managed to avoid conflicts with manned aircraft. From the perspective of maintaining combat effectiveness, this high rate of catastrophic accidents severely undermines the sustained operational capability of military drone fleets.

Currently, the accident rate for military drones in service is alarmingly high. There is an urgent need within military drone development programs to comprehensively integrate system safety engineering principles to elevate safety standards. Within this framework, establishing quantitative safety metrics is of paramount importance. The inherent characteristics of military drones complicate this task. They exhibit vast differences in size and configuration. Furthermore, their operation, which is dependent on onboard flight control systems and/or data links, introduces additional, unique failure modes not present in manned aircraft. Consequently, even if a military drone (the air vehicle itself) were designed to the same safety requirements as a manned aircraft of similar size, it would likely exhibit a higher accident rate. Therefore, it is not appropriate to directly apply the safety risk criteria used for similarly-sized manned aircraft to military drone systems; alternative methods must be employed to formulate quantitative safety targets.

In the realm of establishing safety requirements for Unmanned Aircraft Systems (UAS), a guiding principle has been proposed by European joint aviation authorities: the airworthiness standards for UAS should be no lower than those currently applied to an equivalent type of manned aircraft. Simultaneously, these standards should not impose punitive, more stringent requirements on UAS simply due to technical biases. This principle of “Equivalent Level of Safety” (ELOS) forms the cornerstone of our approach. This article will establish quantitative safety metrics—specifically, the probability requirement for a catastrophic accident—for military drones by adhering to this principle of achieving a safety level equivalent to that of manned aviation.

Safety Levels in Manned Aviation

For manned aircraft, airworthiness standards prescribe different safety level requirements based on the type of aircraft. Compliance with these standards ensures that the aircraft’s systems and components are sufficiently reliable to meet a predefined “Target Level of Safety” (TLS). Below, we examine the safety levels for both civil and military manned aircraft.

Civil Aircraft Safety Requirements

For civil aircraft, safety objectives are embedded within the airworthiness regulations. For instance, in standards like FAA’s FAR Part 25 or EASA’s CS-25 (Transport Category Airplanes), the safety philosophy is managed through a risk matrix that correlates the severity of failure conditions with their maximum permissible probability of occurrence. A generalized representation of such a system is shown in Table 1.

Table 1: Civil Transport Aircraft Safety Risk Matrix (Generalized)
Failure Condition Severity Maximum Probability Requirement (per flight hour)
Minor ≤ $10^{-3}$
Major ≤ $10^{-5}$
Hazardous ≤ $10^{-7}$
Catastrophic ≤ $10^{-9}$

For the aircraft as a whole, the probability of a catastrophic failure condition must be “extremely improbable,” typically understood to be on the order of less than $10^{-9}$ per flight hour for large transport aircraft. For individual systems, which could have multiple potential catastrophic failure paths, the requirement for a single catastrophic failure is often set at $10^{-9}$ per hour or lower. It is crucial to note that accident investigations show the majority of manned aviation accidents are initiated by human error. Thus, highly reliable equipment only contributes partially to overall aviation safety. For smaller aircraft categories, such as those certified under FAR Part 23, the acceptable probabilities are different, as outlined in advisory material like FAA AC 23.1309-1C, which classifies aircraft and defines acceptable failure probabilities accordingly (see Table 2). These requirements represent the minimum safety level deemed acceptable to the public.

Table 2: Acceptable Failure Probabilities for FAR Part 23 Aircraft Categories (Example from AC 23.1309-1C)
Aircraft Category Catastrophic Failure Probability Requirement (per flight hour)
I (Small, Single Piston Engine) ≤ $10^{-6}$
II/III/IV (Larger, Multi-engine, Turbine) ≤ $10^{-7}$ to $10^{-9}$

Military Aircraft Safety Requirements

Military aircraft safety is governed by standards such as MIL-STD-882 and its derivatives (e.g., GJB 900A). These standards mandate that safety requirements are defined by the procuring authority based on the system’s hazard characteristics and an acceptable level of risk, balanced against military necessity, mission profile, technological feasibility, schedule, and lifecycle cost. Unlike civil regulations, these standards typically do not prescribe universal quantitative probability targets. Instead, they establish a qualitative risk management framework. Hazards are identified and assessed based on their severity (e.g., Catastrophic, Critical, Marginal, Negligible) and probability (e.g., Frequent, Probable, Occasional, Remote, Improbable). A risk assessment matrix (see Table 3) is then used to determine the acceptability of the risk.

Table 3: Qualitative Risk Assessment Matrix (Based on MIL-STD-882/GJB 900A)
Probability Severity
Catastrophic (I) Critical (II) Marginal (III) Negligible (IV)
Frequent (A) Unacceptable Unacceptable Review Acceptable
Probable (B) Unacceptable Unacceptable Review Acceptable
Occasional (C) Unacceptable Review Acceptable Acceptable
Remote (D) Review Acceptable Acceptable Acceptable
Improbable (E) Acceptable Acceptable Acceptable Acceptable

While some military airworthiness authorities suggest using a fleet-wide catastrophic accident expectation over the total lifecycle as a quantitative goal, this can lead to highly variable targets depending on fleet size and aircraft longevity. This underscores the need for military drone systems to develop tailored, consistent quantitative safety metrics.

Quantitative Safety Metrics for Military Drone Systems

Defining the Safety Requirement for Military Drones

Adhering to the ELOS principle, we can formulate qualitative safety requirements for a military drone system analogous to the manned aircraft risk system:

  • No Safety Effect: No probability requirement.
  • Minor: Probability less than “Probable.”
  • Major: Probability less than “Occasional.”
  • Hazardous: Probability less than “Remote.”
  • Catastrophic: Probability less than “Improbable.”

The crux of the matter is assigning a quantitative value to “Improbable” for the catastrophic condition. For a military drone, the worst-case outcome of an accident is typically ground impact causing fatalities, as there is no onboard crew. Therefore, our quantitative target focuses on the probability of a catastrophic ground impact event.

Deriving the Quantitative Metric

A common safety engineering method defines safety parameters based on the expected probability of a worst-case outcome. For military drone operations, this is the expectation of fatalities on the ground. Thus, to achieve ELOS, we set the maximum allowable frequency of a catastrophic ground impact ($f_{GI}$) based on the historical catastrophic accident rate for manned aircraft ($f_F$) and the conditional expectation of fatalities given a ground impact:
$$ f_{GI} = \frac{f_F}{E[\text{fatalities} | \text{ground impact}]} $$

Analysis of U.S. National Transportation Safety Board (NTSB) data from 1983-2006 reveals a total manned aviation catastrophic accident rate ($f_F$) of approximately $5.05 \times 10^{-5}$ per flight hour. Crucially, only about 6% of these catastrophic accidents involved fatalities on the ground (see Table 4). This yields a ground-specific catastrophic accident rate for manned aviation on the order of $10^{-6}$ per flight hour.

Table 4: Analysis of Catastrophic Accident Rates from NTSB Data (1983-2006)
Aircraft Category Total Catastrophic Accident Rate (per hour) Onboard Catastrophic Rate (per hour) Ground Catastrophic Rate (per hour)
Carrier $2.43 \times 10^{-6}$ $8.68 \times 10^{-7}$ $3.37 \times 10^{-7}$
Commuter $2.37 \times 10^{-5}$ $1.64 \times 10^{-5}$ $8.30 \times 10^{-6}$
General Aviation $8.05 \times 10^{-5}$ $2.77 \times 10^{-5}$ $6.54 \times 10^{-7}$
Overall $5.05 \times 10^{-5}$ $2.06 \times 10^{-5}$ ~$1.31 \times 10^{-6}$

Therefore, we anchor our ELOS to a ground catastrophic accident rate ($f_F$) of $10^{-6}$ per flight hour. The next step is to model $E[\text{fatalities} | \text{ground impact}]$.

The expected number of fatalities is a function of the number of people exposed in the impact area and the probability that an exposed person is killed:
$$ E[\text{fatalities} | \text{ground impact}] = N_{exp} \times P(\text{fatality} | \text{exposure}) $$
The number of exposed persons ($N_{exp}$) is the product of the effective impact area ($A_{exp}$) and the population density ($\rho$):
$$ N_{exp} = A_{exp} \times \rho $$
The impact area can be approximated for a gliding descent as:
$$ A_{exp} = \left[ W_{\text{aircraft}} + 2R_{\text{person}} \right] \times \left[ L_{\text{aircraft}} + 2R_{\text{person}} + \frac{H_{\text{person}}}{\sin(\text{glide angle})} \right] $$
Where $W$ is wingspan, $L$ is length, $R_{person}$ is average person radius, and $H_{person}$ is height.

The conditional probability of a fatality, $P(\text{fatality} | \text{exposure})$, is primarily a function of the impact kinetic energy ($E_{imp}$). Literature suggests a logarithmic relationship between collision energy and lethality, though models vary significantly. Research for small debris (RCC 323) and for larger vehicles (RCC 321) shows orders-of-magnitude differences in the energy required for a given lethality, indicating that mass plays a role independent of kinetic energy.

Based on these observations, we propose a modified sigmoid (logistic) model that incorporates a protection factor ($p_s$) to account for energy absorption or deflection by structures, vehicles, or terrain:
$$ P(\text{fatality} | \text{exposure}) = \frac{1}{1 + \left( \frac{\alpha \cdot \beta}{E_{imp}} \right)^{p_s/4}} $$
Here, $\alpha$ represents the kinetic energy at which the fatality probability is 50%, and $\beta$ is a scaling parameter representing a lower energy threshold. The protection parameter $p_s \in (0, 1]$; a value of 1 implies no protection, while lower values indicate increasing levels of inherent shielding for people in the environment. A nominal average value can be taken as 0.5.

The impact kinetic energy for a military drone is:
$$ E_{imp} = \frac{1}{2} m v_{imp}^2 $$
A conservative estimate for impact velocity ($v_{imp}$) is 140% of the maximum operational speed ($v_{op}$), leading to:
$$ E_{imp} \approx m v_{op}^2 $$
Substituting all components into our original equation, we arrive at the final formula for the maximum allowable ground impact frequency—our quantitative safety metric—for a military drone:
$$ f_{GI} = \frac{f_F}{\rho \cdot \left[ W_{\text{aircraft}} + 2R_{\text{person}} \right] \cdot \left[ L_{\text{aircraft}} + 2R_{\text{person}} + \frac{H_{\text{person}}}{\sin(\theta)} \right] \cdot \left( \frac{1}{1 + \left( \frac{\alpha \cdot \beta}{m v_{op}^2} \right)^{p_s/4}} \right) } $$
Where:

  • $f_F = 10^{-6}$ /flight hour (ELOS baseline)
  • $m$ = Mass of the military drone
  • $v_{op}$ = Maximum operational speed
  • $W_{\text{aircraft}}, L_{\text{aircraft}}$ = Wingspan and length
  • $\theta$ = Glide angle during uncontrolled descent
  • $\rho$ = Population density of the operating area
  • $p_s$ = Protection factor
  • $\alpha, \beta$ = Model parameters (e.g., $\alpha=10^6$ J, $\beta=10^2$ J)

Case Study: Applying the Metric to Representative Military Drones

To demonstrate the application of this methodology, we calculate the catastrophic ground impact probability requirement ($f_{GI}$) for five fixed-wing military drones of varying sizes. Their basic characteristics are listed in Table 5. We consider three operational scenarios with different population densities and protection factors, as defined in Table 6.

Table 5: Characteristics of Example Military Drones
Military Drone Model Mass, $m$ (kg) Wingspan, $W$ (m) Length, $L$ (m) Max Op Speed, $v_{op}$ (m/s) Op Altitude (m)
RQ-4A Global Hawk 11,612 35.4 14.5 177 18,000
MQ-1 Predator 1,021 14.8 8.2 70 7,600
RQ-2 Pioneer 205 5.2 4.3 41 4,600
Neptune 36 2.1 2.0 43 2,400
Aerosonde 15 2.9 1.7 42 3,700
Table 6: Operational Scenario Parameters
Scenario Population Density, $\rho$ (persons/km²) Protection Factor, $p_s$ Description
Simple 50 0.6 Low density, trained personnel, remote areas.
Normal 200 0.5 Typical suburban population density.
Difficult 5,000 0.4 High density urban operation, minimal protection.

Using the derived formula with parameters $\alpha=10^6$ J, $\beta=10^2$ J, $R_{person}=0.3$ m, $H_{person}=1.8$ m, and a glide angle $\theta=15^\circ$, we compute the required $f_{GI}$ for each military drone in each scenario. The results are presented in Table 7.

Table 7: Calculated Catastrophic Ground Impact Probability Requirements ($f_{GI}$, per flight hour)
Military Drone Model Simple Scenario Normal Scenario Difficult Scenario
RQ-4A Global Hawk $4.2 \times 10^{-6}$ $9.4 \times 10^{-7}$ $3.6 \times 10^{-8}$
MQ-1 Predator $2.2 \times 10^{-5}$ $4.1 \times 10^{-6}$ $1.4 \times 10^{-7}$
RQ-2 Pioneer $1.4 \times 10^{-4}$ $2.3 \times 10^{-5}$ $6.5 \times 10^{-7}$
Neptune $8.2 \times 10^{-4}$ $1.3 \times 10^{-4}$ $3.1 \times 10^{-6}$
Aerosonde $1.4 \times 10^{-3}$ $2.3 \times 10^{-4}$ $5.2 \times 10^{-6}$

The results clearly show a trend: larger, heavier military drones like the Global Hawk must meet a more stringent (lower) probability requirement due to their immense kinetic energy, even in low-density areas. Smaller military drones are allowed a higher probability of catastrophic ground impact because their potential to cause ground fatalities is lower. Furthermore, operating in a densely populated urban area (Difficult scenario) demands safety probabilities that are one to two orders of magnitude stricter than operations over sparsely populated zones. This quantitative output provides a clear, risk-informed target for system safety assessments during the design and certification of a military drone, linking its physical characteristics and intended operational environment directly to a numerical safety goal.

Conclusion

This study has established a methodology for deriving top-level quantitative safety metrics for military drone systems based on the principle of Equivalent Level of Safety with manned aviation. By focusing on the dominant risk of ground impact and using historical manned aviation ground accident data as a baseline, we developed a model that calculates the maximum allowable frequency of a catastrophic event. This model incorporates key parameters of the military drone—its mass, dimensions, and operational speed—as well as critical parameters of its intended operational environment—the population density and an estimate of environmental protection. The resulting metric, $f_{GI}$, provides a clear, physics-based target for the probability of a catastrophic failure leading to ground fatalities. This target can be directly allocated to subsystems (flight controls, propulsion, communications) during the safety assessment process of a military drone development program. While the model’s accuracy is subject to the uncertainties in parameters like the protection factor $p_s$ and the lethality function, it provides a rational, consistent, and justifiable starting point for setting safety requirements. This approach moves beyond qualitative risk matrices and offers a tailored, quantitative foundation for ensuring that military drone systems are developed with a safety rigor commensurate with the risks they pose, thereby enhancing their reliability and ultimately, their sustained combat effectiveness.

Scroll to Top