Characterizing and identifying
separable graphical models


Abstract

We study a broad class of graphical models whose independencies correspond to vertex separation in mixed graphs with directed, undirected, and bidirected edges, that are capable of encoding independence structures arising from feedback, latent and selection mechanisms. In particular, we introduce separable graphs, in which each missing edge implies the existence of a separating set for its endpoints, and essentially separable graphs, those graphs separation equivalent to a separable graph. We show that these models include many existing graph families used to define graphical models an provide several characterizations of separable graphs and essentially separable graphs. We also provide multiple characterizations of separation equivalence for separable graphs. One is a graphical characterization—extending earlier results for specific subfamilies—in terms of ordinary graph properties. Another is a separational characterization, depending only on graph separation properties.

Finally, we provide a canonical representation for the equivalence classes of essentially separable graphs and develop an algorithm that, under suitable assumptions, identifies the equivalence class of any essentially separable graph.

=0

We study a broad class of graphical models represented by mixed graphs with directed, undirected, and bidirected edges, capable of encoding independence structures arising from feedback, latent and selection mechanisms. We introduce separable graphical models, in which each missing edge corresponds to a conditional independence, and essentially separable graphical models, whose independence structure is representable by a separable graphical model. We characterize separable and essentially separable graphs under generalized d-separation and \(\sigma\)-separation, and show that every separation equivalence class of separable graphs contains a representative with at most one edge between any pair of vertices. We also provide several equivalent characterizations of the separation equivalence of separable graphs and develop algorithms for testing the equivalence of two separable graphical models and for identifying the equivalence class of any essentially separable graphical model.

1 Introduction↩︎

Graphical models provide a simple intuitive means of describing sets of independence facts that arise in different statistical contexts. A graphical model consists of a graph and a statistical model — a family of probability distributions — such that each probability distribution in the family satisfies a set of statistical independence facts defined by vertex separation in the graph. When considering probability distributions over product measurable spaces with index set V,1 one uses a graph \(G=\left( V,E \right)\) whose vertices correspond to the index set \(V\) and a set of edges \(E\) in conjunction with a separation criterion to describe the set of independence facts that are required to hold. Such a separation criterion defines the global Markov properties of a graphical model defined by the graph G.

Different classes of graphs arise naturally in different applications. For example, undirected graphs arise in physics [1], directed acyclic graphs arise in genetics [2], and chain graphs generalize these classes [3]. Cyclic graphs arise when modeling systems with feedback [4], [5]. Graphs with bidirected edges and undirected edges arise in systems in which there are latent and selection processes [6], [7]. Different separation criteria also arise naturally in different contexts. The most common separation criterion is d-separation and its various generalizations (e.g., m-separation, c-separation). Additional examples of separation criteria are \(\sigma\)-separation used for non-linear feedback systems [8], [9], p-separation used for modeling independence among regression residuals [10], and \(\delta\)-separation used for dynamical systems [11]. In this paper, we consider mixed graphs that allow for multiple edges between any pair of vertices where an edge can either be undirected, directed, or bidirected edges and a generalization of d-separation. The family of graphical models defined by these mixed graphs can model feedback, latent and selection processes and includes as subclasses many existing classes of graphical models.

We introduce two types of mixed graphs: separable graphs and essentially separable graphs. Separable graphs are those in which every missing edge between two vertices corresponds to the existence of a separating set for the two vertices. Essentially separable graphs are those graphs that are separation equivalent to some separable graph. Separable and essentially separable graphs unify a large set of existing graphs used to define graphical models. Separable graphical models generalize the families of undirected, directed, chain graphical models, maximal ancestral graphs, maximal chain mixed graphs, and maximal anterial graphs. Essentially separable graphical models additionally include ancestral [7], anterial [12], and chain mixed graphical models [13]. As both separable and essentially separable graphs include some cyclic graphs, graphical models defined in terms of these families include models that can be used to describe systems with feedback.

The defining property of separable graphs has appeared previously [7], [13] as an emergent property of a maximization process in which one adds edges to a graph to form an equivalent larger graph until one cannot further augment the graph. In particular, [7] shows that maximal ancestral graphs and [13] shows that maximal chain mixed graphs have the emergent property that every missing edge corresponds to the existence of a separating set. In contrast, we use the property to define separable graphs. This allows us to define a more general family of graphs including some cyclic graphs. We show, however, that for the class of mixed graphs, a maximal graph need not be separable under d-separation.

We provide characterizations of separable graphs and essentially separable graphs. In one graphical characterization we show that essentially separable graphs are essentially acyclic graphs, that is, they are separation equivalent to an acyclic graph. Furthermore, we show that the family of anterial graphs introduced by [12] is essentially equivalent to the family of essentially separable graphs, that is, the family of statistical models associated with the graphical models defined by anterial graphs is identical to the family of statistical models associated with essentially separable models. This result has significant potential computational benefit due to the fact that anterial graphs are simple acyclic graphs.

We provide graphical characterizations of several graph families including the family of essentially undirected graphs; those graphs that are separation equivalent to some undirected graph. A graphical characterization of chain graphs that are equivalent to undirected graphs was provided by [14]. Unlike this characterization undirected graphs, our characterization is purely based on the separation properties of the graph. In particular, we introduce the concept of an inducing vertex; a vertex that induces a dependence between separated sets of vertices when added to a separating set. We show that a graph is essentially undirected if and only if it contains no inducing vertex. In addition to its utility in this characterization, we show that the existence of an inducing vertex in a graph provides information about anterior relationships between the inducing vertex and other vertices in the graph. We also provide a characterization of essential graphs in terms of their separation properties.

We also provide three characterizations of separable equivalence for separable graphs, describe a canonical representation for the equivalence class of essentially separable graphs, and provide a structure identification algorithmfor essentially separable graphical models. The first characterization of separation equivalence is in terms of two graph having the same adjacencies and the same minimal inducing walks. This result is a direct generalization of the characterizations of separation equivalence for directed acyclic graphs [15], chain graphs [16], and ancestral graphs [17] to separable graphs. Our second characterization shows that we only need to consider adjacency and a subset of minimal inducing walks called discriminating inducing walks.

Our final characterization is given in terms of two separational properties of pairs of vertices; vertex separability and the induced arrowhead property. Our final characterization is that two separable graphs are separation euqivalent if and only if the graphs have the same vertex separability and the same induced arrowheads. This characterization is particularly useful for developing structure identification algorithmas it is a separational characterization which implies that, in principle, an structure identification algorithmusing independence tests can identify the equivalence class based only on the properties used in the characterization.

Our representation for the equivalence classes of separable graphs relies on this characterization and, particularly, the induced arrowhead property. We show that we can represent the equivalence class of an essentially separable graph by a graph with the same adjacencies as a separable graph in the equivalence class and whose only arrowheads on edges are induced arrowheads.

Finally, our structure identification algorithmfor essentially separable graphs, the algorithm, relies on identifying separating sets and inducing vertices. The algorithm generalizes the CI and FCI algorithms of [6]. In particular, the CI and FCI algorithms identify the structure of graphical models defined by ancestral graphs, whereas the identifies the structure of a graphical model defined by separable graphs. The algorithm is conceptually simple: the algorithm searches for separating sets for pairs of vertices. If a separating set is found, the edge between the separated vertices is remove edges. Then the separating set is used to identify inducing vertices. If inducing vertices are found, they are are used to orient edges. The algorithm then continues to search for separating sets. We provide sufficient conditions for the algorithm to correctly identify the equivalence class of an essentially separable graph and a polynomial bound on the number of independence tests required.

2 Preliminaries↩︎

In this section we introduce the key objects of study in this paper including independence models, statistical independence models induced by probability distributions, vertex independence models induced by mixed graphs, mixed graphical models, and the problem of structure identification of graphical models.

2.1 Independence models↩︎

An independence model is a representation of the independencies and dependencies that hold in a system of objects \({\cal O}\). Such models are well-studied (e.g., studeny2005?) and used in a variety of contexts including two contexts relevant to this paper; vertex separation in graphs — a system of vertices, and statistical independence in probability distributions — a system of variables. An independence model \(I=\left( {\cal O},T \right)\) where \({\cal O}\) is a set of objects where \(T\subseteq {\cal T}_{{\cal O}}\) is a set of triples and \({\cal T}_{{\cal O}}\) is the set of all possible triples \(\left( A,B,C \right)\) of disjoint subsets of \({\cal O}\). For independence model\(I=\left( {\cal O},T \right)\) and triple \(\left( A,B,C \right)\), if \(\left( A,B,C \right)\in T\), then we say that \(A\) is independent of \(B\) given \(C\) and write \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\). If \(\left( A,B,C \right)\not \in T\) then we say \(A\) and \(B\) are dependent given \(C\) and write \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {C}\). For two independence models \(I=\left( {\cal O}, T \right)\) and \(I'=\left( {\cal O}',T' \right)\), we define \(I\subseteq I'\) if \({\cal O}\subseteq {\cal O}\) and \(T\subseteq T'\). Finally, we denote the set of all independence models by \({\cal I}\). =0

An independence model \(I=\left( {\cal O},T \right)\) where \({\cal O}\) is a set of objects and \(T\subseteq {\cal T}_{{\cal O}}\) is a set of triples where \({\cal T}_{{\cal O}}\) is the set of all possible triples \(\left( A,B,C \right)\) of disjoint subsets of \({\cal O}\). For independence model\(I=\left( {\cal O},T \right)\) and \(\left( A,B,C \right)\), if \(\left( A,B,C \right)\in T\), then we say that \(A\) is independent of \(B\) given \(C\) and write \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\). If \(\left( A,B,C \right)\not \in T\) then we say \(A\) and \(B\) are dependent given \(C\) and write \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {C}\). The for independence model \(I=\left( {\cal O},T \right)\) is the Boolean function \(\testFunctionName_{I} = \delta_{T}\), the characteristic function of the set \(T\).

2.1.1 Independence properties↩︎

An independence property is a logical formula of independence and dependence statements where upper-case letters indicate sets of variables, lower-case letters indicate a singleton set of variables and distinct letters in a formula indicate that the sets are disjoint. Furthermore, two or more adjacent letters are used to indicate union of those sets. For instance, \(BD\) in the weak union property in Table 1 is used in place of \(B\cup D.\) An independence property holds in an independence modelfor \({\cal O}\) if for every possible assignment of disjoint sets of \({\cal O}\) to letters in the logical formula, the logical formula is a true statement about the independence model. For instance, the symmetry property in Table 1 holds in the independence model \(I\) for \(V\) if for all \(\left( A,B,C \right)\in {\cal T}_{V}\) it is the case that if \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) then \({B} \perp\!\!\!\!\perp_{I} {A}\ |\ {C}\). Table 1 contains a set of independence properties that are called the semi-graphoid properties.pearl1988? An independence model\(I\) is a semi-graphoid if all of the semi-graphoid properties hold in \(I\).

Table 1: The semi-graphoid independence properties.
\(\indep{A}{\emptyset}{C}{}\) trivial
\(\indep{A}{B}{C}{}\) \(\implies \indep{B}{A}{C}{}\) symmetry
\(\indep{A}{BD}{C}{}\) \(\implies \indep{A}{B}{C}{} \wedge \indep{A}{D}{C}{}\) decomposition
\(\indep{A}{BD}{C}{}\) \(\implies \indep{A}{B}{CD}{}\) weak union
\(\indep{A}{B}{C}{} \wedge \indep{A}{D}{CB}{}\) \(\implies \indep{A}{BD}{C}{}\) contraction

Table 2 contains several additional independence properties. An independence model \(I\) is a compositional graphoid if the semi-graphoid properties given in Table 1 hold in \(I\) and the intersection and composition properties of given in Table 2 hold in \(I\).

Table 2: Additional independence properties
\(\indep{A}{B}{CD}{I} \wedge \indep{A}{D}{CB}{I}\) \(\implies \indep{A}{BD}{C}{I}\) intersection
\(\indep{A}{B}{C}{I} \wedge \indep{A}{D}{C}{I}\) \(\implies \indep{A}{BD}{C}{I}\) composition
\(\indep{A}{B}{C}{I} \;\wedge \;\indep{A}{B}{Cd}{I}\) \(\implies \indep{A}{d}{C}{I} \;\vee \;\indep{d}{B}{C}{I}\) weak transitivity

2.1.2 Dyadic independence models↩︎

=0 Next we provide a useful characterization of the equivalence of two independence models. An independence model\(I\) is a dyadic independence model if the trivial, symmetry, composition, and decomposition properties hold in \(I\). The function \(\text{\rmfamily\upshape Pairwise}\) is the independence modelprojectionthat maps an independence modelto the independence modelconsisting of all and only the pairwise triples that hold in the given independence model. In particular, \(\text{\rmfamily\upshape Pairwise}(\left( {\cal O},T \right))=\left( {\cal O},\{\, {\left( A,B,C \right)}\in {T}\ | \ {|A|=1 \wedge |B|=1} \,\} \right)\). Two independence models \(I\) and \(I'\) are pairwise equivalent if \(\text{\rmfamily\upshape Pairwise}(I)=\text{\rmfamily\upshape Pairwise}(I')\).

The following proposition shows that for dyadic independence models, equivalence and pairwise equivalence are themselves equivalent.2

Proposition 1.

The importance of Proposition 1 is that one need only verify pairwise independence facts to guarantee equivalence of any dyadic independence model.

2.1.3 Marginalization and conditioning↩︎

Marginalization and conditioning are important operations for probability distributions and graphical models. These operations are useful when one considers models with latent variables and selection bias [7], [18]. We define the conditional projectionof an independence modelthat captures both the marginalization and conditioning operations; this projection was defined by [7] but was not named. The conditional projection of independence model\(\text{\rmfamily\upshape E}^{L}_{S}({I})\) of a independence model\(I=\left( {\cal O},T \right)\) is \[\text{\rmfamily\upshape E}^{L}_{S}({\left( {\cal O},T \right)})=\left( {\cal O}\setminus (L\cup S),T^L_S \right)\] where \[T^L_S = \{\, {\left( A,B,C \right)}\in {{\cal T}_{{\cal O}}}\ | \ {\left( A,B,C\cup S \right)\in T \wedge (A\cup B \cup C)\cap (L \cup S) = \emptyset} \,\}.\]

Examples of the conditional projectionapplied to an independence model\(I=\left( {\cal O},T \right)\) where \({\cal O}=\{\, a,b,c,d \,\}\) and \(T=\{\, \left( a,b,d \right),\left( c,d,\{\, a,b \,\} \right) \,\}\) are given in Table 3.

Table 3: Examples of the applied to an \(I\).
\(\indepmodelEE{I}\) \(=\) \(\seq{\objectDomain,T}\)
\(\indepmodelConditionalExpectation{d}{\emptyset}(I)\) \(=\) \(\seq{\set{a,b,c},\emptyset}\)
\(\indepmodelConditionalExpectation{\emptyset}{d}(I)\) \(=\) \(\seq{\set{a,b,c},\set{\seq{a,b,\emptyset}}}\)
\(\indepmodelConditionalExpectation{\emptyset}{c}(I)\) \(=\) \(\seq{\set{a,b,d},\emptyset}\)
\(\indepmodelConditionalExpectation{c}{\emptyset}(I)\) \(=\) \(\seq{\set{a,b,d},\set{\seq{a,b,d}}}\)
\(\indepmodelConditionalExpectation{d}{c}(I)\) \(=\) \(\seq{\set{a,b},\emptyset} = \indepmodelConditionalExpectation{cd}{\emptyset}(I) = \indepmodelConditionalExpectation{\emptyset}{cd}(I)\)
\(\indepmodelConditionalExpectation{c}{d}(I)\) \(=\) \(\seq{\set{a,b},\set{\seq{a,b,\emptyset}}}\)

The marginalization over \(L\) of a independence model\(I\) is the independence model\(\text{\rmfamily\upshape E}^{L}_{\emptyset}({I})\) and the independence modelobtained by conditioning on \(S\) is \(\text{\rmfamily\upshape E}^{\emptyset}_{S}({I})\). A notable property of the conditional projectionis that it removes the sets of objects \(L\) and \(S\) from an independence modelimplying that the independence modelresulting from an conditional projectioncan only be used to answer dependence and independence questions about the objects that remain.

Some basic properties the conditional projectionthat follow from basic properties of sets are given in the next proposition.

Proposition 2.

2.2 Distributions and statistical independence models↩︎

We use \(P\) to denote a probability distribution over variables \(V\) and assume that \(P\) is from some defining family of probability distributions \({\cal P}\).3 Note that we will use \(V\) to refer to both a set of vertices in a graph and a set of variables. The statistical independence or statistical dependence of two sets of variables given a third set of variables is a property of a distribution. We denote the fact that \(A\) and \(B\) are independent given \(C\) in \(P\) by \({A} \perp\!\!\!\!\perp_{P} {B}\ |\ {C}\) and denote the fact that \(A\) and \(B\) are dependent given \(C\) in \(P\) by \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{P}\ {B}\ |\ {C}\). We use statistical independence to define the statistical independence model for distribution \(P\) as \[{I}{(P)}=\{\, {\left( A,B,C \right)}\in {{\cal T}_{V}}\ | \ {\forall a\in A \;\forall b\in B \;{a} \perp\!\!\!\!\perp_{P} {b}\ |\ {C}} \,\}.\]

A statistical independence modelderived from a distribution is guaranteed to satisfy the semi-graphoid independence properties as shown in the following proposition. A proof of this can be found in studeny2005?.

Proposition 3.

2.3 Mixed graphs↩︎

The family of mixed graphs \({\cal G}\) is the family of loop-less mixed multigraphs with the symmetric edges \(\{\, \ \text{---}\ ,\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ \,\}\) and asymmetric edge \(\{\, \ \text{---}\!\!\!\!\succ\! \ \,\}\) over a set of vertices \(V\). A graph \(G=\left( V,E \right) \in {\cal G}\) has a finite set of vertices \(V\) and a finite set of edges \(E \subseteq {\cal E}= V\times T \times V\) where edges have a type \(t\in T=\{\, \ \text{---}\ , \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ , \ \text{---}\!\!\!\!\succ\! \ \,\}\), there are no loops (i.e., \(\left( a,t,a \right)\not\in E\)), and the set of edges is symmetric (i.e., if \(\left( a,t,b \right)\in E\) and \(t\in \{\, \ \text{---}\ , \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ \,\}\) then \(\left( b,t,a \right) \in E\)). The set \({\cal E}\) is the set of all possible edges with endpoints in \(V\).

2.3.1 Edges and endmarks↩︎

An edge \(\left( a,t,b \right)\in E\) connects its endpoints \(a\) and \(b\) and has edge type \(t\in \{\, -,\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ , \ \text{---}\!\!\!\!\succ\! \ \,\}\). A pair of distinct vertices \(a,b \in V\) in a graph \(G\in {\cal G}\) can have up to four distinct edges connecting them and each edge is either an undirected (\(a \ \text{---}\ b\)), a bidirected (\(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\)), or one of two distinct directed edges (\(a\ \text{---}\!\!\!\!\succ\! \ b\) or \(b\ \text{---}\!\!\!\!\succ\! \ a\)). An edge that connects \(a\) and \(b\) is often denoted by \({e(a, b)}\) or \({e(b, a)}\). This denotation indicates only the endpoints of the edge but not its type. We also use the letter \(e\), often with a subscript (e.g., \(e_i\)) to denote an edge without reference to either its type or its endpoints. We often depict edges both in text and in figures. For instance, if \({e(a, b)}= \left( a,\ \text{---}\!\!\!\!\succ\! \ ,b \right)\in E\) then we can depict the edge as either \(a \ \text{---}\!\!\!\!\succ\! \ b\) or \(b \ \!\prec\!\!\!\!\text{---}\ a\) and this is true regardless of whether the edge type is symmetric or asymmetric because the symbols used for symmetric edge types are laterally symmetric and the symbol for the asymmetric edge type is not laterally symmetric. Two vertices \(a\) and \(b\) are adjacent in a graph if there is an edge that connects them in the graph. We denote the set of vertices adjacent to a vertex \(b\) in graph \(G\) by \(\mathop{\mathrm{Adj}}(b,G)\). Each endpoint of an edge in a graph \(G\in {\cal G}\) has an endmark which is either an arrowhead or a tail. For instance, the edge \(a \ \text{---}\!\!\!\!\succ\! \ b\) has a tail at \(a\) and an arrowhead at \(b\). An endmark of a vertex \(a\) for an edge \({e(a, b)}\) in a graph is exclusive if all edges that connect \(a\) and \(b\) have the same endmark at \(a\). If an exclusive endmark is an arrowhead it is called an exclusive arrowhead and otherwise it is called an exclusive tail. If an edge \({e(a, b)}\) has an arrowhead at \(b\) then we say that the edge is into \(b\) and if it has a tail at \(a\) we say that the edge is out of \(a\).

2.3.2 Walks: edge sequences, vertex sequences, and section sequences↩︎

In this section we define walks in graphs as edge sequences that satisfy particular constraints and define terminology and notation related to walks. We also define the vertex sequence of a walk and the section sequence of a walk.

A walk in graph \(G\) is an edge sequence in which (i) every terminal edge shares an endpoint with its adjacent edge, and (ii) every internal edge shares one of its endpoints with one of its adjacent edges and its other endpoint with its other adjacent edge. We use lower-case Greek letters \(\omega\), \(\gamma\), and \(\tau\) both with and without subscripts to denote walks. We will often depict a walk by an alternating sequence of vertices and edge types such as \(a \ \text{---}\!\!\!\!\succ\! \ b \ \text{---}\ c\).

Associated with every walk \(\omega\) is its unique vertex sequence \(\text{\rmfamily\upshape ver}({\omega})\). For instance, the walk \(\omega=a \ \text{---}\!\!\!\!\succ\! \ b \ \text{---}\ c\) has vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( a,b,c \right)\). We use \(\text{\rmfamily\upshape Ver}({\omega})\) to denote the set of vertices that appear on a walk. A chord of a walk \(\gamma\) with vertex sequence \(\text{\rmfamily\upshape ver}({\gamma})=\left( v_1,\ldots,v_n \right)\) is an edge \({e(v_r, v_s)}\) between a pair of non-consecutive vertices \(v_r\) an \(v_s\). A walk is chordless if it has no chords.

We often describe vertices relative to a walk using the following natural definitions. A vertex \(v\) is on (or appears on) a walk \(\gamma\) if \(v\) is on \(\text{\rmfamily\upshape ver}({\gamma})\). A vertex \(v\) is called an internal vertex on a walk \(\gamma\) if \(v\) is an internal vertex of \(\text{\rmfamily\upshape ver}({\gamma})\). A vertex \(v\) is the first vertex of a walk \(\gamma\) if \(v\) is the first vertex of \(\text{\rmfamily\upshape ver}({\gamma})\). A vertex \(v\) is the last vertex of a walk \(\gamma\) if \(v\) is the last vertex of \(\text{\rmfamily\upshape ver}({\gamma})\). We use \(\mathop{\mathrm{first}}(\gamma)\) and \(\mathop{\mathrm{last}}(\gamma)\) to denote, respectively, the first and last vertex of walk \(\gamma.\) A vertex \(v\) is called an endpoint of a walk \(\gamma\) is either the first or last vertex of \(\gamma\). If the first vertex of a walk \(\gamma\) is \(v_1\) and the last is \(v_n\) then the walk \(\gamma\) is between \(v_1\) and \(v_n\).

Also associated with a walk \(\omega\) is a section sequence \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) such that (i) \(\text{\rmfamily\upshape ver}({\gamma})=\sigma_1 \mathbin{+}\ldots \mathbin{+}\sigma_n\), (ii) if vertex sequence \(\sigma_i\) has more than one vertex then \(\omega(\sigma_i)\) is an undirected walk, (iii) no pair of adjacent sections can be combined to form a longer undirected subwalk of \(\omega\); that is \(\omega(\sigma_{i-1} \mathbin{+}\sigma_i)\) is not an undirected walk. A section of a walk \(\gamma\) is any vertex subsequence that appears on the section sequence of the walk \(\text{\rmfamily\upshape sec}({\gamma})\). We use lower-case Greek letters \(\sigma\) and \(\sigma'\) both with and without subscripts to denote sections on a walk. Note that we choose to use vertex sequences to represent sections as a section may consist of a single vertex. For instance, for the walk \(\omega=a \ \text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) every section is a vertex sequence of length one; \(\text{\rmfamily\upshape sec}({\omega})=\left( \left( a \right),\left( b \right),\left( c \right) \right)\). A section \(\sigma_i\) of a walk \(\omega\) with \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) is a collider section if \(1 < i < m\), the edge \({e(\mathop{\mathrm{last}}(\sigma_{i-1}), \mathop{\mathrm{first}}(\sigma_i))}\) on \(\omega\) has an arrowhead at \(\mathop{\mathrm{first}}(\sigma_i)\), and the edge \({e(\mathop{\mathrm{last}}(\sigma_i), \mathop{\mathrm{first}}(\sigma_{i+1})}\) has an arrowhead at \(\mathop{\mathrm{last}}(\sigma_i)\). Any section on a walk that is not a collider section is a non-collider section. Note that the endpoints of a walk are always on non-collider sections.

2.3.3 Types of walks and anterior sets↩︎

In this section we define several types of walks, and define anterior and posterior vertex sets that are defined in term of walks in a graph \(G\in {\cal G}\).

First we define several type of walk. A walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a circuit if the first and last vertices of the walk are identical (i.e., \(v_1=v_n\)).4 A walk is undirected if all of the edges on the walk are undirected edges. A walk \(\gamma\) with vertex sequence \(\text{\rmfamily\upshape ver}({\gamma})=\left( v_1,\ldots,v_n \right)\) is an anterior walk if it contains only undirected and directed edges and if the edge \({e(v_{i}, v_{i + 1})}\) on \(\omega\) is directed then it is oriented \(v_{i} \ \text{---}\!\!\!\!\succ\! \ v_{i + 1}\). A walk \(\omega\) with vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a directed walk if it is an anterior walk containing only directed edges. A semi-directed walk is an anterior walk with at least one directed edge. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is either a directed walk, anterior walk, or a semi-directed walk then the walk is from \(v_1\) to \(v_n\).

Next we define the concepts of anterior sets in a graph. The vertices anterior to a set of vertices \(A\) in graph \(G\) is the set \(\mathop{\mathrm{Ant}}(A,G)\) containing \(A\) and all vertices \(j\in V\) such that there is a anterior walk from \(j\) to some vertex \(a\in A\). A set of vertices \(A\) is an anterior set in a graph \(G\) if \(A=\mathop{\mathrm{Ant}}(A,G).\) A set of vertices \(A\) is anterior to a set of vertices \(B\) in graph \(G\) if \(A\subseteq \mathop{\mathrm{Ant}}(B,G)\).

2.3.4 Connecting walks and vertex separation↩︎

A vertex separation criterioncaptures the separation properties of a graph and one typically defines a vertex separation criterionin terms of connecting walks in the graph. In this section, we extends previous definitions of d-connecting walks to mixed graphs in order to define a vertex separation criterionfor mixed graphs.

A walk \(\omega\) between distinct vertices \(a\) and \(b\) is a connecting walk given \(C\subseteq V\) in graph \(G\in {\cal G}\) if (1) every collider section of \(\omega\) has a vertex in \(C\), and (2) no non-collider section has a vertex in \(C\). Note that \(C\) cannot contain either endpoint of the walk if the walk is connecting given \(C\). If there is a connecting walk between \(a\) and \(b\) given \(C\) in graph \(G\) then \({a} \perp\!\!\!\!\perp_{} {b}\ |\ {C}\) holds in \(G\). If there is no connecting walk between \(a\) and \(b\) given \(C\) in graph \(G\) then \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{}\ {b}\ |\ {C}\) holds in \(G\). If \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{}\ {b}\ |\ {C}\) holds in \(G\) then we write \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {C}\) and, otherwise \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {C}\). Two vertices \(a\) and \(b\) in graph \(G\) are separated if there is a set \(C\) such that \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {C}\).

2.3.5 Independence models of mixed graphs↩︎

Vertex separation in a graph is then used to define an independence model over the vertices. In particular, the graph independence modelfor graph \(G=\left( V,E \right)\) is \[{I}{(G)}=\left( V,\{\, {\left( A,B,C \right)}\in {{\cal T}_{V}}\ | \ {\forall a\in A \;\forall b\in B \;{a} \perp\!\!\!\!\perp_{G} {b}\ |\ {C}} \,\} \right).\]

The independence model of a mixed graph satisfies additional independence properties. The following proposition was proved in [19].

Proposition 4.

In addition, the weak transitivity independence property was shown to hold in mixed graph in [20].

Proposition 5.

2.3.6 Separation equivalence and separation equivalence classes↩︎

Separation equivalence and separation equivalence classes play an important role in characterizing graphical models and in identifying their structure.

The separation equivalence of two graphs is defined in terms of their independence models as \(G \equiv G'\) if \({I}{(G)}={I}{(G')}\).5 Note that the independence model of a graph is decomposable, thus, Proposition 1 implies that one only needs to consider walk in order to establish the separation equivalence of two graphs. In particular, two graphs \(G\) and \(H\) are separation equivalent if and only if (1) if there exists a connecting walk given \(C\) in \(G\) then there is a connecting walk given \(C\) in \(H\), and (2) if there exists a connecting walk given \(C\) in \(H\) then there is a connecting walk given \(C\) in \(G\).

The separation equivalence class of a graph is the set of graphs that are separation equivalent to the graph. The equivalence class of a graph \(G\) with respect to \(\equiv\) relative to a graph family \({\cal F}\) is the set of graphs \([G]_{\cal F}=\{\, {G'}\in {{\cal F}}\ | \ {G\equiv G'} \,\}\). Note that we do not explicitly mention the equivalence relation \(\equiv\) when denoting the separation equivalence class of a graph because the only equivalence classes of graphs that we consider are separation equivalence classes. When no family is mentioned the graph family is take to be the set of all mixed graphs \({\cal G}\), that is, \([G]=[G]_{\cal G}\).

2.4 Graph properties and graph separation properties↩︎

A graph property is a Boolean function of one or more graphs.

A graph property \(f(G_1,\ldots,G_k)\) is a graph separation property if it can be expressed as a Boolean function of the independence models of the graphs; that is, for some Boolean function \(h\),

\[f(G_1,\ldots,G_k) = h\bigl(I(G_1),\ldots,I(G_k)\bigr).\]

Such a property depends on each graph only through its induced independence model.

Throughout this paper we distinguish between graphical characterizations, which are defined in terms of arbitrary graph properties, and separational characterizations, which are defined in terms of graph separation properties. A key advantage of separational characterizations is that they depend only on the independence models of the graphs and are therefore invariant under separation equivalence.

2.5 Graphical models, separational and statistical equivalence↩︎

A graphical model is defined with respect to a defining graph structure \(G\) and a defining set of distributions \({\cal P}\). A graphical model is a tuple \(M_{G}^{\cal P}=\left( G,{\cal P}_{G} \right)\) such that \(G\in {\cal G}\) and \({\cal P}_{G}=\{\, {P}\in {{\cal P}}\ | \ {{I}{(G)} \subseteq {I}{(P)}} \,\}\). If \({I}{(G)} \subseteq {I}{(P)}\) we say that \(P\) is Markov with respect to \(G\).6 Thus \({\cal P}_{G}\) represents the set of distributions in \({\cal P}\) that are Markov with respect to \(G\). We use \(M_{G}\) to denote \(M_{G}^{\cal P}\) unless the choice of the \({\cal P}\) is relevant.

It is useful to compare graphical models in terms of the independence models of their defining graphs, and the set of distributions that are Markov with respect to their defining graph. Two graphical models \(M_{G}, M_{H}\) are separation equivalent if \(G\equiv H\). Two graphical models \(M_{G}, M_{H}\) are statistically equivalent if \({\cal P}_{G}={\cal P}_{H}\). The following proposition relates the separation equivalence and statistical equivalence of graphical models. It follows from the fact that the set of distributions that are Markov with respect to a graph is defined in terms of the independence model of the defining graph.

Proposition 6.

Statistical equivalence can fail to imply separation equivalence if the family of defining distributions is not rich enough to distinguish between graphs that are not separation equivalent.

2.6 Graph families and essential graph families↩︎

A graph family \({\cal F}\) is any subset of the family of mixed graphs \({\cal G}\) (i.e., \({\cal F}\subseteq {\cal G}\)). In this section we distinguish several types of mixed graphs and notation for the set of graphs of each type. A graph is simple if there is at most one edge between any pair of vertices. The family of simple graphs is \({\cal G}_{simp}\). A graph is acyclic if it contains no semi-directed circuit and is cyclic otherwise. The family of acyclic graphs is \({\cal G}_{acyc}\). A graph \(G\) is maximal if adding any edge between any two non-adjacent vertices in \(G\) changes its independence model. The family of maximal graphs is \({\cal G}^{max}\).

We define essential graph families using the equivalence closure of a generating graph family with respect to separation equivalence. The equivalence closure of a set \({\cal F}\subseteq {\cal G}\) with respect to equivalence relation \(\sim\) on \({\cal G}\) is the set \(\operatorname{cl}_\sim({\cal F})=\{\, {F}\in {{\cal F}}\ | \ {\exists G\in {\cal G}, G \sim F} \,\}.\) The essential graph family generated by \({\cal F}\) is the set \(\mathcal{E}({\cal F})=\operatorname{cl}_\equiv({\cal F}).\) Equivalently, this is the union of all separation–equivalence classes that intersect \(\mathcal{F}\).

2.7 Comparing the expressivity graph families↩︎

We can compare graphical models in terms of their graphical expressivity and their separational expressivity.

We compare the graphical expressivity of two graphical model families by comparing the graphs that they contain. For instance, if \({\cal F}\subset {\cal H}\) then \({\cal H}\) is more graphically expressive than \({\cal M}_{{\cal F}}\). Thus, the family of chain graphs is more graphically expressive than both the family of undirected and directed acyclic graphs.

We compare the separational expressivity of two graph families using the sets of graphs contained in the essential families generated by the two families. If \(\mathcal{E}({\cal F})\subset \mathcal{E}({\cal H})\) then we say that \({\cal H}\) is more separationally expressive than \(G\). We denote this relationship by \({\cal F}\sqsubset {\cal H}\). If \(\mathcal{E}({\cal F})= \mathcal{E}({\cal H})\) then the two families are essentially equivalent and denote the relationship by \({\cal F}\equiv {\cal H}\). Because essential families are defined as the separation-equivalent closure, such set-theoretic comparison compare the families of induced independence models associated with the graph family. The implications of essential equivalence for graphical models is considered in the next section.

2.8 Graphical model families↩︎

A graphical model family is defined in terms of a defining family of graphs \({\cal F}\subseteq {\cal G}\) and a defining family of distributions \({\cal P}\). In particular, the graphical model family defined by \({\cal P}\) and \({\cal F}\) is the set of graphical models \({\cal M}^{\cal P}_{\cal F}= \bigcup_{G\in{\cal F}}M_{G}^{\cal P}\). For instance the family of Gaussian anterial graphical models is the set of models \({\cal M}_{{\cal G}_{ant}}^{\cal P}\) if \({\cal P}\) is the set of all Gaussian probability distributions over the set of variables \(V\). Other types of graphical models are defined by using other defining families of distributions and graphs. We will typically assume that different graphical model familiesshare the same defining family of distributions \({\cal P}\) and use, for instance, \({\cal M}_{{\cal F}}\) to denote \({\cal M}^{\cal P}_{\cal F}\).

We compare the statistical expressivity of two graphical model families using the set of models that they define. We use the relations \(\equiv\) and \(\sqsubseteq\) to compare statistical expressivity. These relations are defined as follows

\[\begin{align} {\cal M}_{{\cal F}}\equiv {\cal M}_{{\cal H}}&\quad \mathrm{if}\quad& \text{\rmfamily\upshape Models}({\cal M}_{{\cal F}})=\text{\rmfamily\upshape Models}({\cal M}_{{\cal H}}) \\ {\cal M}_{{\cal F}}\sqsubset {\cal M}_{{\cal H}}&\quad \mathrm{if}\quad& \text{\rmfamily\upshape Models}({\cal M}_{{\cal F}}) \subset \text{\rmfamily\upshape Models}({\cal M}_{{\cal H}}) \\ \end{align}\] where \(\text{\rmfamily\upshape Models}({\cal M}_{{\cal H}})=\{\, {\cal P}_{H} \;| \;\left( H, {\cal P}_{H} \right) \in {\cal M}_{{\cal H}} \,\}\). If \({\cal M}_{{\cal F}}\equiv {\cal M}_{{\cal H}}\) then the two graphical model families are modeling equivalent. If \({\cal M}_{{\cal F}}\sqsubset {\cal M}_{{\cal H}}\) then \({\cal M}_{{\cal H}}\) is more statistically expressive than \({\cal M}_{{\cal F}}\).

The following proposition captures the implication that the essential equivalence of two graph families on the statistical expressivity of the graphical model families that they define. The proposition follows from the fact that essentially equivalent graph families have the same graphs modulo separation equivalence and Proposition 6.

Proposition 7. If two graph families are essentially equivalent (i.e, \({\cal F}\equiv {\cal H}\)) then for any defining family \({\cal P}\), the graphical model families that they define are modeling equivalent (i.e., \({\cal M}^{\cal P}_{\cal F}\equiv {\cal M}^{\cal P}_{\cal H}\)).

2.9 Structure identification algorithms and identification↩︎

The goal of a structure identification algorithmis to identify graphical properties of the structure of a generating graph \(G^*\) given an observed distribution \(P^*\).7 In this paper we focus on independence testbased structure identification algorithms in which one uses only the results of statistical independence tests to identify the structure of \(G^*\). This type of structure identification algorithmis often called a constraint-based learning algorithm. Furthermore, we choose to represent the identified structure of \(G^*\) with a graph. Thus, our focus is on graphical structure identification algorithms, where a graphical structure identification algorithm is a function \(l\in {{\cal I}} \mapsto {{\cal G}}\) that maps the independence model\({I}{(P^*)}\) to a graph \(G\in {\cal G}\).

We begin by noting that two separation equivalent graphs cannot be distinguished by a graphical structure identification algorithm. This is due to the fact that a graphical structure identification algorithmis invariant under separation equivalence. In other words, the two separation equivalent graphs have equivalent independence models (i.e., \({I}{(G)}={I}{(H)}\)) which implies that any graphical structure identification algorithmapplied to these independence models will result in identical graphs (i.e., \(l({I}{(G)})=l({I}{(H)})\)). Thus separation equivalent graphs are indistinguishable based on statistical independence tests. Thus, a graphical structure identification algorithmcan only hope to distinguish separation equivalence classes of graphical models.

In order for a graphical structure identification algorithmto correctly identify the separation equivalence class of a generating graph \(G^*\) we need to make identifying assumptions connecting \({I}{(P^*)}\) and \({I}{(G^*)}\). A typical assumption between \(P^*\) and \(G^*\) is the Markov assumption. A distribution \(P^*\) is Markov with respect to \(G^*\) (i.e., \(P \in {\cal P}_{G}\)). The Markov assumption, however, is not sufficient to guarantee the identification of the equivalence class of the generating graph. The assumption only guarantees that \({I}{(G^*)} \subseteq {I}{(P^*)}\). If, for instance, there is a product distribution8 \(P\in {\cal P}\) then \(P\in {\cal P}_{G}\) for all \(G\in {\cal F}\). Thus, if the generative distribution \(P^*\) is a product distribution, all graphical structures are indistinguishable if one only assume that \(P^*\) is Markov with respect to \(G^*\).

Thus, in order to identify the equivalence class of the generating graph \(G^*\), one must make an additional compatibility assumption between \(P^*\) and \(G^*\) generally, or between \({I}{(P^*)}\) and \({I}{(G^*)}\) in the case of an independence testbased structure identification algorithm. Such an assumption must ensure that at least some additional dependence facts hold in \(P^*\). The typical assumption (e.g., [6]) is that \(P^*\) is Markov and faithful with respect to \(G^*\) or equivalently that \(P^*\) is perfect with respect to \(G^*\). A probability distribution \(P^*\) is perfect with respect to \(G^*\) if \({I}{(P^*)}={I}{(G^*)}\). A weaker assumption that is appropriate for a graphical structure identification algorithmis perfect testing, where one assumes that, for any \(\left( A,B,C \right)\) considered during the execution of the algorithm, the result of statistical independence tests on \(P^*\) matches the result of a separation test on \(G^*\) (i.e., \({A} \perp\!\!\!\!\perp_{{I}{(P^*)}} {B}\ |\ {C}\) if and only if \({A} \perp\!\!\!\!\perp_{{I}{(P^*)}} {B}\ |\ {C}\)). In this case we say \(P^*\) provides perfect testing for \(G^*\) with respect to a graphical structure identification algorithm. The sufficiency of the perfect testing assumption for identifying the equivalence class of \(G^*\) for any graph family \({\cal F}\) is due to the fact that \(G\equiv H\) is defined as \({I}{(G)}={I}{(H)}\). Thus, if a graphical structure identification algorithmuses enough statistical tests it can distinguish graphs that are not separation equivalent.

Finally, we define when a graphical structure identification algorithmidentifies the separation equivalence class of a graph family given a probability distribution under some compatibility condition. A compatibility condition is a Boolean function of a distribution and a graph; a function in \({{{\cal P}}\mathrel \times{{\cal G}}} \mapsto {\{\, \mathop{\mathrm{True}},\mathop{\mathrm{False}} \,\}}\). A graphical structure identification algorithm\(l\in {{\cal I}} \mapsto {{\cal G}}\) identifies the separation equivalence class of a graph family \({\cal F}\) given \(P^*\in {\cal P}\) under compatibility condition \(C\) if for all \(G^*\in {\cal F}\) and for all \(P^*\in {\cal P}\) it is the case that if \(C(P^*, G^*)\) then \(l({I}{(P^*)}) \equiv G^*\).

3 Separable graphs↩︎

A graph \(G\) is separable if every pair of non-adjacent vertices is separable. The family of separable graphs is denoted by \({\cal G}_{sep}.\) In this section, we provide a characterization of separable graphs and of separable vertices in mixed graphs.

The existence of separating sets is closely connected to the adjacency properties of a mixed graph. Recall that \(C\) is a separating set for two vertices \(i\) and \(j\) in graph \(G\) if \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) and that that two vertices \(i\) and \(j\) are separable in graph \(G\) if there is a separating set \(C\). The following propositions capture the fact that the existence of a separating set for two vertices implies that the two vertices are not adjacent. This proposition follows from the fact that two vertices that are adjacent cannot be separated by any separating set.

Proposition 8. If \(i\) and \(j\) are separable in \(G\) then \(i\not\in \mathop{\mathrm{Adj}}(j,G)\).

The lack of a separating set for a pair of two vertices, however, does not imply the existence of an edge between the two vertices. Consider the pair of vertices \(\left( b,c \right)\) in Graph \(G_2\) in Figure 1. These vertices are not separable and thus Graph \(G_2\) is not separable. One can verify that there is no separating set for this pair of vertices by exhaustively considering the possible separating sets. The following theorem characterizes when two vertices are separable in a graph and provides a more direct approach to verifying that two vertices are separable.

Theorem 9.

This characterization of vertex separability generalizes the characterization of [13] from chain mixed graphs to mixed graphs. Again considering vertices \(\left( b,c \right)\) in Graph \(G_2\), we can see that \({b} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G_2}\ {c}\ |\ {ade}\) which implies, by Theorem 9, that \(b\) and \(c\) are not separable.

In order to characterize separable graphs we consider two types of walks: collider walks and inducing walks. A collider walk is a walk in which all internal vertices on the walk are on collider sections of the walk. Note that this implies that the endpoints of a collider walk are the only vertices on non-collider sections of the walk. A collider walk is trivial if it contains no collider sections and it is non-trivial otherwise. Any walk consisting of a single edge is a trivial collider walk. A collider walk in a graph is an inducing walk if there is no edge in the graph between the endpoints of the walk. Note that an inducing walk must have at least one internal vertex and thus a walk consisting of a single edge is not an inducing walk because it has no internal vertices. Inducing walks are important with respect to separability due to the fact that they can induce dependence between vertices that are not adjacent. They also play an important roll in other results in the paper including one of our characterizations of separation equivalence.

The next theorem characterizes separable graphs in terms of whether the graph contains a self-inducing walk. A self-inducing walk is an inducing walk such that every collider section is anterior to one of the endpoints of the inducing walk.9

Theorem 10.

This characterization generalizes the results of [13] and [7] to the family of mixed graphs.

The graph \(G_1\) in Figure 1 is an example of a separable graph. Separability can be verified by the separation facts \({b} \perp\!\!\!\!\perp_{G_1} {e}\ |\ {d}\), \({a} \perp\!\!\!\!\perp_{G_1} {b}\ |\ {\emptyset}\), \({a} \perp\!\!\!\!\perp_{G_1} {d}\ |\ {\emptyset}\) and \({a} \perp\!\!\!\!\perp_{G_1} {e}\ |\ {\emptyset}\).

Figure 1: Separable graph G_1 and essentially separable graph G_2 that is not separable.

4 Essentially separable graphs↩︎

A graph \(G\) is essentially separable if there is a graph \(G'\equiv G\) such that \(G'\) is separable. Thus, the family of essentially separable graphs is the essential graph family \(\mathcal{E}({\cal G}_{sep})\) generated by separable graphs. When considering graphical models defined by graphs, if a graphical model is defined in terms of a essentially separable graph then there is a statistically equivalent graphical model that is defined in terms of a separable graph.

Graph \(G_2\) in Figure 1 is not separable. This follows from Theorem 10 and the fact that the walk \(b \ \text{---}\!\!\!\!\succ\! \ d \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) is a self-inducing walk. The graph, however, is essentially separable. In particular, if edge \(b \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) is added to this graph then one obtains graph \(G_1\), an equivalent separable graph. The equivalence can be verified by enumerating the separation facts for the two graphs.

For acyclic graphs, a graph is separable if and only if it is maximal (see, Corollary 2 of [13]). This correspondence, however, fails for mixed graphs as illustrated by Graph \(G_3\) of Figure 2.=0 10 =0 This graph is an example of a cyclic graph that is maximal but not essentially separable. Graph \(G_3\) is not separable due to the fact that \(b \ \text{---}\!\!\!\!\succ\! \ d \ \!\prec\!\!\!\!\text{---}\ c\) is a self-inducing walkand Theorem 10. Note \(a\ \text{---}\!\!\!\!\succ\! \ e \ \!\prec\!\!\!\!\text{---}\ d\) is also a self-inducing walk. To see that the graph \(G_3\) has no equivalent separable graph we start by noting that two separation facts are true in graph \(G_3\): (1) \({a} \perp\!\!\!\!\perp_{G_3} {b}\ |\ {\emptyset}\) and (2) \({a} \perp\!\!\!\!\perp_{G_3} {b}\ |\ {cd}\). Suppose there is a separable graph \(G'_3\) that is equivalent to \(G_3\). Graph \(G'_3\) must have an edge \({e(b, c)}\) and an edge \({e(a, c)}\). If \({e(b, c)}\) has a tail at \(c\) or \({e(a, c)}\) has tail \(c\) in \(G'_3\) then fact (1) would not be true. However, if both edges have arrowheads at \(c\) then fact (2) would not hold. Thus, no such separable graph \(G'_3\) equivalent to \(G_3\) exists.

Figure 2: A graph that is not essentially separable and maximal.

Next we show that graph \(G_3\) is maximal. No edge \({e(a, b)}\) can be added due to the fact that \(a\) and \(b\) are separable due to (e.g.) separation fact (1). We have shown above that no edge \({e(b, c)}\) can be added so the only other edges that could be added is the edge \({e(a, d)}\). Consider adding an edge \({e(a, d)}\) to the graph. If \({e(a, d)}\) has a tail at \(d\) or \({e(b, d)}\) has a tail at \(d\) in \(G'_3\) then fact (1) would not be true. However, if both edges have arrowheads at \(d\) then fact (2) would not hold. Thus, no such separable graph \(G'_3\) equivalent to \(G_3\) exists. Thus, no such edge can be added to the graph and \(G_3\) is maximal.

Figure 3: A graph that is not essentially separable and maximal.

Next we show that the graph in Figure 3 is maximal. As shown above, the graph is not separable or even weakly-separable. The only edges that can possibly be added are \({e(v_1, v_3)}\) and \({e(b, e)}\) as all other pairs of vertices are separable in the graph. We showed above that no edge \({e(v_1, v_3)}\) can be added. Next we consider adding an edge \({e(b, e)}\) to the graph. Two additional separation facts that hold in the graph are fact (3), \({b} \perp\!\!\!\!\perp_{G} {v_2}\ |\ {v_3}\) and fact (4), \({b} \perp\!\!\!\!\perp_{G} {v_2}\ |\ {v_2e}\). If \({e(b, e)}\) with a tail at \(e\) is added then fact (3) would not be true. If \({e(b, e)}\) with an arrowhead at \(e\) is added then fact (4) would not be true. Thus, no such edge can be added to the graph and \(G\) is maximal.

In the remainder of the paper we provide results about separable and essentially separable families of graphs and the graphical models defined by these graph families.

5 Graphical characterization of essentially separable graphs↩︎

In this section we provide a graphical characterization of essentially separable graphs. Furthermore, we show that any graphical models defined in terms of an essentially separable model has an equivalent graphical model defined in terms of a simple acyclic graphs called an anterial graph.

A graph \(G\) is essentially acyclic if there is an acyclic graph \(G'\) that is separation equivalent to \(G\). Thus the family of essentially acyclic is the essential graph family \(\mathcal{E}({\cal G}_{acyc})\) generated by acyclic graphs. A graph that is not essentially acyclic is essentially cyclic. Consider graphs \(G_4\) and \(G_5\) from Figure 4. The two graphs are separation equivalent as \(a\) is separated from \(d\) given \(bc\) in both graphs, \(b\) is separated from \(c\) given \(ad\) in both graphs, and these are the only separation facts that hold in these graphs.

Figure 4: A cyclic graph G_4 and an equivalent acyclic graph G_5.

The next theorem provides a characterization of essentially separable graphs as those graphs that are essentially acyclic.

Theorem 11.

The graph \(G_3\) from Figure 2 is essentially cyclic. This follows from Theorem 11 and the fact that \(G_3\) is not essentially separable.

The following corollary of Theorem 11 shows that, separable graphical models \({\cal M}_{\mathcal{E}({\cal G}_{sep})}\) and acyclic graphical models \({\cal M}_{{\cal G}_{acyc}}\) are modeling equivalent.

Corollary 1.

Next we define \(\text{\rmfamily\upshape Anterialize}\) algorithm that converts a graph to an anterial graph. An anterial graph is a simple mixed graph \(G\) such that (1) \(G\) has no semi-directed circuits, and (2) if \(i\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ j\) then \(i \not \in \mathop{\mathrm{Ant}}(j,G)\) and \(j \not \in \mathop{\mathrm{Ant}}(i,G)\). We denote the family of anterial graphs by \({\cal G}_{ant}\subseteq {\cal G}_{simp}\cap {\cal G}_{acyc}\). The graph \(G_1\) in Figure 1 is an example of a separable graph that is not an anterial graph but is simple and acyclic. The graph \(G_1\) is not anterial due to the existence of the edge \(c \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ d\) such that \(d\in \mathop{\mathrm{Ant}}(c,G)\).

The \(\text{\rmfamily\upshape Anterialize}\) algorithm is shown in Algorithm 5. We denote the graph obtained by applying Algorithm 5 to graph \(G\) by \(\text{\rmfamily\upshape Anterialize}(G)\). The graph \(\text{\rmfamily\upshape Anterialize}(G)\) is a simple graph with the same adjacencies as \(G\) such that an edge \({e(i, j)}\) in \(\text{\rmfamily\upshape Anterialize}(G)\) has a tail at \(i\) if and only if there is an anterior walk from \(i\) to \(j\) in \(G\). Consider applying the \(\text{\rmfamily\upshape Anterialize}\) algorithm to graph \(G_4\) of Figure 4. Consider the directed edge \(a \ \text{---}\!\!\!\!\succ\! \ c\). Due the fact that there is an anterior walk from \(c\) to \(a\) (i.e., \(c\in \mathop{\mathrm{Ant}}(a,G)\)) and an anterior walk from \(a\) to \(c\) (the edge it self), the edge \({e(a, c)}\) in \(\text{\rmfamily\upshape Anterialize}(G_4)\) must be \(a \ \text{---}\ c\). By a similar argument, all of the edges must be undirected and the result \(\text{\rmfamily\upshape Anterialize}(G_4)\) is the graph \(G_5\) also from Figure 4.

Figure 5: The algorithm

The following theorem proves that that every separable graph has an equivalent anterial graph and that such a graph can be obtained using the algorithm.

Theorem 12.

Theorem 12 has significant implications about the statistical expressivity of graphical models defined using the family of separable anterial graphs \({\cal G}_{ant}^{sep}\) that is captured in the following corollary.

Corollary 2.

Corollary 2 shows that the family of essentially separable graphical models is modeling equivalent to the family of separable anterial graphical models. This is notable as anterial graphs are simple acyclic graphs which, from a computational perspective, allows structure identification algorithm that seek to identify the equivalence class of an essentially separable graph to focus on simple graphs rather than multigraphs.

6 Separational characterizations of essential graph families↩︎

In this section we give separational characterizations of three essential graph families (defined in Section 2.6): essentially separable graphs (Section 4), essentially acyclic graphs (Section 5), and essentially undirected graphs, the essential family \(\mathcal{E}({\cal G}_{und})\) generated by the family of undirected graphs.

We use separational characterizations because they are invariant under separation equivalence (see Section 2.4). This ensures that each characterization applies uniformly to all graphs in an essential family and clarifies the separation structure shared by the graphs in these families. Many familiar graph properties are not invariant under separation equivalence. For example, in Section 4 we observed that adjacency is not invariant, and in Section 5 we observed that acyclicity and undirectedness are also not invariant. Indeed, each of the essential graph families considered here is generated from a graph family defined by properties that fail to be invariant under separation equivalence.

We begin by characterizing essentially undirected graphs. A fundamental distinction between undirected graphs and, for instance, directed graphs, is that adding a vertex to a separating set for two vertices in a directed graph can induce a dependence between the two vertices. The simplest example of this phenomena is the graph \(i \ \text{---}\!\!\!\!\succ\! \ k \ \!\prec\!\!\!\!\text{---}\ j\) with three vertices and two edges in which \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {\emptyset}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {k}\). In this example, the vertex \(k\) induces dependence between \(i\) and \(j\) given the empty set. We call vertex \(k\) an inducing vertex.

It is useful to generalize the concept of an inducing vertex by defining the concept of an inducing object in an independence model and by considering sets of objects that induce dependence. An object \(d\in {\cal O}\) is an inducing object for \(\left( A,B,C \right)\in {\cal T}_{{\cal O}}\) in independence model \(I\) for \({\cal O}\) if both \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {Cd}\). The inducing objects for \(\left( A,B,C \right)\in {\cal T}_{{\cal O}}\) in independence model\(I\) is the set \(\operatorname{IV}(A,B,C,I)=\{\, {d}\in {{\cal O}}\ | \ {{A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C} \wedge {A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {Cd}} \,\}\). We say that \(d\in {\cal O}\) is an inducing object in independence model \(I\) for \({\cal O}\) if there exists \(\left( A,B,C \right)\) such that \(d\) is an inducing object for \(\left( A,B,C \right)\) in \(I\).

Next we generalize to consider sets of objects that induce dependence. A set of objects \(D \subseteq {\cal O}\) is an inducing set for \(\left( A,B,C \right)\in {\cal T}_{{\cal O}}\) in independence model \(I\) for \({\cal O}\) if both \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {CD}\). The inducing sets for \(\left( A,B,C \right)\in {\cal T}_{{\cal O}}\) in independence model\(I\) is the set of sets \(\operatorname{IS}(A,B,C,I)=\{\, {D}\in {2^{{\cal O}}}\ | \ {{A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C} \wedge {A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {CD}} \,\}\).

The existence of an inducing set in an independence model allows one to infer the existence of additional dependence facts. Consider the induced dependence property: \[{A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C} \;\wedge \;{A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\{B}\ |\ {CD} \implies {A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\{D}\ |\ {CB} \;\wedge \;{D} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\{B}\ |\ {CA}.\]

As described in the next proposition, the induced dependence property is guaranteed to hold in any semi-graphoid independence model.

Proposition 13.

Due to Propositions 3 and 4, the induced dependence property holds for both statistical independence in probability distributions and vertex separation in mixed graphs. Furthermore, if we consider, inducing sets of size one (i.e., \(|D|=1\)) then the induced dependence property is a statement about the properties of inducing objects (e.g., inducing vertices or inducing variables). For instance, in the context of mixed graphs, the induced dependence property can be used to guarantee the existence of connecting walks from the existence of an inducing vertex. Vertex \(d\) being an inducing vertex for sets \(A\) and \(B\) given set \(C\) implies the existence of two connecting walks, one starting at a vertex in \(A\) and the other starting at a vertex \(B\) with both terminating at \(d\).

The following theorem provides a characterization of essentially undirected graphs in terms of the existence of inducing vertices in the induced independence model of the graph.

Theorem 14.

We illustrate this proposition with two examples. Consider graphs \(G_4\) and \(G_5\) from Figure 4. As described in Section 5, the two graphs are separation equivalent. This implies that \(G_4\) is essentially undirected and, by Theorem 14 graph \(G_4\) has no inducing vertices. Next consider graph \(G_6\) and \(G_7\) from Figure 6. The two graphs are separation equivalent and thus, Theorem 14 implies that \(G_6\) has no inducing vertices. This example illustrates that the graphical condition given by [14] for a chain graph to have no equivalent undirected graph is not appropriate for mixed graphs.

Figure 6: An essentially undirected graph G_6 and an equivalent undirected graph G_7.

Next we consider ordering information in graphs and how it relates to inducing vertices in graphs. We use \(\mathrel{\lessapprox}\) to denote a preorder over a set; a preorder is a binary relation that is transitive and reflexive. We use the following notation for the derived relations (i) \(a \mathrel{\approx}b\) if \(a\mathrel{\lessapprox}b\) and \(b \mathrel{\lessapprox}a\), (ii) \(a < b\) if \(a \mathrel{\lessapprox}b\) and \(b \mathrel{\not\lessapprox}a\), (iii) \(a \mathrel{\parallel}b\) if \(a \mathrel{\not\lessapprox}b\) and \(b\mathrel{\not\lessapprox}a\), and (iv) \(a \mathrel{\curlyvee}b\) if \(a\mathrel{\lessapprox}b\) or \(b \mathrel{\lessapprox}a\). We use a preorder \(\mathrel{\lessapprox}\) over \(V\) to define functions from subsets of \(V\) to subsets of \(V\).

In particular, \(V_{\mathrel{\lessapprox}A}= \{\, {b}\in {V}\ | \ {\exists a \in A, b \mathrel{\lessapprox}a} \,\}\), \(V_{\mathrel{\gtrapprox}A}= \{\, {b}\in {V}\ | \ {\exists a \in A, b \mathrel{\gtrapprox}a} \,\}\), and \([A]_\approx = \{\, {b}\in {V}\ | \ {\exists b\in A, b \mathrel{\approx}k} \,\}\).

Preorders arise naturally when considering graphs. The induced preorder of a graph \(G\) is denote \(\mathrel{\lessapprox}_G\) and defined as \(a \mathrel{\lessapprox}_Gb\) if \(a = b\) or there is an anterior walk from \(b\) to \(a\) in \(G\), that is \(b\in\mathop{\mathrm{Ant}}(a,G)\). The relation \(\mathrel{\lessapprox}_G\) for graph \(G=\left( V,E \right)\) is a preorder on \(V\) as reflexivity is guaranteed by the definition and anterior walks can be appended to show transitivity. Note that the relation \(a \mathrel{\approx_G}b\) implies that either \(a=b\) or the existence of anterial walks from \(a\) to \(b\) and from \(b\) to \(a\) in graph \(G\).

We begin by noting that the existence of an inducing set in a graph provides information about anterior relationship between the inducing set and other vertices in the graph.

Proposition 15.

It often simpler to consider inducing vertices. The following property is the specialization of the Proposition 15 to inducing vertices.

Proposition 16.

Next we consider the relationship \(\mathrel{\approx_G}\) induced by a graph \(G\) and show that any pair of vertices \(a \mathrel{\approx_G}b\) is also equivalent with respect to membership in sets of inducing vertices in the induced independence model of \(G\). An independence model\(I\) satisfies the inducing vertex equivalence property with respect to \(\mathrel{\lessapprox}\) if for all vertices \(a,b\in V\), if \(a\mathrel{\approx}b\) then for all \(i,j\in V\) and \(C\subseteq V\), it holds that \(a\in \operatorname{IV}(i,j,C,I)\) if and only if \(b\in \operatorname{IV}(i,j,C,I)\).

Proposition 17.

Consider the following property that generalizes the inducing vertex equivalence property to inducing sets.

An independence model\(I\) satisfies the inducing set equivalence property with respect to \(\mathrel{\lessapprox}\) if for all vertices \(d\in V\) and all non-empty sets \(D,E\subset V\), such that \(E,D\subseteq [d]_\approx^G\), and all \(i,j\in V\) and \(C\subseteq V\), it holds that \(D\in \operatorname{IS}(i,j,C,I)\) if and only if \(E\in \operatorname{IS}(i,j,C,I)\).

The inducing set equivalence property, unlike the inducing vertex equivalence property, is not guaranteed to hold in all graphs. For instance, consider Graph \(G_3\) of Figure 2. In this graph, \([c]_\approx=\{\, c,d,e \,\}=\operatorname{IV}(a,b,\emptyset,G_3)\) which illustrates Proposition 17. The fact that \({a} \perp\!\!\!\!\perp_{G_3} {b}\ |\ {cde}\) shows that the inducing set property does not hold.

Theorem 18.

The following corollary of Theorem 18 follows from Theorem 11.

Corollary 3. \(G\) is essentially acyclic if and only if \({I}{(G)}\) satisfies the inducing set equivalence property with respect to \(\mathrel{\lessapprox}_G\).

As shown in subsequent sections, inducing vertices and derived concepts like induced arrowheads are also useful for developing separational characterizations of the separation equivalence of separable graphs (Section 8), representing the equivalence classes of separable graphs (Section 9), and identifying essentially separable graphs (Section 10).

7 Graphical characterizations of separation equivalence↩︎

In this section we provide two graphical characterizations of the separation equivalence of two graphs. First we show that two separable graph are separation equivalent if and only if they have the same adjacencies and same minimal inducing walks. This characterization is a direct generalization of the characterizations of separation equivalence for directed acyclic graphs [15], chain graphs [16], and ancestral graphs [17] to separable graphs.

We begin by defining the property of two graphs having the same adjacencies. Two graphs have the same adjacencies if for every edge in one graph there is a corresponding edge with the same endpoints in the other graph and vice versa. Note that the definition of same adjacencies does not require the corresponding edges to be of the same type. In other words, only the endpoints of the edges matter and not their endmarks.

Next we define the property of two graphs having the same minimal inducing walks. We define the property based on an equivalence relation over collider walks rather than walk equality.11 To motivate the need to introduce an equivalence relation, consider the graph \(a\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) and the graph \(a \ \text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\ c\). These two graphs are separation equivalent but their sets of minimal inducing walks are disjoint.

Thus, in order to characterize separation equivalence we need to introduce an equivalence relation. In particular, two collider walks \(\gamma\) and \(\omega\) are equivalent \(\gamma\equiv \omega\) if \(\text{\rmfamily\upshape ver}({\gamma}) = \text{\rmfamily\upshape ver}({\omega})\) and \(\text{\rmfamily\upshape sec}({\gamma})=\text{\rmfamily\upshape sec}({\omega})\) or \(\text{\rmfamily\upshape ver}({\mathop{\mathrm{rev}}(\gamma)}) = \text{\rmfamily\upshape ver}({\omega})\) and \(\text{\rmfamily\upshape sec}({\mathop{\mathrm{rev}}(\gamma)})=\text{\rmfamily\upshape sec}({\omega})\) where \(\mathop{\mathrm{rev}}(\gamma)\) is the walk with the same edges as \(\gamma\) but the opposite traversal order. Two graphs have the same minimal inducing walks if for every minimal inducing walk\(\omega\) in one graph there is a corresponding minimal inducing walk\(\omega'\) such that \(\omega \equiv \omega'\) and vice versa.

Theorem 19.

We illustrate this theorem with two examples. Let \(\text{\rmfamily\upshape MIW}(G)\) be the set of minimal inducing walks in a graph \(G\). Consider graphs \(G_4\) and \(G_5\), from Figure 4. The two graphs have the same adjacencies and \(\text{\rmfamily\upshape MIW}(G_4)=\text{\rmfamily\upshape MIW}(G_5)=\emptyset\). Thus, by Theorem 19, \(G_4 \equiv G_5\). Next consider the graph \(G_1\) from Figure 1 and graph \(G_8\) from Figure 7. These two graphs have the same adjacencies and \(\text{\rmfamily\upshape MIW}(G_1)=\{a \ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b, a\ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ d, a\ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\ e\}\equiv \{a \ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\ b, a \ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\ d, a \ \text{---}\!\!\!\!\succ\! \ c \ \!\prec\!\!\!\!\text{---}\ e\} = \text{\rmfamily\upshape MIW}(G_8)\). Thus, by Theorem 19, \(G_1 \equiv G_8\).

Figure 7: Separable graph G_8 is equivalent to graph G_1 of Figure 1.

Next we present a useful characterization of separation equivalence and describe a useful property related to this characterization. This characterization is refinement of the first characterization where we compare minimal discriminating inducing walks rather than minimal inducing walks. In order to define minimal discriminating inducing walks, we need a few additional definitions. A section on an inducing walk is discriminated if the section is not anterior to either endpoint of the inducing walk. An inducing walk discriminates a collider section if the section is discriminated by the walk. An inducing walk is a (simple) discriminating inducing walk if it contains exactly one discriminated section and a compound discriminating inducing walk if it contains more than one discriminated section. Note that an inducing walk containing no discriminated sections is a self-inducing walk.

Two graphs have the same minimal discriminating inducing walks if for every minimal discriminating inducing walk\(\omega\) in one graph there is a corresponding minimal discriminating inducing walk\(\omega'\) such that \(\omega \equiv \omega'\) and vice versa.

Theorem 20.

For the graphs \(G_8\) from Figure 7 and \(G_1\) from Figure 1 the set of minimal inducing walks and the set of minimal discriminating inducing walks are identical, that is, every minimal inducing walkin these graphs is also a minimal discriminating inducing walk.

The next proposition shows that discriminated sections of minimal discriminating inducing walks contain inducing vertices and that all other vertices are not inducing vertices.

Proposition 21.

This proposition along with Proposition 16 play an essential role in proving that our structure identification algorithmidentifies all required arrowheads.

=0

Our next characterization is refinement of the first characterization where we compare minimal discriminating inducing walks rather than minimal inducing walks. In order to define minimal discriminating inducing walks, we need a few additional definitions. A section on an inducing walk is discriminated if the section is not anterior to either endpoint of the inducing walk. An inducing walk discriminates a collider section if the section is discriminated by the walk. An inducing walk is a (simple) discriminating inducing walk if it contains exactly one discriminated section and a compound discriminating inducing walk if it contains more than one discriminated section. Note that an inducing walk containing no discriminated sections is a self-inducing walk. Two graphs \(G\) and \(G'\) have the same minimal discriminating inducing walks if and only if \(G \equiv_\text{\rmfamily\upshape MDIW}G'\) where \(\text{\rmfamily\upshape MDIW}\) is the collider walk projectionof a graph the the set of minimal discriminating inducing walks in the graph.

Theorem 22.

This characterization and is useful for testing the equivalence of two separable graphs as compared to using of Theorem 19. In order to use Theorem 19 to test equivalence, one need to enumerate minimal inducing walks. Using Theorem 22, however, one is only required to enumerate minimal inducing walks. Because minimal discriminating inducing walks are a subset of minimal inducing walks, the use of this characterization for testing equivalence can reduce the computational cost of testing.

Our final characterization compares induced arrowheads rather than minimal inducing walks or minimal discriminating inducing walks.

8 Separational characterization of separation equivalence↩︎

In this section we show that two separable graphs are separation equivalent if and only if they have the same vertex separability and same induced arrowheads.

We begin by defining the property of two graphs having the same vertex separability. Two graphs have the same vertex separability if, for every pair of vertices, the pair is separable in one graph if and only if it is separable in the other. This property is useful because it is a graph separation property that, when the graphs are assumed separable, is equivalent to the graphical condition that the graphs have the same adjacencies. Consequently, the separational property of same vertex separability can replace the graphical property of same adjacency in Theorems 19 and 22.

Next we define the property of two graphs having the same induced arrowheads. The induced arrowheads of a graph are defined in terms of the vertex property of being an inducing vertex defined in Section 6, and two properties of pairs of vertices: vertex separability and the arrowhead inducing property. A pair of vertices \(\left( b,d \right)\) is arrowhead inducing at \(b\) if there exists \(i,j,C\) such that \(b\in \operatorname{IV}(i,j,C,G)\) and \(d\not\in \operatorname{IV}(i,j,C,G)\). A pair of vertices \(\left( a,b \right)\) has an induced arrowhead at \(b\) if the pair is arrowhead inducing at \(b\) and the pair is not vertex separable. The induced arrowheadproperty of a pair of vertices is a graph separation property as the property of begin an inducing vertex and vertex separability are both graph separation properties.

Note that the definition of an induced arrowhead  due to the fact it is a graph separation property, makes no mention that an edge has an arrowhead endmark. The following proposition, shows that, despite this property, the existence of an induced arrowhead on an edge in a graph implies the existence of an exclusive arrowhead on that edge.

Proposition 23.

Two graphs \(G\) and \(G'\) have the same induced arrowheads if for every pair of vertices \(\left( a,b \right)\) in \(G\), the pair has an induced arrowhead at \(b\) in \({I}{(G)}\) if and only if the pair has an induced arrowhead at \(b\) in \({I}{(G')}\). Note that the property is separational, that is, it is defined in terms of graph separation properties of the two graphs.

Theorem 24.

We illustrate this theorem with two examples. Consider graphs \(G_4\) and \(G_5\), from Figure 4. The two graphs have the same adjacencies and neither graph has any induced arrowheads. Thus, by Theorem 24, \(G_4 \equiv G_5\). Next consider graph \(G_1\) from Figure 1 and graph \(G_8\) from Figure 7. These two graphs have the same adjacencies and both graphs have the same four induced arrowheads: an induced arrowhead at \(c\) on edges \({e(a, c)}, {e(b, c)}, {e(d, c)},\) and \({e(d, c)}\). Thus, by Theorem 24, \(G_1 \equiv G_8\).

Finally, we note that, unlike the characterizations in Section 7, this characterization is not graphical, but rather separational, in the sense that it can be defined purely in terms of the induced independence models of the two graphs. The fact that this characterization, and the definitions of same vertex separability and same induced arrowheads are separational is useful for developing structure identification algorithms that use statistical tests of independence. In particular, this allows for the identification of adjacencies and arrowheads sufficient to identify the equivalence class of a graph from statistical tests under suitable assumptions.

9 Representing equivalence classes of separable graphs↩︎

In Algorithm ¿fig:alg:InducedArrowheadsCanonical? we define the algorithm that takes a mixed graph and returns a mixed graph with the same adjacencies while preserving arrowheads on edges only if they have induced arrowheads.

We illustrate the algorithm by applying it to Graph \(G_1\) of Figure 1. The result is Graph \(G_8\) shown in Figure 7. The graph has the same adjacencies at \(G_1\). Each of the arrowhead endmarks on an edge is an induced arrowhead on the edge. For instance, the edge \(a \ \text{---}\!\!\!\!\succ\! \ c\) has an induced arrowhead at \(c\) due to the facts that \(c\in \operatorname{IV}(a,b,\emptyset,G)\) and \(a\not\in \operatorname{IV}(a,b,\emptyset,G)\).

Next we consider properties of the algorithm. First we establish that the algorithm preserves separation equivalence if applied to a separable graph.

Theorem 25.

Next, we consider different types of representations of equivalence classes of graph. The equivalence class of \(a\in A\) given equivalence relations \(\equiv\) is denoted \(\left[{a}\right]_{A}^{\equiv}\) but we use \(\left[{a}\right]_{A}\) when the equivalence relation is clear from context. A function \(f\in {A} \mapsto {B}\) is a canonical representation function for equivalence classes of \(A\) with respect to \(\equiv\) if it is the case that \(a\equiv a'\) if and only if \(f(a) = f(a')\) for all \(a,a'\in A\). A function \(f\in {A} \mapsto {A}\) is a projection if \(f(f(a))=f(a)\) for \(a\in A\). A function \(f\in {A} \mapsto {A}\) is a canonical projection for \(A\) with respect to equivalence relation \(\equiv\) if \(f\) is a projection and, for \(a\in A\), it holds that \(f(a)\equiv a\). Thus, a canonical projection is a type of canonical representation. Furthermore, showing that a function is a canonical representation function does not require showing \(f(a) \equiv a\). The following theorem shows that the function is a canonical projection.

Theorem 26.

We relate the representation of an equivalence class of separable graph to a generalization of the concept of the largest graph to mixed graphs. The concept of the largest chain graph was introduced in [16]. A graph \(G'\) is a largest equivalent simple graph of \(G\) if \(G'\equiv G\) and \(G'\) is simple and \(G'\) has the largest number of tail endmarks of any simple separable graph equivalent to \(G\). Let \(\text{\rmfamily\upshape Largest}(G)\) be the set of largest equivalent graphs to \(G\). Frydenberg showed that for chain graphs, every equivalence class contains a unique largest graph that is equivalent to the members of the equivalence class. The next corollary follows directly from Theorem 26 — the fact that is a canonical projection — and generalizes Frydenberg’s uniqueness result to separable graphs.

Corollary 4.

Finally, we related the representation of an equivalence class to anterial graphs.

Corollary 5.

10 Identifying essentially separable graphs↩︎

In this section, we develop the algorithm, a constraint-based graphical structure identification algorithmthat uses only independence tests. We show that identifies the separation‑equivalence class of essentially separable graphs under perfect testing and provide a bound on the number of independence tests required.

The algorithm is shown in Algorithm 8. The algorithm outputs a simple graph \(G\) as a representation for an equivalence class of essentially separable graphs. The use of a simple graph is justified by Corollary 2.

Figure 8: The Algorithm

We begin with an overview of the algorithm. The algorithm starts with a simple complete undirected graph \(G\), that is, a graph in which all edges are undirected and there is an undirected edge between every pair of vertices. The algorithm systematically searches for separating sets \(C\) of increasing size for pairs of adjacent variables \(i\) and \(j\) and uses independence model \(I={I}{(P^*)}\) to test whether \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\). If the test determines that \(i\) and \(j\) are separated by \(C\) then the edge between \(i\) and \(j\) is removed. The algorithm then identifies the inducing vertices \(\operatorname{IV}(i,j,C,I)\) and uses them to add arrowhead endmarks to existing edges. The algorithm continues to try to remove edges until it has considered separator sets of sufficient size.

Unlike many independence testbased graphical structure identification algorithms, the algorithm adds orientation information and determines the adjacency structure concurrently and uses this orientation information to restrict the search for separating sets. In particular, the algorithm implicitly uses the following induced arrowhead identification rule to add arrowheads to the current representation \(G\).

Orientation Rule 1 (Induced arrowhead identification rule). If there is an edge \({e(k, l)}\) in simple graph \(G\) such that there exists vertices \(i\) and \(j\) and vertex set \(C\) such that \(k\in \operatorname{IV}(i,j,C,I)\) and \(l\not\in \operatorname{IV}(i,j,C,I)\), change the endmark at \(k\) on \({e(k, l)}\) to be an arrowhead.

The induced arrowhead identification rule is a sound orientation rule under the assumption that \(I={I}{(P^*)}\) provides perfect testing for an essentially separable graph \(G^*\). This is due to the fact that induced arrowheads are exclusive arrowheads (Proposition 23). Note that the algorithm uses previously identified orientation information to restrict attention to sets of vertices that are potentially anterior separating sets. This restriction is justified by the following theorem and the soundness of the added arrowheads under the assumption of perfect testing.

Proposition 27.

In order to effectively terminate the algorithm, we need to an upper bound the size the minimal separating sets for a pair of vertices that are adjacent in the current graph \(G\). Proposition 27 and the correctness of Orientation Rule 1 and edge removal provides a simple tighter bound on the size of the minimal separating set in a graph. In particular, if \(C\) is a minimal separator for \(a\) and \(b\) in \(G^*\), then \(|C| \leq |\mathop{\mathrm{Ant}}(ab,G^*)| \leq | \mathop{\mathrm{Ant}}(ab,G)|\). This, however is not a tight bound and leads to excess computation. For instance, if \(G^*\) is undirected and connected the bound is vacuous. In graphs without bidirected edges, the degree of the vertices — the cardinality of the set of adjacent vertices — can be used to bound the size of the minimal separating set. This, however, is not possible for mixed graphs. For instance, consider graph \(G_{11}\) shown in Figure 9. In order to separate \(a\) and \(e\) in \(G_{11}\) the minimal separating set is the set \(\{\, b,c,d \,\}\) that includes vertex \(c\) that is adjacent to neither \(a\) nor \(b\).

This motivates the definition of the induced adjacencies of a vertex. The induced adjacencies of a vertex \(a\) given vertex \(b\) in graph \(G\) is the set \(\text{\rmfamily\upshape iAdj}(a,b,G)\) that contains the vertices connected to \(a\) by collider walk in which every internal vertex is in \(\mathop{\mathrm{Ant}}(ab,G)\). In graph \(G_{11}\), \(\text{\rmfamily\upshape iAdj}(a,b,G)=\text{\rmfamily\upshape iAdj}(b,a,G)=\{\, b,c,d \,\}\).12 The anterior induced adjacencies of a vertex \(a\) given vertex \(b\) in graph \(G\) is the set \(\text{\rmfamily\upshape aiAdj}(a,b,G)=\text{\rmfamily\upshape iAdj}(a,b,G) \cap \mathop{\mathrm{Ant}}(ab,G).\) The next proposition shows that, if \(a\) and \(b\) are separable then the anterior induced adjacencies of \(a\) given \(b\) are sufficient to separate \(a\) and \(b\).

Proposition 28.

Figure 9: Graph G_{11} illustrates that vertex separation is non-local.

The quantity \(\text{\rmfamily\upshape SepSetBound}(a,b,G)\) is the separation set bound for a pair of vertices \(a\) and \(b\) in graph \(G\) and defined to be 0 if \(a\not\in \mathop{\mathrm{Adj}}(b,G)\) and to be \(\text{\rmfamily\upshape SepSetBound}(a,b,G)=\max(|\text{\rmfamily\upshape aiAdj}(a,b,G)|,|\text{\rmfamily\upshape aiAdj}(b,a,G)|)\) otherwise. The following proposition captures the fact that the separation set bound for \(G\) bound the size of the minimal separation set in \(G^*\).

Proposition 29.

We then use this bound to define an overall bound for the graph \(G\). The separation set bound of graph \(G\) is defined to be \(\text{\rmfamily\upshape SepSetBound}(G)=\max_{a,b \in V} \text{\rmfamily\upshape SepSetBound}(a,b,G)\) and use it to determine when to terminate the algorithm.

The following theorem describes the correctness of the algorithm. The correctness result assumes that the \(P^*\) provides perfect testing with respect to \(G^*\) for the algorithm.

Theorem 30.

From Corollaries 4 and 5, the graph \(\text{\rmfamily\upshape SGI}({I}{(G^*)})\) is both the largest graph equivalent to \(G^*\) and an anterial graph equivalent to \(G^*\).

Corollary 6.

We illustrate the algorithm applied to \({I}{(G_2)}\) from Figure 1. The initial graph is the simple complete undirected graph (not shown). The first separation fact that is found is \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {\emptyset}\). The algorithm removes the edge between \(a\) and \(b\) and then computes the set \(\operatorname{IV}(a,b,\emptyset,G)=\{\, c \,\}.\) It then uses Orientation Rule 1 to add arrowhead endmarks at \(c\) on the edges \(e(a,c), e(b,c), e(d,c), e(e,c).\) The results at this point is shown as Graph \(G_9\) in Figure 10. The algorithm then continues to search for separation facts. It next finds that \({a} \perp\!\!\!\!\perp_{G} {d}\ |\ {\emptyset}\), removes the edge \(e(a,d)\), computes the set \(\operatorname{IV}(a,d,\emptyset,G)=\{\, c \,\}\). In this case the application of Orientation Rule 1 adds no new arrowhead endmarks. It next finds \({a} \perp\!\!\!\!\perp_{G} {e}\ |\ {\emptyset}\), removing the edge, and again no new arrowhead endmarks are added. The result at this stage is shown at Graph \(G_{10}\) in Figure 10. The algorithm then finds \({b} \perp\!\!\!\!\perp_{G} {e}\ |\ {\emptyset}\), and removes the edge \(e(b,e)\) and adds no new arrowhead endmarks. No additional independencies are found and the result is the graph \(G_8\) in Figure 7. Note that the adjacencies of \(G_6\) and \(G_2\) are not the same as \(G_2\) is essentially separable. Nonetheless, it does have the same adjacencies as the graph \(G_1\) and the same induced arrowheads.

Figure 10: Graph G_9 and G_{10} are intermediate graphs obtained while applying the algorithm.

The next theorem provides a simple bound on number of independence tests required by the algorithm in terms the properties of a graph equivalent to \(G^*\).

Theorem 31.

11 Discussion↩︎

This paper contributes to a long series of work investigating the properties of families of graphical models and algorithms identifying equivalence classes of graphical models using independence tests. In this section, we discuss aspects of our work as it relates to previous work that has not been discussed in the previous sections.

11.1 Essentially cyclic graphical models↩︎

Cyclic directed graphs have been used to represent the equilibrium of systems with feedback. For instance, [4] considers simple graphs with directed edges and [5] considers reciprocal graphs; graphs with directed and undirected edges with additional restrictions. Both of these families are subfamilies of the mixed graphs considered in this paper.

A characterization of separation equivalence for directed graphs was given by [21]. A structure identification algorithmthat identifies the equivalence class of a directed graphical models under perfect testing was given in [4]. More recently an alternative characterization of separation equivalence for directed graphs was given by [22]. The family of directed graphs includes some essentially cyclic graphs (e.g., graph \(G_3\) from Figure 2).

The characterizations of the separation equivalence of separable graphs given in Sections 7 and 8 include some cyclic graphs but does not include essentially cyclic graphs. A natural generalization of our work and previous work on directed graphs is to provide a characterization of separation equivalence for all mixed graphs, to develop a canonical representation function for the equivalence class of mixed graphs, and to develop structure identification algorithms that identify the equivalence class of mixed graphs.

11.2 Sound and complete representation of equivalence classes↩︎

In this paper, the goal of our structure identification algorithmis to obtain a representation of the equivalence class of the generative graphical model under perfect testing. In fact, the output of SGI provides additional information about the generative structure of the graphical model as all identified arrowheads are exclusive arrowheads and shared by all equivalent separable graphs. A natural goal for a structure identification algorithmit to provide correct information about endmarks (soundness) and as much information about endmarks as possible (completeness). This is typically accomplished through the application of orientation rules. A set of sound and complete orientation rules for directed acyclic graphs was presented by [23] and for ancestral graphs by [24].

From Theorem 26, we know that if \(G\) is a separable graph then \(\text{\rmfamily\upshape InducedArrowheads}(G)\equiv G\). Corollary 4, implies that it is not possible to add any additional arrowheads. This implies that the structure identification algorithmis arrowhead complete in the sense that no additional arrowheads can be added. Developing a set of sound and complete orientation rules for essentially separable graphs (e.g., applied to the output of the algorithm) is a natural next step. In order to accomplish this one needs to extend the class of graphs used to represent the output as in [24]. This is due to the fact that for some separation equivalence classes some but not all of the tail endmarks are exclusive.

The arrowhead completeness of the SGI algorithm enables one to explore the impact of the ontological assumptions about the generative process on the identifiability of features of the equivalence class of the generative model. For instance, if we assume that \(G\) is a directed acyclic graph, then one can use the PC algorithm and the orientation rules R1-R4 of [23] to obtain a sound and complete set of endmarks under perfect testing. However, an equivalent graph, under the weaker assumption that the generative model is essentially separable might not have the same arrowheads. For instance, consider the graph with edges \(a \ \text{---}\!\!\!\!\succ\! \ c\), \(b \ \text{---}\!\!\!\!\succ\! \ c\), \(c \ \text{---}\!\!\!\!\succ\! \ d\). The result of the PC algorithm and the orientation rules under perfect testing adds of an arrowhead at \(d\) on the edge \({e(c, d)}\) which is not added by the SGI algorithm. This is justified by the existence of the equivalent graph in which \({e(c, d)}\) is undirected. Such additional arrowheads are sound when making the ontological assumption that the family generating processes are directed acyclic graphs rather than essentially separable graphs. This situation is similar when assuming \(G\) is an ancestral graph and applying the orientation rules R1-R4 of [24]. Again, one obtains an arrowhead at \(d\) on \({e(c, d)}\) as the orientation rules are sound for ancestral graphs but not for essentially separable graphs.

11.3 Assumption for identification and their plausibility↩︎

The correctness results for the algorithm (Corollary 6) assume perfect testing. In this section we consider the tenability and plausibility of this identification assumption.

A distribution \(P\) is perfect with respect to \(G\) if \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {C} \iff {A} \perp\!\!\!\!\perp_{P} {B}\ |\ {C}\).13 Clearly, if a distribution \(P\) is perfect with respect to \(G\) then \({I}{(P)}\) provides perfect testing for \(G\). We establish the tenability of the perfect testing assumption by establishing the existence of perfect distributions for all essentially separable graphs. This follow from the paper [20] that shows the existence of a perfect distribution for every chain mixed graphs and Theorem 12, every separable graph has an equivalent anterial graph. Other related results for more restricted graph families and distribution families are those of [6], [25], [26].

Next we consider the plausibility of the identification assumption. Previous work has justified the assumption of the generative distribution being a perfect distribution for particular defining distribution families and graph families by showing that, in a specific measure theoretic sense, most distributions that can be represented by a graph are perfect. [6], [25], [26] One can hope to extend these results to richer families of graphs and families of distributions to show the plausibility of the assumption of perfect testing.

11.4 Elucidating the assumptions for identification↩︎

The perfect testing assumption used in Corollary 6 does not provide insight into the nature of the assumptions required the algorithm correctness. The conjunction of the following alternative compatibility conditions are sufficient for to identify structure and provide some insight into the requirements for correctness.

1) Bounded vertex separability perfectness: for all \(i\) and \(j\), the vertices \(i\) and \(j\) are not vertex separable in \(G^*\) if and only if for all \(C\subseteq V \setminus \{\, i,j \,\}\) such that \(|C|< \text{\rmfamily\upshape SepSetBound}(i,j,G^*)\), \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{P^*}\ {j}\ |\ {C}\).

2) Bounded induced arrowhead perfectness: if vertices \(k\) and \(l\) are not vertex separable in \(G^*\), then for all \(i\), \(j\), and \(C\subseteq V\setminus \{\, i,j \,\}\) such that \(|C|<\text{\rmfamily\upshape SepSetBound}(i,j,G^*)\), \[\begin{align} k &\in \operatorname{IV}(i,j,C,{I}{(G^*)}) \wedge l\notin \operatorname{IV}(i,j,C,{I}{(G^*)}) \\ &\iff\; k \in \operatorname{IV}(i,j,C,{I}{(P^*)}) \wedge l\notin \operatorname{IV}(i,j,C,{I}{(P^*)}) \end{align}\]

Informally, the sufficiency of these conditions follows from Theorem 24 and the following informal arguments.

The bounded vertex separability perfectness condition guarantees adjacency correctness in the result of the algorithm. The forward direction of this condition guarantees that no required edge is removed and the reverse direction of the condition guarantees that missing edges are removed. The forward direction of bounded vertex separability is essentially a bounded version of adjacency faithfulness of [27] with the other direction being a bounded local Markov condition (see also [28]).

The bounded induced arrowhead perfectness condition guarantees that any edge in the result of the algorithm will be oriented with an arrowhead if and only if it has an induced arrowhead in \(G^*\). The induced arrowhead is stronger than perfect testing as it requires (e.g.) correctness for all \(i,j\) and all separating sets \(C\) with \(|C| < \text{\rmfamily\upshape SepSetBound}(i,j,G^*)\) but the algorithm uses (e.g.) only minimal separating sets.

Finally, we note that the assumption of perfect testing is also sufficient but not minimal due to the fact that one can recover from (1) failing to remove an edge due to an incorrect test if there is another test later that removes the edge, and (2) failing to orient an induced arrowhead on an edge in \(G^*\) if another edge removed later leads to the orientation of the required induced arrowhead.

11.5 More efficient structure identification algorithms↩︎

Most independence testbased structure identification algorithms, such as the the PC algorithm [6], the FCI algorithm [6] and the FCI+ algorithm [29], use some sort of locality in their search for separatings sets for pairs of variables. For instance, the PC algorithm, when trying to separate vertices \(a\) and \(b\) only consider vertices that are adjacent to \(a\) and \(b\). As discussed in Section 10, this is sufficient in if there are no bidirected edges. If, however, the generative structure includes bidirected edges one needs to augments the candidate set for potential separating sets to include additional vertices. For instance, the FCI [6], RFCI [30], and FCI+ [29] each consider vertices beyond those adjacent to the endpoints of an edge they are trying to remove. In this paper, we also consider extended sets of vertices that we call the set of induced adjacencies. Unlike these other approaches, we do not restrict separating sets to to induced adjacencies but rather allow for a non-local search among vertices that are potentially anterior to the endpoints of the edge that we are trying to remove.

One can, however, consider a more localized version of the algorithm in which we choose potential separating sets for \(i\) and \(j\) using the current graph \(G\). In particular, Proposition 28 shows that the anterior inducing adjacencies provide a more localized separation criterion as compared to search among vertices that are anterior to either \(i\) or \(j\). This, one can choose \(C\) to be a subset of \(\text{\rmfamily\upshape aiAdj}(i,j,G)\) or to be a subset of \(\text{\rmfamily\upshape aiAdj}(j,i,G)\). One complication in doing so, is that, unlike the sets \(\mathop{\mathrm{Ant}}(i,G)\) and \(\mathop{\mathrm{Ant}}(j,G)\), there is no guarantee that \(\text{\rmfamily\upshape aiAdj}(i,j,G) \subseteq \text{\rmfamily\upshape aiAdj}(i,j,G^*)\). Thus if searching from among possible separating sets (e.g.) \(C\subseteq \text{\rmfamily\upshape aiAdj}(i,j,G)\) we need to check all subsets of size \(\leq socs\). It would be interesting to compare alternative structure identification algorithms that use both locality and orientation information to improve computational efficiency.

In addition to computational efficiency, it is important to consider the statistical reliability of structure identification algorithms. There are a number of different approaches to improving reliability including using redundant tests and removing unnecessary tests. The algorithm, after identifying a separating set, determines the complete set of inducing variables for the separated vertices. It is not necessary to identify this entire set as many of the induced arrowheads can be identified on the basis of other separating sets. It would be interesting to explore the reliability of the algorithm as compared with other independence testbased structure identification algorithms and to explore if reliability or efficiency can be improved by using locality and by being lazy about computing complete sets of inducing variable for separated vertices especially when future tests will establish the existence of an arrowhead.

Finally, we note that Classen et al. [29] also provide a polynomial bound for identifying ancestral. The polynomial bound we provide in Theorem 31 is not, however, directly comparable.

11.6 Maximal graphs↩︎

In Section 4, we showed that there are maximal graphs that are not separable. Previous work such as [13] and [7] have provided maximization algorithm for subfamilies of mixed graphs. It would be interesting to develop algorithms that transform a graph into a maximal equivalent graph and study their properties. The properties of maximal graphs are likely to prove useful in extending the results on characterizing separation equivalence to all mixed graphs and in developing identification algorithms for the separation equivalence classes of mixed graphical models.

11.7 Other separation criteria↩︎

The focus of this paper has been on the properties of mixed graphs with respect to d-separation. It would be interesting to consider separable, essentially separable and essentially acyclic graphs defined with respect to other separation criteria. In particular, the \(\sigma\)-separationcriteria has been defined for mixed graphs with directed and bidirected edge. It would be interesting to extend \(\sigma\)-separationto mixed graphs and explore the properties of \(\sigma\)-separable, \(\sigma\)-essentially separable, and \(\sigma\)-essentially acyclicgraphs. In particular, one might expect that all mixed graphs in such an extension, are \(\sigma\)-essentially acyclic, given the work by [8] and [9] related to acyclification. Furthermore, one would then expect that all mixed graphs are \(\sigma\)-essentially separable.

12 Proofs of properties of independence models↩︎

=0 In this section we prove Proposition 1 from Section 2.1.

Proposition 1

Proof. The forward direction follows from the fact that the projection of an independence modelcontains all and only the pairwise independence statements that hold in a graph. For the reverse direction we assume that \(\text{\rmfamily\upshape Pairwise}(I)=\text{\rmfamily\upshape Pairwise}(I')\). Assume that the claim does not hold. In that case there must be an \(\left( A,B,C \right)\) such that either (i) \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I'}\ {B}\ |\ {C}\) or (ii) \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {C}\) and \({A} \perp\!\!\!\!\perp_{I'} {B}\ |\ {C}\). Without loss of generality, assume (i). From decomposition we have \({a} \perp\!\!\!\!\perp_{I} {b}\ |\ {C}\) for \(a\in A\) and \(b\in B\). From pairwise equivalence, we have \({a} \perp\!\!\!\!\perp_{I'} {b}\ |\ {C}\) for \(a\in A\) and \(b\in B\). Finally, from composition we have \({A} \perp\!\!\!\!\perp_{I'} {B}\ |\ {C}\). Thus we have a contradiction and the claim holds. ◻

In this section we prove Propositions 1 and 2 from Section 2.1.

Proposition 1

Proof. The forward direction follows from the fact that the projection of an independence modelcontains all and only the pairwise independence statements that hold in a graph. The reverse direction follows from the fact that every non-pairwise dependence statement \({A} \perp\!\!\!\!\perp_{} {B}\ |\ {C}\) that holds in a independence model\(I\) is a deterministic function of \(\text{\rmfamily\upshape Pairwise}(I)\) and the trivial independence function and the contrapositive versions of the symmetry and decomposition properties applied to the set of pairwise dependent statements that hold in \(I\). ◻

Proposition 2

Proof. Let \(I=\left( {\cal O},T \right)\) and \(L_1, L_2,S_1,S_2\) be disjoint sets of \({\cal O}\).

We define useful projections for sets of tests \(T \subseteq {\cal T}_{{\cal O}}\) for object domain \({\cal O}\).

\[\text{\rmfamily\upshape C}_S(T)= \{\, {\left( A,B,C \right)}\in {\tests_{{\cal O}\setminus S}}\ | \ {\left( A,B,C\cup S \right) \in T \wedge (A\cup B \cup C)\cap S = \emptyset} \,\}\] \[\text{\rmfamily\upshape M}_L(T)= \{\, {\left( A,B,D \right)}\in {\tests_{{\cal O}\setminus L}}\ | \ {\left( A,B,D \right) \in T \wedge (A\cup B \cup D) \cap L = \emptyset} \,\}\]

These projections allow us to provide an alternative definition of the conditional projectionprojection: \[\text{\rmfamily\upshape E}^{L}_{S}(I)= \left( {\cal O}\setminus (L \cup S), \text{\rmfamily\upshape C}_S(T) \cap \text{\rmfamily\upshape M}_L(T) \right).\]

The first property in the proposition then follows from the fact that \(\text{\rmfamily\upshape C}_\emptyset(T)=\text{\rmfamily\upshape M}_\emptyset(T)=T\) and basic set manipulation.

Next we define \(\cap\) for independence models by lifting \(\cap\) on sets to tuples. In particular, \[\left( {\cal O},T \right)\cap \left( {\cal O}',T' \right)=\left( {\cal O}\cap {\cal O}', T \cap T' \right).\] This allows us to relate the composition of conditional projections to intersection for disjoint subsets \(L_1,L_2,S_1,S_2\) of \({\cal O}\) as follows: \[\text{\rmfamily\upshape E}^{L_1}_{S_1}\circ \text{\rmfamily\upshape E}^{L_2}_{S_2}=\text{\rmfamily\upshape E}^{L_1}_{S_1}\cap \text{\rmfamily\upshape E}^{L_2}_{S_2}.\]

Properties (2) and (3) from the proposition then follows from basic properties of sets. ◻

Next we provide an alternative proof that the independence property weak transitivity holds in mixed graphs from Section 2.3.4.

Proposition 5

Proof. Follows from Lemma [lem:open-walks-to-common-vertex:exist-open-walk-between-endpoints], and decomposition. ◻

13 Proofs of useful properties of walks and vertex sets↩︎

13.1 Manipulating walks↩︎

We can use the subsequence operator to define a subwalk. For instance, if \(\omega=\left( e_1,\ldots, e_n \right)\) then \(\gamma=\omega(e_i,e_j)=\left( e_i,\ldots,e_j \right)\) is the subwalk containing all of the edges from \(e_i\) to \(e_j\). We extend the definition of the subwalk operator to allow for the specification of a subwalk via a pair of vertices on the walk or a subsequence of the vertex sequence of the walk. Consider the walk \(\omega=\left( e_1,\ldots,e_{n-1} \right)\) with vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\). We use \(\omega(v_i,v_j)\) to refer to the subwalk of \(\omega\) containing the edges corresponding to adjacent pairs of vertices on the vertex subsequence \(\text{\rmfamily\upshape ver}({\omega})(v_i,v_j)\). We also allow the subwalk operator to be applied to a vertex subsequence of the vertex sequence of the walk. For instance, \(\omega(\left( v_i,\ldots,v_j \right))=\omega(v_i,v_j)\). Note that the subwalk operator can be used to reverse the sequences of edges in a walk. For instance, \(\omega(v_n,v_1)=\left( e_{n-1},\ldots,e_1 \right)\) is the walk whose first vertex is the last vertex of the walk \(\omega\). Note that \(\omega(v_i,v_i)=\omega(\left( \right))=\omega(\left( v_i \right))=\left( \right)\) is an empty walk. We use the binary operator \(\mathbin{+}\) to append two sequences (e.g., \(\omega(e_1,e_n)= \omega(e_1,e_i) \mathbin{+}\omega(e_i,e_n)\))

13.2 Termination properties of walks↩︎

A walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is into \(v_1\) if the edge \({e(v_1, v_2)}\) on \(\omega\) has an arrowhead at \(v_1\), otherwise it is out of \(v_1\). For instance, the walk \(a \ \text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) is out of \(a\) and into \(c\). A walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) is weakly into \(v_1\) if either (1) \(\omega\) is into \(v_1\) or (2) the edge \({e(\mathop{\mathrm{last}}(\sigma_1), \mathop{\mathrm{first}}(\sigma_2))}\) has an arrowhead at \(\mathop{\mathrm{last}}(\sigma_1)\), otherwise it is strongly out of \(v_1\). For instance, the walk \(a \ \text{---}\ b \ \text{---}\!\!\!\!\succ\! \ c \ \text{---}\!\!\!\!\succ\! \ d \ \text{---}\ e\) is strongly out of \(a\) and weakly into \(e\). Note that a walk that is into an endpoint is necessarily weakly into that endpoints and that a walk that is strongly out of an endpoint is necessarily out of that endpoint.

13.3 Open walks and connecting walks↩︎

Next we define a generalization of connecting walks that yields an equivalent definition of vertex separation that is useful for describing and proving results about mixed graphs.

A walk \(\omega\) is open given \(C\) if every collider section of \(\omega\) is anterior to \(C\cup \{\, i,j \,\}\) and every internal vertex on a non-collider section is not in \(C\). If a walk is not open given \(C\) then it is closed given \(C\). Note that the walk \(i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ i \ \text{---}\ b \ \!\prec\!\!\!\!\text{---}\ j\) is open given \(C=\{\, i \,\}.\) A collider section of a walk is open given \(C\) if every vertex is anterior to \(C\) and is closed otherwise. A non-collider section of a walk is open given \(C\) if every vertex on the section that is not an endpoint of the walk is not in \(C.\) Thus, a walk is open given \(C\) if and only if every section of the walk is open given \(C.\)

The concept of shortest open walk often plays an important role in proving separation properties of graphs (including the following lemma). A walk \(\omega\) is a shortest open walk given \(C\) if \(\omega\) is open given \(C\) and there is no shorter walk that is open given \(C\).

The following lemma captures the property that if is there is an open walk between \(i\) and \(j\) given \(C\) there must be another open walk given the \(C\setminus \{\, i,j \,\}.\)

Lemma 1. If walk \(\omega\) between \(i\) and \(j\) is open given \(C\) in graph \(G\) then there is an open walk \(\omega'\) that is open given \(C\setminus \{\, i,j \,\}\) in \(G\).

Proof. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) be the shortest walk between \(i\) and \(j\) that is open given \(C\) such that there is no subwalk including \(\omega\) itself between \(i\) and \(j\) that is open given \(C\setminus \{\, i,j \,\}.\) We consider two cases.

Case 1:  \(C\cap \{\, i,j \,\} = \emptyset.\) In this case, the walk \(\omega\) is open given \(C\setminus \{\, i,j \,\}\). This contradiction the assumption that there is no subwalk open given \(C\setminus \{\, i,j \,\}\) and we have a contradiction.

Case 2:  \(C \cap \{\, i,j \,\} \neq \emptyset.\) Note that the only occurrence of \(i\) on \(\sigma_1\) can be as vertex \(v_1\) and the only occurrence of \(j\) on \(\sigma_m\) can be as vertex \(v_n.\) If the only section containing \(i\) is on \(\sigma_1\) and the only occurrence of \(j\) is on \(\sigma_m\) then \(\omega\) open given \(C\setminus \{\, i,j \,\},\) a contradiction. If \(i\in C\cap \{\, i,j \,\}\) then every occurrence of \(i\) must be in a non-collider section otherwise the walk is not open given \(C\). Similarly for \(j.\) If every occurrence of \(i\) or \(j\) is on collider section that contains a member of \(C\setminus \{\, i,j \,\}\) then \(\omega\) is open given \(C\setminus \{\, i,j \,\},\) a contradiction. Thus there must be a collider section containing a vertex in \(\{\, i,j \,\}\) and no other vertex in \(C\setminus \{\, i,j \,\}\). Without loss of generality, assume \(\sigma_k\) is a collider section containing \(v_l=i\) and no vertex in \(C\setminus \{\, i,j \,\}.\) In this case, the walk \(\omega(v_l,v_n)\) is a shorter walk open given \(C,\) a contradiction.

In all cases we have a contradiction so the lemma must hold. ◻

The following lemma proves that one can transform an open walk given \(C\) into another open walk given \(C\) in which all collider sections are anterial to a vertex in \(C\).

Lemma 2. If there is a walk \(\omega\) between \(i\) and \(j\) that is open given \(C\) then there is a walk \(\omega'\) between \(i\) and \(j\) open given \(C\setminus \{\, i,j \,\}\) in which all collider sections on \(\omega'\) are anterior to \(C\setminus \{\, i,j \,\}\).

Proof. Let \(\omega\) be an open walk given \(C\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\). By Lemma 1, we can assume that \(C\cap \{\, i,j \,\}=\emptyset.\) We construct the required walk \(\omega'\) as follows:

If there is a collider section on \(\omega\) that is anterior to \(v_1\) but not anterior to \(C\) then choose \(i\) to be as large as possible such that \(\sigma_i\) is such a collider section and choose \(i=1\) otherwise. If \(i > 1\) then let \(\gamma_i\) be the shortest anterior walk from \(\mathop{\mathrm{first}}(\sigma_i)\) to \(v_1\) and let \(\gamma_1=\left( \right)\) otherwise. Due to the choice of \(\sigma_i\), the walk \(\gamma_i\) contains no vertices in \(C\).

If there is a collider section on \(\omega\) that is anterior to \(v_n\) but not anterior to \(C\) that is not before \(\sigma_i\) then choose \(j\) to be as small as possible but with \(j\geq i\) such that \(\sigma_j\) is such a section and let \(j=m\) otherwise. If \(j\neq m\) then let \(\gamma_j\) be the shortest walk from a vertex \(v_b\) in \(\sigma_j\) to \(v_n\) and let \(\gamma_j=\left( \right)\) otherwise. Again, due to the choice of \(\sigma_j\), the walk \(\gamma_j\) contains no vertices in \(C\).

Finally, let \(\omega'=\gamma_i \mathbin{+}\omega(\mathop{\mathrm{first}}(\sigma_i),\mathop{\mathrm{last}}(\sigma_j)) \mathbin{+}\gamma_j\). The walk \(\omega'\) is an open walk given \(C\) such that all collider sections are anterior to \(C\). ◻

The following proposition demonstrates that open walks and connecting walks yield the equivalent definitions of vertex separation in a mixed graph.

Lemma 3. There is a connecting walk between \(i\) and \(j\) given \(C\setminus \{\, i,j \,\}\) if and only if there is an open walk between \(i\) and \(j\) given \(C\).

Proof. For the forward direction, assume there is a walk \(\omega\) that is a connecting walk given \(C\). The walk \(\omega\) is also an open walk given \(C\) as every non-collider section contains no vertex in \(C\) and every collider section contains vertex in \(C\) and thus is anterior to \(\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\).

For the backward direction, assume there is a walk between \(i\) and \(j\) that is an open walk given \(C\). From Lemma 1, we can assume that \(C\) does not contain either \(i\) or \(j\). From Lemma [lem:open-give-c:all-colliders-anterior-to-C], we assume that the walk \(\omega\) between \(i\) and \(j\) is open given \(C\) and that every collider section on \(\omega\) is anterior to \(C\). We transform the walk \(\omega\) into walk \(\omega'\) by replacing every collider section \(\tau\) on \(\omega\) that does not contains a vertex in \(C\) with a walk \(\tau'\) between \(\mathop{\mathrm{first}}(\tau)\) and \(\mathop{\mathrm{last}}(\tau)\) that is connecting given \(C\). The walk \(\tau'\) is defined as follows: Let \(\text{\rmfamily\upshape ver}({\tau})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and let \(\gamma_c\) be a shortest anterior walk from a vertex on \(\tau\) to a vertex \(c\in C\). Let the first vertex of \(\gamma'\) be \(v_k\). We define \(\tau'=\tau(v_1,v_k) \mathbin{+}\gamma_c \mathbin{+}\gamma_c(c,v_k) \mathbin{+}\tau(v_k,v_n)\).

Next we show that \(\omega'\) constructed in this way is a connecting walk given \(C\). Consider any collider section \(\tau\) on \(\omega\) that does not contain a vertex in \(C\). Let \(\tau'=\tau(v_1,v_k) \mathbin{+}\gamma_c \mathbin{+}\gamma_c(c,v_k) \\ \mathbin{+}\tau(v_k,v_n)\) with \(\gamma_c\) a shortest anterior walk from \(\tau\) to a vertex \(c\in C\). By choosing the shortest anterior walk the only vertex on \(\gamma'\) in \(C\) is its endpoint \(c\). Thus the only vertex in \(C\) on \(\tau'\) is \(c\) and it appears only once on the walk. If \(\gamma_c\) is a semi-directed walk then \(c\) is on a collider section of \(\gamma_c\mathbin{+}\gamma_c(c,v_k)\) and all other sections of \(\tau'\) are non-collider section on \(\omega'\) due to the fact that the walk \(\tau'\) is strongly out of \(v_1\) and \(v_n\). Furthermore, none of these sections contain a vertex in \(C\). If \(\gamma_c\) is an undirected walk then \(\tau'\) is an undirected walk and every vertex on \(\tau'\) is on a collider section that contains a vertex \(c\in C\).

Thus walk \(\omega'\) constructed in this way is a connecting walk as every collider section contains a vertex in \(C\) and no non-collider section contains a vertex in \(C\). ◻

13.4 Invertible walk decomposition functions↩︎

The decomposition of walks into subwalks will play an important role in proving various results. In this section, we define an invertible walk decomposition. In later section, we define specific walk decompositions.

Let \(W(G)\) be the set of all possible walks in graph \(G\). A walk decomposition of a walk \(\omega \in W(G)\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a set of walks \(\text{\rmfamily\upshape decomp}(\omega) = \{\, \gamma_1, \ldots, \gamma_n \,\}\) such that (1) \(\gamma_i\) is a subwalk of \(\omega\) for \(1 \leq i \leq n\), and (2) every edge \({e(v_{i}, v_{i + 1})}\) on \(\omega\) for \(1 \leq i < n\) is on some subwalk \(\gamma_j\).

A walk decomposition function \(f\) for a set of walks \({\cal W}\subseteq W(G)\) is a function \(f(\omega)\) that maps a walk \(\omega \in {\cal W}\) to a walk decomposition of \(\omega\). If \(f\) is a walk decomposition function for a set of walks \({\cal W}\) we denote the set of possible walk decomposition by \(f({\cal W}) = \bigcup_{\omega \in {\cal W}}{f(\omega)}\).

A walk decomposition function \(f\) for \({\cal W}\) is invertible if there is a function \(f^{-1}\) from \(f({\cal W})\) to \({\cal W}\) such that for all \(\omega\in {\cal W}\) it is the case that \(f^{-1}(f(\omega))=\omega\). The function \(f^{-1}\) is a walk composition function for a walk function \(f\).

13.5 The maximal walk decomposition and walk equivalence↩︎

The maximal walk decomposition of a walk is a walk decomposition into maximal collider walks and maximal treks. A trek is a walk in which all vertices are on non-collider sections. A collider walk \(\gamma\) is a maximal collider walk on \(\omega\) if \(\gamma\) is a subwalk of \(\omega\) and there is no longer subwalk of \(\omega\) that is a collider walk and contains \(\gamma\). A trek \(\tau\) is a maximal trek on \(\omega\) if \(\tau\) is a subwalk of \(\omega\) and there is no other trek that is a subwalk of \(\omega\) and contains \(\tau\). The maximal walk decomposition of \(\omega\) is the walk decomposition $ {{m}}() = {, 1, 1, 2,, {n-1},n ,}$ such that (i) \(\gamma_i\) for \(1 \leq i < n\) is a non-trivial maximal collider walk of \(\omega\), and (ii) \(\tau_i\) for \(1 \leq i \leq n\) is a maximal trek of \(\omega\). The walk decomposition function$ {{m}}$ is invertible due to the fact that a non-collider section of a walk must be a section of a maximal trekand a collider section of a walk must be an internal section of a maximal collider walk. In other words, there is a function $ {{m}}^{-1}$ such that $ {{m}}^{-1}( {{m}}())=\(. If a pair of walks in a maximal walk decompositionof a walk overlaps then one of the walks is a maximal trekand the other is a maximal collider walkand they share exactly one edge. While the first and last edges of a walk must be part of a maximal trekin a maximal walk decompositionof a walk, they can be part of the same maximal trek if there are no collider sections in the walk. The first and last treks of a maximal walk decomposition are called *terminal* treks while treks between two collider walks are called *internal* treks. An internal trek must be into both of its endpoints, a terminal maximal trek with an adjacent maximal collider walk is required to be into one of its endpoints, and the maximal trek of a walk consisting of a single maximal trek is not required to be into either endpoint. For example if walk\)$ is the walk \(a \ \text{---}\ b \ \text{---}\!\!\!\!\succ\! \ c \ \text{---}\ d \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ e \ \!\prec\!\!\!\!\text{---}\ f\) then $ {_{m}}()={, a  b  !!!!!  c, b  !!!!!  c   d  !!!!!!!!!!  e  !!!!! f, e  !!!!! f ,}$.

Next we define the equivalence maximal walk decompositions. Two maximal walk decompositions \(\text{\rmfamily\upshape decomp}(\gamma) \equiv \left( \gamma_1,\ldots,\gamma_n \right)\) and \(\text{\rmfamily\upshape decomp}_w(\omega)=\left( \omega_1,\ldots,\omega_m \right)\) are equal if (1) each walk decomposition contains the same number of subwalks (i.e., \(n=m\)) and, (2) for \(1\leq i \leq n\), if \(i\) is odd the vertex sequence of \(\gamma_i\) and \(\omega_i\) are the same (i.e., \(\text{\rmfamily\upshape ver}({\gamma_i})=\text{\rmfamily\upshape ver}({\omega_i})\)) and if \(i\) is even then \(\gamma_i\equiv \omega_i\). Two walks \(\omega\) and \(\gamma\) are equivalent (denoted \(\omega\equiv \gamma\)) if \(\text{\rmfamily\upshape decomp}_w(\omega)\equiv \text{\rmfamily\upshape decomp}_w(\gamma)\) or \(\text{\rmfamily\upshape decomp}_w(\mathop{\mathrm{rev}}(\omega))\equiv \text{\rmfamily\upshape decomp}_w(\gamma)\) where \(\mathop{\mathrm{rev}}(\omega)\) is the walk with the same edges as \(\omega\) but the opposite traversal order. While two equivalent walks are guaranteed to have the same vertex sequence they need not consist of edges with the same endmarks or have the same section sequence. Consider walks \(a\ \text{---}\!\!\!\!\succ\! \ b \ \text{---}\ c\) and \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b \ \text{---}\!\!\!\!\succ\! \ c\). These two walks are equivalent due to the fact that each walk decomposition consists of a single maximal trek and these maximal treks have the same vertex sequence. The two walks, however, have different section sequences. Now consider the walks \(a \ \text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ c\) and \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b \ \!\prec\!\!\!\!\text{---}\ c\). These two walks are also equivalent. Their walk decompositions are of length three, their maximal treks consist of single edges with the same vertex sequence and their maximal collider walks have the same section sequence.

13.6 Trisections↩︎

The concept of trisections is used in many of the proofs that follow. A walk \(\omega\) is trisection if its section sequence \(\text{\rmfamily\upshape sec}({\omega})=\left( \sigma_1,\sigma_2,\sigma_3 \right)\) has three section and the first and last are of length one. We often denote a trisection by \(\left( i,\sigma,j \right)\). Trisection subwalks of walks are useful. If \(\sigma\) is an internal section on a walk \(\omega\) then there is a unique trisection on \(\omega\) that contains \(\sigma\). This allows us to select a trisection on a walk using an internal section on that walk. A trisection \(\left( i, \sigma, j \right)\) is unshielded in graph \(G\) if there is no edge \({e(i, j)}\) in \(G\) and is shielded otherwise. An important fact that is often used in proofs is that a chordless unshielded trisection \(\left( i,\sigma,j \right)\) whose section \(\sigma\) is a collider section is a minimal inducing walk.

13.7 Decomposing and Composing open walks↩︎

In this section, we describe walk decompositions of open walks into open walks and the openness of the composition of open walks. For some decompositions of an open walk into open subwalks we can guarantee termination properties of the subwalks.14 The openness of a walk composed of two open walks also depends on the termination properties of the subwalks.

Lemma 4. If \(\omega\) is an open walk given \(C\) and \(b\) is an internal vertex on a non-collider section of \(\omega\) then the walks \(\omega(v_1,b)\) and \(\omega(v_n,b)\) are open given \(C\). Furthermore, at least one of the walk is strongly out of \(b\).

Proof. Let \(\omega\) is a open walk given \(C\) in graph \(G\) and \(b\) is an internal vertex on a collider section of \(\omega\). It must be the case that \(b\not \in C\) otherwise \(\omega\) would not be an open walk given \(C\). The walks \(\omega(v_1,b)\) and \(\omega(v_n,b)\) are both open given \(C\) as every collider section on these walks is a collider section on \(\omega\) and must contain a vertex in \(\mathop{\mathrm{Ant}}(C,G)\). Furthermore non-collider sections on either of these walk cannot contain a vertex in \(C\) otherwise the walk \(\omega\) would not be open given \(C\). Finally, one of the walks must be strongly out of \(b\) otherwise \(b\) would be on a collider section of \(\omega\). ◻

Next we define minimal open walks. The concept of a minimal open walk generalizes the concept of a minimal inducing walk and is essential to describe the compositional properties of open walks. A walk \(\gamma\) is a minimal open walk between \(i\) and \(j\) given \(C\) if \(\gamma\) is an open walk given \(C\) and there is no shorter open walk between \(i\) and \(j\) given \(C\) that uses only vertices on \(\gamma\). One of the important properties of a minimal open walk is that the endpoints of the walk do not appear on internal non-collider sections. This property is proved in the following lemma.

Lemma 5. If \(\omega\) is a minimal open walk between \(i\) and \(j\) given \(C\) then neither endpoint of \(\omega\) appears as an internal vertex on a non-collider section of \(\omega\).

Proof. Let \(\omega\) be a minimal open walk given \(C\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\). Suppose the lemma is not true. In this case at least one of the endpoints appears on a non-collider section of \(\omega\). Without loss of generality, assume that \(v_1=v_j\) for \(1 < j < n\). Consider the walk \(\omega'=\omega(v_j,v_n)\). The walk \(\omega'\) is an open walk between \(v_1\) and \(v_n\) by Lemma 4. Furthermore, it is strictly shorter than \(\omega\) and only uses vertices on \(\omega\) as it is a subwalk on \(\omega\). Thus \(\omega\) is not a minimal open walk given \(C\) and we have a contradiction. Thus, neither endpoint can appear as an internal vertex on a non-collider section of a minimal open walk. ◻

Lemma 6. If \(\omega\) is a minimal open walk given \(C\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) and vertex \(b\) is on a collider section \(\sigma_i\) then

(i) the walk \(\omega(v_1,\mathop{\mathrm{first}}(\sigma_i))\) is into \(\mathop{\mathrm{first}}(\sigma_i)\) and is a minimal open walk given \(Cv_n\setminus \mathop{\mathrm{first}}(\sigma_i)\), and

(ii) the walk \(\omega(v_n,\mathop{\mathrm{last}}(\sigma_i))\) is into \(\mathop{\mathrm{last}}(\sigma_i)\) and is a minimal open walk given \(Cv_1\setminus last(\sigma_i)\).

Proof. Let \(\omega\) be a minimal open walk given \(C\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) such that \(b\) is on a collider section \(\sigma_i\). Let \(f_i=\mathop{\mathrm{first}}(\sigma_i)\).

Proof of (i): Consider the walk \(\omega'=\omega(v_1,f_i)\). The walk \(\omega'\) must be into \(f_i\) due to the fact that \(\sigma_i\) is a collider section. Next we show that \(\omega'\) is open given \(Cv_n \setminus f_i\). Every collider section on \(\omega'\) is a collider section on \(\omega\), and thus, from \(\omega\) being open given \(C\), we have that every collider section on \(\omega'\) is anterior to \(Cv_n\setminus f_i\). Every non-collider section on \(\omega'\) is a non-collider section on \(\omega\) except the last section of \(\omega'\) that consists only of the vertex \(b\). From Lemma 5 and the assumption that \(\omega\) is a minimal open walk, we know that \(v_n\) is not on an internal non-collider section of \(\omega'\). Combining this fact and the fact that \(\omega\) is open given \(C\), it must be the case that no non-collider section \(\omega'\) contains a vertex in \(Cv_n\setminus f_i\). Thus \(\omega'\) is an open walk given \(Cv_n\setminus f_i\).

Proof of (ii): the proof is analogous to the proof of (i). ◻

Next we consider the openness of walks obtained by composing open subwalks.

Lemma 7. If walk \(\omega\) between \(i\) and \(j\) and walk \(\gamma\) between \(j\) and \(k\) are both minimal open walks given \(C\) then \(\omega \mathbin{+}\gamma\) is open given \(Cj\) if and only if both \(\omega\) and \(\gamma\) are weakly into \(j\).

Proof. Let walk \(\omega\) between \(i\) and \(j\) and walk \(\gamma\) between \(j\) and \(k\) be minimal open walks given \(C\) that are weakly into \(j\). Let \(\omega'=\omega \mathbin{+}\gamma\).

For the forward direction, assume \(\omega \mathbin{+}\gamma\) is open given \(Cj\). Suppose the lemma does not hold and at least one of \(\omega\) and \(\gamma\) are strongly out of \(j\). This implies that \(j\) must be on a non-collider section on \(\omega \mathbin{+}\gamma\) which implies that the walk is not open given \(Cj\) which is a contradiction.

For the backward direction, assume both \(\omega\) and \(\gamma\) are both weakly into \(j\). First from the fact that both walks are open given \(C\), it must be the case that \(j\not\in C\). Furthermore, from Lemma 5, neither \(\omega\) nor \(\gamma\) contain \(j\) on a non-collider section. Next, due to both walks being weakly into \(j\), \(j\) must be on a collider section. All other collider sections are anterial to some vertex in \(C\) and no non-collider section can contain \(C\) or \(j\). Thus the walk is an open walk given \(Cj\). ◻

Lemma 8. If walk \(\omega\) between \(i\) and \(j\) and walk \(\gamma\) between \(j\) and \(k\) are both open given \(C\) and at least one of \(\omega\) or \(\gamma\) is strongly out of \(j\) then \(\omega \mathbin{+}\gamma\) is open given \(C\).

Proof. Let \(\omega\) be a walk between \(i\) and \(j\) open given \(C\) and \(\gamma\) be a walk between \(j\) and \(k\) given \(C\) and that at least one of \(\omega\) or \(\gamma\) is strongly out of \(j\). Let \(\omega'=\omega \mathbin{+}\gamma\).

Suppose that \(\omega'\) is not open given \(C\).

First, all sections of \(\omega'\) are sections on \(\omega\) or \(\gamma\) except possibly the last section of \(\omega\) and the first section of \(\gamma\). Furthermore every such section is a collider section on \(\omega'\) if and only if it is a collider section on \(\omega\) or \(\gamma\). From the fact that \(\omega\) and \(\gamma\) are open given \(C\), all such sections are open on \(\omega'\) given \(C\). Next the fact that \(\omega\) and \(\gamma\) are open given \(C\) implies that no vertex in the last section of \(\omega\) is in \(C\) and no vertex in the first section of \(\gamma\) is in \(C\). Thus, the only way that \(\omega'\) is not open given \(C\) is if the section containing \(j\) on \(\omega'\) is a collider section. This can only happen if both \(\omega\) and \(\gamma\) are weakly into \(j\) which is a contradiction. Thus the lemma must be true. ◻

13.8 Properties of anterior and posterior sets↩︎

The following proposition of anterior and posterior sets are often used without explicitly referencing the following lemmas.

The vertices posterior to a set of vertices \(A\) in a graph \(G\) is the set \(\mathop{\mathrm{Post}}(A,G)\) containing all vertices in \(A\) and all vertices \(j\in V\) such that there is an anterior walk from a vertex \(a\in A\) to \(j\).

Proposition 32. \[\begin{array}{ll} \mathop{\mathrm{Ant}}(A\cup B,G) \supseteq \mathop{\mathrm{Ant}}(A,G) & (1)\\ \mathop{\mathrm{Ant}}(A\cup B,G)=\mathop{\mathrm{Ant}}(A,G) \text{\quad if\quad} B\subset \mathop{\mathrm{Ant}}(A,G)& (2) \\ \end{array}\]

Proof. Let \(G\) be a graph.

Property (1): For every vertex \(c\in \mathop{\mathrm{Ant}}(A,G)\) there must be an anterior walk from \(c\) to a vertex in \(A\) which implies the existence of an anterior walk from \(c\) to a vertex in \(A\cup B\) and thus \(c\in \mathop{\mathrm{Ant}}(A\cup C,G)\).

Property (2): Property (1) proves one direction so we just need to show \(ant(A\cup B,G) \subseteq \mathop{\mathrm{Ant}}(A,G)\). For every vertex \(c\in \mathop{\mathrm{Ant}}(A\cup B, G)\) then there is an anterior walk \(\gamma\) from \(c\) to a vertex \(d\) in \(A\cup B\). If \(d\in A\) we are done. Otherwise \(d\in B\). Because \(d\in B\subseteq \mathop{\mathrm{Ant}}(A,G)\) there is a walk \(\gamma'\) from \(d\) to a vertex in \(A\). The walk \(\gamma \mathbin{+}\gamma'\) is an anterior walk from \(b\) to a vertex in \(A\) which proves the claim. ◻

Proposition 33. \[\begin{array}{ll} \mathop{\mathrm{Post}}(A\cup B,G) \supseteq \mathop{\mathrm{Post}}(A,G) & (1)\\ \mathop{\mathrm{Post}}(A\cup B,G) = \mathop{\mathrm{Post}}(A,G) \text{\quad if\quad} B\subset \mathop{\mathrm{Post}}(A,G)& (2) \\ \end{array}\]

Proof. Let \(G\) be a graph.

Property (1): For every vertex \(c\in \mathop{\mathrm{Post}}(A,G)\) there must be an anterior walk from a vertex in \(A\) to \(c\) which implies the existence of an anterior walk from a vertex in \(A\cup B\) to \(c\) and thus \(c\in \mathop{\mathrm{Post}}(A\cup C,G)\).

Property (2): Property (1) proves one direction of the property so we just need to show \(\mathop{\mathrm{Post}}(A\cup B,G) \subseteq \mathop{\mathrm{Post}}(A,G)\). For every vertex \(c\in \mathop{\mathrm{Post}}(A\cup B)\) then there is an anterior walk \(\gamma\) from a vertex \(d\) in \(A\cup B\) to \(c\). If \(d\in A\) we are done. Otherwise \(d\in B\). Because \(d\in B\subseteq \mathop{\mathrm{Post}}(a,G)\) there is a walk \(\gamma'\) from a vertex in \(A\) to \(d\). The walk \(\gamma \mathbin{+}\gamma'\) is an anterior walk from a vertex in \(A\) to \(d\) which proves the claim. ◻

The proper anterior set of a set of vertices \(C\) in graph \(G\) is the set \(\mathop{\mathrm{PropAnt}}(C,G)=\mathop{\mathrm{Ant}}(C,G)\setminus C\).

Proposition 34. If \(B\subseteq \mathop{\mathrm{PropAnt}}(A,G)\) then \[B \cup \mathop{\mathrm{PropAnt}}(A\cup B,G) = \mathop{\mathrm{PropAnt}}(A,G).\]

Proof. Assume \(B\subseteq \mathop{\mathrm{PropAnt}}(A,G)\). \[\begin{array}{lll} B \cup \mathop{\mathrm{PropAnt}}(A\cup B,G) & = B\cup \mathop{\mathrm{Ant}}(A\cup B,G)\setminus (A\cup B) & \text{Definition of \;} \mathop{\mathrm{PropAnt}}. \\ & = \mathop{\mathrm{Ant}}(A\cup B, G)\setminus A & \text{Basic set operations.}\\ & = \mathop{\mathrm{Ant}}(A,G) \setminus A & \text{Lemma~\ref{lem:ant-property}}\\ & = \mathop{\mathrm{PropAnt}}(A,G) & \text{Definition of \;} \mathop{\mathrm{PropAnt}}. \\ \end{array}\] ◻

14 Proofs related to the characterization of separable graphs and vertex separation↩︎

In this section, we provide a proof of theorems appearing in Section 3. In particular, we provide a proof of Theorem 9, the characterization of vertex separation, and a proof of Theorem 10, the characterization of separable graphs.

The following lemma is the contrapositive of Proposition 8.

Lemma 9. If two vertices are adjacent in a graph then they are not separable.

Proof. Let \(a\in \mathop{\mathrm{Ant}}(b,G)\). This implies there is an edge \({e(a, b)}\) in \(G\) and the walk consisting of this single edge is a walk between \(a\) and \(b\). There is no separating set \(C \subseteq V\setminus \{\, a,b \,\}\) and thus the two vertices are not be separable. ◻

Lemma 10. The endpoints of a self-inducing walk are not separable.

Proof. A self-inducing walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is an open walk given any vertex set \(C\subseteq V \setminus \{\, v_1,v_n \,\}\) and thus the claim then follows from Lemma 3. ◻

An important anterial property of treks is that every internal vertex of treks is anterior to one of its endpoints.

Lemma 11. For any internal vertex on a trek, there is an anterial subwalk of the trek from the internal vertex to one of the endpoints of the trek.

Proof. We prove the claim by induction on the number of vertices.

For the base case we consider treks of length two. In this case there are no internal vertices and the claim holds vacuously.

For the induction case, assume it is true for all treks of length \(n-1\) and show for treks of length \(n\). Let \(\omega=\left( e_1,\ldots,e_n \right)\) be a trek of length \(n\) with vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n+1} \right)\). The subwalk \(\omega'=\left( e_1,\ldots,e_{n-1} \right)\) is a trek of length \(n-1\) and thus, by the induction hypothesis, there is an anterial subwalk from every internal vertex to either \(v_1\) or \(v_n\). If edge \(e_n\) has a tail at \(v_{n}\) then \(v_{n}\) must be anterior to \(v_{n+1}\) and the claim holds. If edge \(e_n\) has an arrowhead at \(v_n\) then no vertex \(v_i\) of \(\omega\) \(i < n\) can be connected to \(v_n\) by a semi-directed walk otherwise \(\omega\) would have a collider section. This implies that either \(v_n\) is connected to \(v_1\) by and undirected walk or there is a semi-directed walk from \(v_n\) to \(v_1\). In either case, the claim holds. As the claim holds whether the last edge has an arrowhead or tail at the last internal vertex the claim holds of any trek of length \(n\). ◻

The following lemma proves that every vertex on an open walk given \(C\) is anterial to the vertex set \(C\) or an endpoint of the walk.

Lemma 12. Every vertex on an open walk between \(i\) and \(j\) given \(C\) is in \(\mathop{\mathrm{Ant}}(C\cup\{\, i,j \,\},G)\).

Proof. Let \(\omega\) be an open walk between \(i\) and \(j\) given \(C\) in a graph \(G\). Every vertex \(b\) on \(\omega\) is on a collider section or a non-collider of \(\omega\).

Case 1:  \(b\) is on a collider section. From the fact that \(\omega\) is open given \(C\), every collider section is anterior to \(C\cup \{\, i,j \,\}\) and thus the every vertex on a collider section must be in \(\mathop{\mathrm{Ant}}(C\cup\{\, i,j \,\},G)\).

Case 2:  \(b\) is on a non-collider section. Every non-collider section is on a maximal trek and, from Lemma 11, every vertex on a maximal trek is anterior to one of its endpoints. Furthermore, every endpoint of a maximal trek on \(\omega\) is either an endpoints of the walk or a vertex on a collider section. Thus every vertex on a maximal trek must be in the set \(\mathop{\mathrm{Ant}}(C\cup\{\, i,j \,\},G)\).

In either case the vertex must be in the set \(\mathop{\mathrm{Ant}}(C\cup\{\, i,j \,\},G)\) which implies the lemma is true. ◻

Theorem 9

Proof. For the backward direction, assume that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}}.\) In this case, the vertices \(i\) and \(j\) are separated by \(\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\) and thus separable.

For the forward direction, we prove the contrapositive. We assume that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {C}\) where \(C=\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\) and prove that \(i\) and \(j\) are not separable. From, Lemma 3 there must be a walk \(\omega\) between \(i\) and \(j\) that is open given \(C\). We prove by cases.

Case 1:  \(\omega\) contains no collider sections. In this case, all internal vertices are on non-collider sections. If \(\omega\) contains an internal vertex it must be on a non-collider section and in \(C\) which would imply that the walk is not be open given \(C\), so \(\omega\) has no internal vertices. Thus \(\omega\) must contain a single edge \({e(i, j)}\) which, by Lemma 9, implies that \(i\) and \(j\) are not separable.

Case 2:  \(\omega\) contains a collider sections. From the fact that \(\omega\) is open given \(C\), every collider section must be anterior to \(C\cup \{\, i,j \,\}.\) Thus, if \(\omega\) had an internal vertex on a non-collider section, this vertex, by Lemma 12, would be in \(C\) and the walk would be closed given \(C.\) This implies that every internal vertex on \(\omega\) is on a collider section. These facts imply that \(\omega\) is a self-inducing walk which, by Lemma 10, implies that \(i\) and \(j\) cannot be separated.

The lemma holds in each of the exhaustive cases and thus the lemma holds. ◻

Lemma 13. If \(\omega\) is a non-trivial walk between \(i\) and \(j\) in graph \(G\) that is not a self-inducing walk then \(\omega\) is closed given \(C=\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\).

Proof. Let graph \(G\) contain a non-trivial walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) such that \(\omega\) is not a self-inducing walk.

The maximal walk decomposition of \(\omega\) must contain a non-trivial maximal trek because \(\omega\) is not a self-inducing walk. Let \(\omega(v_i,v_k)\) with \(i < k\) be a non-trivial maximal trek. Note that there must be an internal vertex \(v_j\) with \(i < j < k\) on this maximal trek and this vertex is on a non-collider section of \(\omega.\) We consider three cases.

Case 1:  Neither \(v_i\) nor \(v_k\) are on collider section of \(\omega.\) In this case \(i=1\) and \(k=n\) and \(\omega\) is a trek. From the fact that \(\omega\) is non-trivial it contains an internal vertex on a non-collider section. This vertex must be in \(C\) and thus the walk is not open given \(C.\)

Case 2:  Either \(v_i\) or \(v_k\) are on collider sections of \(\omega\) but not both. Without loss of generality, assume \(v_k\) is on a collider section and thus \(i=1.\) If \(v_k\not \in C\) then there is a collider section on \(\omega\) that is not anterior to \(C\) and thus the walk is not open given \(C.\) On the other hand, if \(v_j\in C\) then the internal vertex \(v_j\) is in \(C\). This implies that there is a non-collider section of \(\omega\) that contains a vertex in \(C\) and the walk is not open given \(C.\)

Case 3:  Both \(v_i\) and \(v_k\) are on collider sections of \(\omega.\) If either \(v_k\not \in C\) or \(v_i\not\in C\) there is a collider section on \(\omega\) that is not anterior to \(C\) and thus the walk is not open given \(C.\) On the other hand, if \(\{\, v_i,v_k \,\} \subseteq C\) then the internal vertex \(v_j\) is in \(C\). This implies that there is a non-collider section of \(\omega\) that contains a vertex in \(C\) and the walk is not open given \(C.\) ◻

Lemma 14. A walk \(\omega\) between \(i\) and \(j\) is open given \(\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\) in graph \(G\) if and only if either (i) there is an edge \({e(i, j)}\) in \(G\), or (ii) there is a self-inducing walk between \(i\) and \(j\).

Proof. This follows from Lemmas 9, 10, and 13. ◻

Theorem 10

Proof. Let \(G\) be a graph. For the forward direction, assume that \(G\) is separable. Aiming for a contradiction, suppose that \(G\) contains a self-inducing walk between \(i\) and \(j\). This implies \(i\not\in \mathop{\mathrm{Adj}}(j,G)\) and, from Lemma 10, that \(i\) and \(j\) are not separable. Thus we have a contradiction. Thus \(G\) must not contain a self-inducing walk.

For the reverse direction, assume that \(G\) contains no self-inducing walk. Aiming for a contradiction, assume that \(G\) is not separable. This implies that there is a pair of vertices \(i\not\in \mathop{\mathrm{Adj}}(j,G)\) such that \(i\) and \(j\) are not separable. This implies that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}}\) which implies that there is a walk \(\omega\) between \(i\) and \(j\) that is open given \(\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}.\) From Lemma 14 and \(i\not\in \mathop{\mathrm{Adj}}(j,G)\), however, this walk \(\omega\) must be a self-inducing walk. This is a contradiction as \(G\) does not contain any self-inducing walks and the lemma must hold. ◻

15 Proofs related to essentially acyclic and anterial graphs↩︎

In this section we prove results from Section 5. In addition, we prove a set of useful properties of minimal inducing walks and shortest open walks that are used in this section and in later sections of the appendix.

15.1 Characterization of minimal inducing walks↩︎

Lemma 15. An inducing walk in a graph is minimal if and only if any chord on the walk is (i) between two internal vertices and is directed, or (ii) between an internal vertex and an endpoint of the walk and is either undirected or directed with a tail at the internal vertex.

Proof. Let \(\omega\) be an inducing walk in graph \(G\) with vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and let \({e(v_i, v_j)}\) for \(j > i+1\) be a chord of the inducing walk.

Assume \(\omega\) is minimal but that the chord does not satisfy condition (i) or (ii). We consider the possible endpoint for \({e(v_i, v_j)}\). First note that there can be no edge between the endpoints \(v_1\) and \(v_n\) as in this case \(\omega\) would not be an inducing walk. If \(v_i\) and \(v_j\) are both two internal vertices of \(\omega\) then we are in case (i). If there is either an undirected edge or a bidirected edge, however, then the walk \(\omega(v_1,v_i)\mathbin{+}\left( {e(v_i, v_j)} \right) \mathbin{+}\omega(v_j,v_n)\) would be an inducing walk that uses a subset of the vertices in \(\omega\) and thus \(\omega\) is not minimal. This is a contradiction and thus there is no chord violating condition (i). If one of \(v_i\) and \(v_j\) is an endpoint and the other is internal then we are in case (ii). If \(v_i=v_1\) and there is an arrowhead at \(v_j\) on chord \({e(v_i, v_j)}\) then \(\left( {e(v_1=v_i, v_j)} \right) \mathbin{+}\omega(v_j,v_n)\) would be an inducing walk that uses a subset of the vertices in \(\omega\) and thus \(\omega\) is not minimal. If \(v_j=v_n\) and there is an arrowhead at \(v_i\) on chord \({e(v_i, v_j)}\) then \(\omega(v_1,v_i)\mathbin{+}\left( {e(v_i, v_n=v_j)} \right)\) would be an inducing walk that uses a subset of the vertices in \(\omega\). In either case, \(\omega\) is not minimal. This is a contradiction and there is no chord violating condition (ii).

For the other direction, assume \(\omega\) is an inducing walk such that all of its chords satisfy conditions (i) and (ii). Assume that there is an inducing walk \(\omega'\) between \(v_1\) and \(v_n\) that uses a subset of vertices in \(\omega\). In this case, there must be a chord of \(\omega\) that is on \(\omega'\). Let \({e(v_i, v_j)}\) with \(i < j\) be the first chord, an edge on \(\omega'\) not on \(\omega\). If the first edge of \(\omega'\) is a chord it must be \(v_1=v_i\) and \(v_j \neq v_n\) as such a chord does not satisfy either (i) or (ii). In this case, the edge has a tail at \(v_j\) and cannot be on a collider section on \(\omega'\). This implies that \(\omega'\) is not an inducing walk. If the edge is not the first edge then the vertex \(v_i\) must be an internal vertex on \(\omega'\). If \(v_j=v_n\) then there must be a tail at \(v_i\) on the edge and \(v_i\) is not on a collider section of \(\omega'\). Again \(\omega'\) is not an inducing walk. Finally, if both \(v_i\) and \(v_j\) are internal vertices on \(\omega'\) then the chord must be directed and thus both \(v_i\) and \(v_j\) cannot be a collider section of \(\omega'\) and thus it is not an inducing walk. In each of these cases, we have a contradiction as \(\omega'\) is assumped to be an inducing walkand thus no such \(\omega'\) exists and \(\omega\) must be a minimal inducing walk. ◻

15.2 The minimal inducing walkdecomposition↩︎

In this section, we decompose minimal inducing walks that are not self-inducing walks into minimal discriminating inducing walks. In order to define minimal discriminating inducing walks, we need a few additional definitions. A section on an inducing walk is discriminated if the section is not anterior to either endpoint of the inducing walk. An inducing walk discriminates a collider section if the section is discriminated by the walk. An inducing walk is a (simple) discriminating inducing walk if it contains exactly one discriminated section and a compound discriminating inducing walk if it contains more than one discriminated section. Note that an inducing walk containing no discriminated sections is a self-inducing walk.

A walk decomposition is a minimal inducing walkdecomposition if every walk in the decomposition is a minimal discriminating inducing walk. Finally, a minimal inducing walkdecomposition function is a walk decomposition function that decomposes a minimal inducing walkthat is not a self-inducing walkinto a set of minimal discriminating inducing walks.

A recursive minimal inducing walkdecomposition function $ {_{iw}}$ is given in Algorithm 11. We next prove essential properties and the correctness of the algorithm.

Figure 11: The \text{\rmfamily\upshape decomp}_{iw}algorithm

The first lemma provides sufficient conditions under which a minimal inducing walkcontains another minimal inducing walkas a subwalk.

Lemma 16. If \(\omega\) is a minimal inducing walk with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) in graph \(G\) then

(i) if \(\mathop{\mathrm{first}}(\sigma_i,G)\not\in \mathop{\mathrm{Adj}}(v_1,G)\) then \(\omega(v_1,\mathop{\mathrm{first}}(\sigma_i,G))\) is a minimal inducing walk, and

(ii) if \(\mathop{\mathrm{last}}(\sigma_i,G)\not\in \mathop{\mathrm{Adj}}(v_n,G)\) then \(\omega(\mathop{\mathrm{last}}(\sigma_i,G), v_n)\) is a minimal inducing walk.

Proof. Let \(\omega\) be a minimal inducing walk with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) in graph \(G\). First we prove (i). Assume \(\mathop{\mathrm{first}}(\sigma_i,G) \not\in \mathop{\mathrm{Adj}}(v_1,G)\). This implies that \(\omega'= \omega(v_1,\mathop{\mathrm{first}}(\sigma_i,G))\) is an inducing walk. The walk \(\omega'\) is a minimal inducing walk, by Lemma 15 and the fact that \(\omega\) is a minimal inducing walk. The proof for (ii) is symmetric to the proof of (i). ◻

If a minimal inducing walkcontains a discriminated section it must obey certain adjacency properties that are captured in the next lemma.

Lemma 17. If a minimal inducing walkin graph discriminates a collider section then there is no chord between the endpoints of the minimal inducing walkand a vertex on the discriminated section.

Proof. Let \(G\) be a graph containing a minimal inducing walk\(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) that discriminates section \(\sigma_i\). Assume the lemma does not hold. Then there must be a chord \({e(v_i, v_j)}\) such \(i=1\) or \(i=n-1\) and \(v_j\) is on \(\sigma_i\). Without loss of generalityassume \(i = 1\).

Case 1:  \({e(v_i, v_j)}\) has an arrowhead at \(v_j\). In this case, the walk \(\left( {e(v_i, v_j)} \right)\mathbin{+}\omega(v_j,v_n)\) is an inducing walk that uses a subset of the vertices on \(\omega\) and thus \(\omega\) is not a minimal inducing walk. This is a contradiction.

Case 2:  \({e(v_i, v_j)}\) has a tail at \(v_j\). In this case, the section is not discriminated by \(\omega\) which is a contradiction.

In either case we have a contradiction and the lemma must hold. ◻

The following lemma allows us to decompose a minimal inducing walkthat contains two or more discriminated sections into shorter minimal inducing walks.

Lemma 18. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) discriminates two collider sections \(\sigma_i\) and \(\sigma_j\) with \(1 < i < j < n\) then the subwalks \(\omega(v_1, \mathop{\mathrm{first}}(\sigma_j))\) and \(\omega(\mathop{\mathrm{last}}(\sigma_i), v_n)\) are minimal inducing walks containing discriminated sections.

Proof. Let \(\omega\) be a minimal inducing walk in graph \(G\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) that discriminates two collider sections \(\sigma_i\) and \(\sigma_j\) with \(1 < i < j < n\). Let \(\omega_1 = \omega(v_1, \mathop{\mathrm{first}}(\sigma_j))\) and \(\omega_n = \omega(\mathop{\mathrm{last}}(\sigma_i), v_n)\). Both \(\omega_1\) and \(\omega_n\) are collider walks. From Lemma 17 both are inducing walks. Finally, by Lemma 15 and the fact that \(\omega\) is a minimal inducing walk, both are minimal inducing walks. ◻

Lemma 19. The function $ {_{iw}}$ is an invertible minimal inducing walkdecomposition function.

Proof. If \(\omega\) is a minimal inducing walkthat is not a self-inducing walkthen it must have a discriminated section. The correctness of the walk decomposition function follows from the fact that each added walk is a discriminating inducing walkand Lemma 18, which allows us to decompose a walk into minimal inducing walks with fewer discriminated sections. The walk decomposition function $ {_{iw}}$ is invertible due to the fact that no internal section on a minimal inducing walkcan be repeated. ◻

Lemma 20. If \(\omega\) is a minimal inducing walkin a separable graph \(G\) then every collider section on \(\omega\) is discriminated by some discriminating inducing walkin $ {_{iw}}(, G)$.

Proof. We prove by induction on the number of collider section on the inducing walk. Let \(\omega\) be a minimal inducing walkthat is not a self-inducing walkin a graph \(G\). It must have a discriminated section \(\sigma\).

For the base case, \(\sigma\) is the only collider section of \(\omega\). In this case, the collider section \(\sigma\) must be discriminated by \(\omega\) and we are done.

For the induction case, we assume it is true for walks with \(n\) collider sections and show for \(n+1\) collider sections. First, the collider section \(\sigma\) is discriminated by \(\omega\). If there is a collider section \(\sigma'\) on \(\omega\) closer to \(v_1\) than \(\sigma\) then the walk \(\omega(v_1, \mathop{\mathrm{first}}(\sigma))\) is a collider walk. By Lemma 17 and the fact that \(\omega\) is a minimal inducing walk, the subwalk is also a minimal inducing walk. The walk has at most \(n\) collider sections and thus, by the induction hypothesis, the walk discriminates \(\sigma'\). If there is a collider section \(\sigma'\) on \(\omega\) closer to \(v_n\) than \(\sigma\) then the walk \(\omega(\mathop{\mathrm{last}}(\sigma), v_n)\) is a collider walk. By Lemma 17 and the fact that \(\omega\) is a minimal inducing walk, the subwalk is a minimal inducing walk. The walk has at most \(n\) collider sections and thus, by the induction hypothesis, the walk discriminate \(\sigma'\).

Thus, every collider section of \(\omega\) is discriminated by some discriminating inducing walkthat is a subwalk of \(\omega\). ◻

15.3 Minimal inducing walks in separable graphs↩︎

Lemma 21. If walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) is a discriminating inducing walkin graph \(G\) that discriminates \(\sigma_i\) then \(\sigma_i\) is not anterior to \(\sigma_j\) for \(j\neq i\).

Proof. Let walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) be a discriminating inducing walkin graph \(G\) that discriminates \(\sigma_i\). Every collider section other than \(\sigma_i\) is anterior to \(v_1\) or \(v_n\). Suppose the lemma does not hold and \(\sigma_i\) is anterior to \(\sigma_j\). In this case \(\sigma_i\) is anterior to \(v_1\) or \(v_n\) and thus \(\sigma_i\) is not discriminated by \(\omega\). This is a contradiction so the lemma must hold. ◻

Lemma 22. In a separable graph, no internal section on a minimal inducing walk can be anterior to an adjacent section.

Proof. Let \(G\) be a separable graph. Assume the lemma is not true and that \(\omega\) is a minimal inducing walkthat contains a section \(\sigma_i\) anterior to an adjacent section. From Lemma 20, there is a discriminating inducing walk\(\omega'\) that discriminates \(\sigma\). Result then follows from Lemma 21. ◻

Lemma 23. In a separable graph, a minimal inducing walk does not have a chord between adjacent sections.

Proof. Let \(G\) be a separable graph and \(\omega\) be a minimal inducing walk with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) with a chord between vertex \(v_i\) on section \(\sigma_a\) and vertex \(v_j\) on \(\sigma_{a+1}\).

Case 1:  \(1 < a < m - 1\). In this case, the chord is between two internal sections. By Lemma 15 and minimality, the chord must be directed. Without loss of generality, assume \(v_i \ \text{---}\!\!\!\!\succ\! \ v_j\). This, however, contradicts Lemma 22.

Case 2:  \(a=1 \vee a = m - 1\). In this case, the chord is between an internal section and its adjacent terminal section. By Lemma 15 and minimality, the chord must have a tail at the internal vertex. This, however, contradicts Lemma 22.

In either case we have a contradiction and the lemma must hold. ◻

Lemma 24. In a separable graph, there is no chord on a collider section of a minimal inducing walk.

Proof. Suppose the lemma is not true. Let \(G\) be a separable graph contain a walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) such that there is a chord on collider section \(\sigma_a=\left( {v}_{i},\ldots,{v}_{l} \right)\). Let chord \({e(v_{j}, v_{k})}\) on \(\sigma_a\) be the chord that maximizes \(|k-j|\) and \(i \leq j < k \leq l\).

Case 1:  \({e(v_{j}, v_{k})}\) is undirected or bidirected. In this case the walk \(\omega(v_1,v_j)\mathbin{+}\left( {e(v_j, v_k)} \right) \mathbin{+}\\ \omega(v_k,v_n)\) is an inducing walk that uses a subset of the vertices in \(\omega\) and thus \(\omega\) is not a minimal inducing walk. This is a contradiction.

Case 2:  \({e(v_{j}, v_{k})}\) is directed. Without loss of generality assume that \({e(v_{j}, v_{k})}\) has an arrowhead at \(v_k\). In this case, the walk \(\left( {e(v_j, v_k)} \right)\mathbin{+}\omega(v_k, \mathop{\mathrm{first}}(\sigma_{a+1}))\) is a collider trisection. Furthermore, by Lemma 23 the walk is unshielded and thus is a minimal inducing walk. Due to the fact that \(\sigma_a\) is an undirected walk, the collider trisection is also a self-inducing walk which, by Theorem 10, contradicts the assumption that \(G\) is a separable graph.

Both cases lead to contradictions so the lemma must hold. ◻

Lemma 25. In a separable graph, a minimal inducing walkhas no chord between internal sections that are part of a semi-directed circuit.

Proof. Assume the lemma is not true and let \(G\) be a separable graph containing a minimal inducing walkwith a chord between internal sections that are part of a semi-directed circuit in \(G\). Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) be a shortest minimal inducing walkin \(G\) with a chord between internal sections that are part of a semi-directed circuit in \(G\). The chord must be directed otherwise \(\omega\) would not be a minimal inducing walk. Let chord \({e(v_i, v_j)}\) of \(\omega\) be the chord between internal sections and on a semi-directed circuit with the largest jump, that is, such that \(|j-i|\) is as large as possible. Without loss of generality, assume that \(i<j\) and that edge \({e(v_i, v_j)}\) has an arrowhead at \(v_j\). Let \(v_i\) be on \(\sigma_s\) and \(v_j\) be on \(\sigma_u\). It must be the case that \(1 < s < u < m\). Let \(l_i = \mathop{\mathrm{last}}(\sigma_i)\) and \(f_i=\mathop{\mathrm{first}}(\sigma_i)\). In order for \(v_1\) and \(v_n\) to be separable there must be a discriminated section \(\sigma_t\) on \(\omega\) otherwise \(\omega\) is a self-inducing walk.

Case 1:  Section \(\sigma_t\) is not after \(\sigma_s\) on \(\omega\), that is, \(1< t \leq s\). We consider two subcases. First, \(l_t\not\in \mathop{\mathrm{Adj}}(v_n,G)\). In this case, then the walk \(\omega(l_t, v_n)\) is a minimal inducing walkcontaining a chord between internal sections that is on a semi-directed circuit that is shorter than \(\omega\). This is a contradiction. Second, \(l_t\in \mathop{\mathrm{Adj}}(v_n,G)\). In this case, by Lemma 15, the edge \({e(l_t, v_n)}\) must have a tail which implies that \(\sigma_t\) is not discriminated. Again we have a contradiction.

Case 2:  Section \(\sigma_t\) is not before \(\sigma_u\) on \(\omega\), that is, \(u \leq t < m\). We again consider two subcases. First, \(f_t\not\in \mathop{\mathrm{Adj}}(v_1,G)\). In this case, the walk \(\omega(v_1, f_t)\) is a minimal inducing walkcontaining a chord between internal sections that is on a semi-directed circuit that is shorter than \(\omega\). This is a contradiction. Second, \(f_t\in \mathop{\mathrm{Adj}}(v_1,G)\). In this case, by Lemma 15, the edge \({e(f_t, v_1)}\) must have a tail at \(f_t\) which implies \(\sigma_t\) is not a discriminated section. Again we have a contradiction.

Case 3:  Section \(\sigma_t\) is between \(\sigma_s\) and \(\sigma_u\) on \(\omega\). If there are multiple discriminated section between \(\sigma_s\) and \(\sigma_u\) then choose \(\sigma_t\) to be the closest to \(\sigma_u\). We again consider two subcases. First, \(l_t \in \mathop{\mathrm{Adj}}(v_n,G)\). In this case, the edge \({e(l_t, v_n)}\) must have a tail at \(l_t\) by Lemma 15 which implies \(\sigma_t\) is not a discriminated section. This is a contradiction. Second, \(l_t \not\in \mathop{\mathrm{Adj}}(v_n,G))\). In this case, the walk \(\omega(l_t,v_n)\) must be a self-inducing walk as every collider section between \(\sigma_t\) and \(\sigma_n\) is not discriminated. This, by Theorem 10, contradicts the assumption that \(G\) is separable.

In each case we have a contradiction. Thus, a minimal inducing walk in a separable graph can have no chord between internal sections that is part of a semi-directed circuit. ◻

Lemma 26. In a separable graph, any edge on a minimal inducing walk has an exclusive endmark at any endpoint that is internal to the minimal inducing walk.

Proof. Suppose the lemma is not true. Let \(G\) be a separable graph that contains \(\omega\) minimal inducing walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) such that not all of the internal endmarks on \(\omega\) are exclusive. Without loss of generality assume that the edge is \({e(v_{i-1}, v_{i})}\) for \(1 < i \leq n\) and the edge does not have an exclusive endpoint at \(v_i\).

Case 1:  \(i=2\). In this case, the there must be an \({e'(v_1, v_2)}\) with an tail at \(v_2\). This implies that \(\sigma_2 \subseteq \mathop{\mathrm{Ant}}(\sigma_1,G)\) which contradicts Lemma 22.

Case 2:  \(i > 2\) and \({e(v_{i-1}, v_{i})}\) is bidirected. In this case, the there must be an \({e'(v_{i-1}, v_i)}\) with a tail at \(v_i\). Because the edge is bidirected, the two endpoints are on adjacent sections of \(\omega\). These sections are both collider sections on \(\omega\). Thus there is an internal section anterial to an adjacent section which contradicts Lemma 22.

Case 3:  \(i > 2\) and \({e(v_{i-1}, v_{i})}\) is undirected. In this case, the there must be an \({e'(v_{i-1}, v_i)}\) with an arrowhead at \(v_i\). Because the edge is undirected, the two endpoints are on the same section \(\sigma_a\) of \(\omega\). This implies that the walk \(\left( {e'(v_{i-1}, v_i)} \right)\mathbin{+}\omega(v_i,\mathop{\mathrm{first}}(\sigma_{a+1}))\) is a collider trisection. Furthermore, by Lemma 23, the trisection is unshielded an thus minimal inducing walk. This implies, however, that the trisection is a self-inducing walk which contradicts Theorem 10.

In all three cases we have a contradiction and thus the lemma must hold. ◻

15.4 Properties of shortest open walks↩︎

Recall that a walk \(\omega\) is a shortest open walk given \(C\) if \(\omega\) is open given \(C\) and there is no shorter walk that is open given \(C\).

Lemma 27. Every shortest open walk has no chords between vertices of non-collider sections on distinct maximal treks.

Proof. Let \(\omega\) be a shortest open walk between \(a\) and \(b\) given conditioning set \(C\) and the walk decomposition of \(\omega\) be \(\left( \tau_1,\gamma_1,\tau_2,\ldots, \gamma_{n-1},\tau_n \right)\) with maximal treks \(\tau_i\) open given \(C\) and maximal collider walks \(\gamma_i\) open given \(C\).

Assume that the lemma is not true. Let maximal treks \(\tau_k\) with \(\text{\rmfamily\upshape ver}({\tau_k})=\left( a_1,\ldots, a_m \right)\) and \(\tau_l\) with \(\text{\rmfamily\upshape ver}({\tau_l})=\left( b_1,\ldots, b_n \right)\) be such that there is a chord \({e(a_i, b_j)}\). Let walk \(\omega'=\omega(a_1,a_i) \mathbin{+}{e(a_i, b_j)} \mathbin{+}\omega(b_j,j)\) be the walk obtained by replacing the subwalk from \(a_i\) to \(b_j\) in \(\omega\) by the chord \({e(a_i, b_j)}\). We show that for any chord between \(a_i\) and \(b_j\) the walk \(\omega'\) is a shorter open walk than \(\omega\) which is a contradiction.

If the edge \({e(a_i, b_j)}\) is undirected then there is a section \(\sigma\) on \(\omega'\) that contains both \(a_i\) and \(b_j\). Furthermore, \(\sigma\) must be a non-collider on \(\omega'\) given \(C\) and cannot contain a member of \(C\) as all vertices on \(\sigma\) are on non-collider sections of \(\omega\). In this case, \(\omega'\) is a shorter open walk than \(\omega\) which is a contradiction.

If the edge \({e(a_i, b_j)}\) is directed, we assume, without loss of generality that it is oriented \(a_i \ \text{---}\!\!\!\!\succ\! \ b_j\). In this, case the section \(\sigma\) of \(\omega'\) containing \(a_i\) must be an open non-collider section given \(C\). The section \(\sigma'\) of \(\omega'\) containing \(b_j\) need not be a non-collider section. In the case that it is a non-collider section it is open given \(C\) and \(\omega'\) is a shorter open walk than \(\omega\) which is a contradiction. Next we consider the case in which \(\sigma'\) is a collider section on \(\omega'\). In this case, the section containing \(b_j\) on \(\omega\) is a non-collider section which, by Lemma 12, implies that there is an anterior walk \(\gamma=\left( a_1=b_j,\ldots, a_n \right)\) from \(b_j\) to some vertex \(a_n\in C \cup \{\, i,j \,\}\). In this case, \(\omega'\) must be a shorter open walk than \(\omega\), which is a contradiction.

If the edge \({e(a_i, b_j)}\) is bidirected, \(a_i\) and \(b_j\) are in separate sections on \(\omega'\). As in the case above, if the sections are non-colliders they must be open and if they are colliders, they must be anterior to \(C\cup\{\, i,j \,\}\). Thus, in any combination, \(\omega'\) is a shorter open walk than \(\omega\), which is a contradiction.

Hence, there can be no chord between vertices of non-collider sections on distinct maximal treks. ◻

Lemma 28. Every maximal collider walk in the walk decomposition of a shortest open walk is a minimal inducing walk.

Proof. Let \(\gamma\) be a maximal collider walk on a shortest open walk \(\omega\). Let \(\tau\) and \(\tau'\) be the adjacent maximal treks adjacent to \(\gamma\) on \(\omega\). The endpoints \(\gamma\) are both on non-collider section of distinct maximal treks of \(\omega\). From Lemma 27, there can be no chord between the endpoints and thus \(\gamma\) must be an inducing walk. Furthermore, the walk \(\gamma\) must be minimal or there would be a shorter open walk than \(\omega\). ◻

Lemma 29. A vertex on a non-collider section of a shortest open walk given \(C\) appears only in one non-collider section on the walk.

Proof. Suppose the lemma is not true. Let \(G\) be a graph that contains a walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) that is open given \(C\) such that there are vertices \(v_i\) on non-collider section \(\sigma_h\) and \(v_k\) on non-collider section \(\sigma_j\) on \(\omega\) such that \(v_i = v_k\). Without loss of generalityassume \(i < k\) which implies \(h \leq j\). The walk \(\omega(v_1,v_i) \mathbin{+}\omega(v_j,v_n)\) is a shorter open walk given \(C\) and thus we have a contradiction and the lemma must be true. ◻

15.5 Proofs of Theorems 11 and 12↩︎

In order to prove the theorems we prove a series of lemmas relating to the algorithm.

Lemma 30. The graph \(\text{\rmfamily\upshape Anterialize}(G)\) is a simple graph.

Proof. Let \(G\) be a graph and let \(H=\text{\rmfamily\upshape Anterialize}(G)\). If there is no edge between \(a\) and \(b\) in \(G\) then there is no edge between \(a\) and \(b\) in \(H\). If there are one or more edges between \(i\) and \(j\) in \(G\) then only one edge is added to \(H\) because the choice of edge endmarks is uniquely determined by the existence of anterior walks between \(i\) and \(j\) in \(G\). ◻

A graph \(G\) satisfies the anterial endmark property if the endmarks of every edge \({e(a, b)}\) in \(G\) is such that there is a tail at \(a\) on \({e(a, b)}\) if and only if there is an anterior walk from \(a\) to \(b\) in \(G\).

Lemma 31. A simple graph \(G\) is an anterial graph if and only if the graph satisfies the anterial endmark property.

Proof. For the forward direction, suppose \(G\) is an anterial graph. Assume that the anterial endmark property does not hold. In this case there is an edge \({e(a, b)}\) with an arrowhead at \(b\) and there is an anterior walk \(\omega\) from \(b\) to \(a\). We consider two cases. First, \({e(a, b)}\) has an arrowhead at \(a\). In this case, \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\) and \(b \in \mathop{\mathrm{Ant}}(a,G)\) which imply that \(G\) is not anterial. Second, \({e(a, b)}\) has a tail at \(a\). In this case, the walk \(\omega \mathbin{+}\left( {e(a, b)} \right)\) is a semi-directed circuit and again \(G\) is not anterial. In either case we have a contradiction so the forward direction holds.

For the backward direction, let \(G\) be a simple graph and assume that the graph satisfies the anterial endmark property but is not anterial. We consider two cases. First there is an edge \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\) and an anterior walk \(\omega\) from \(b\) to \(a\) in \(G\). In this case, the graph \(G\) does not satisfy the anterial endmark property. Second there is an edge \(a \ \text{---}\!\!\!\!\succ\! \ b\) and an anterior walk \(\omega\) from \(b\) to \(a\) in \(G\). In this case, the graph \(G\) does not satisfy the anterial endmark property. In either case we have a contradiction and the backward direction holds. ◻

Lemma 32. If \(G\) is a graph then \(\text{\rmfamily\upshape Anterialize}(G)\) is an anterial graph.

Proof. From Lemma 30, the graph \(\text{\rmfamily\upshape Anterialize}(G)\) is simple. Graph \(\text{\rmfamily\upshape Anterialize}(G)\) satisfies the anterial endmark property because every edge \({e(a, b)}\) added to the the graph \(\text{\rmfamily\upshape Anterialize}(G)\) has a tail at \(a\) if and only if there is an anterior walk from \(a\) to \(b\). Thus, by Lemma 31, the graph \(\text{\rmfamily\upshape Anterialize}(G)\) is an anterial graph. ◻

Lemma 33. The graph \(G\) and \(\text{\rmfamily\upshape Anterialize}(G)\) have the same adjacencies.

Proof. Let \(G\) be a graph and let \(H=\text{\rmfamily\upshape Anterialize}(G)\). The algorithm results in a graph \(\text{\rmfamily\upshape Anterialize}(G)\) with the same adjacencies as the input graph \(G\) due to the fact that for every edge \({e(a, b)}\) in \(G\) some edge \({e'(a, b)}\) is added to \(H\) and if there is no edge \({e(a, b)}\) in \(G\) then no edge is added between \(a\) and \(b\) in \(H\). ◻

Lemma 34. If there is an edge \({e(a, b)}\) in \(G\) that has a tail at \(a\) then there is no edge \({e'(a, b)}\) in graph \(\text{\rmfamily\upshape Anterialize}(G)\) with an arrowhead at \(a\).

Proof. Let \(G\) be a graph containing an \({e(a, b)}\) with a tail at \(a\). In this case \(a\in \mathop{\mathrm{Ant}}(b,G)\). This implies that the \({e'(a, b)}\) in \(\text{\rmfamily\upshape Anterialize}(G)\) must be either \(a \ \text{---}\ b\) or \(a \ \text{---}\!\!\!\!\succ\! \ b\). ◻

Lemma 35. There is an anterior walk from \(v_1\) to \(v_n\) in graph \(G\) if and only if there is an anterior walk from \(v_1\) to \(v_n\) in \(\text{\rmfamily\upshape Anterialize}(G)\).

Proof. For the first direction, let \(\gamma\) be an anterior walk from \(v_1\) to \(v_n\) in \(G\). From Lemma 33, we know that there is a walk \(\omega\) in \(\text{\rmfamily\upshape Anterialize}(G)\) with the same vertex sequence. Furthermore, from Lemma 34 the walk \(\omega\) must also be an anterior walk as every undirected edge in \(G\) remains an undirected edge in \(\text{\rmfamily\upshape Anterialize}(G)\) and every directed edge in \(G\) is either an undirected or directed edge in \(\text{\rmfamily\upshape Anterialize}(G)\).

For the other direction, let \(\omega\) be an anterior walk in \(\text{\rmfamily\upshape Anterialize}(G)\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\). Associate with each edge \({e(v_i, v_{i+1})}\) on \(\omega\) an anterior walk on \(\gamma_i\); one must exist due to the fact that an edge \({e(v_i, v_j)}\) in \(\text{\rmfamily\upshape Anterialize}(G)\) has a tail at \(v_i\) if and only if there is an anterior walk from \(v_i\) to \(v_j\) in \(G\). The walk \(\gamma=\gamma_1 \mathbin{+}\cdots \mathbin{+}\gamma_{n-1}\) is an anterior walk from \(v_1\) to \(v_n\) in \(G\). ◻

Lemma 36. If separable graph \(G\) contains minimal inducing walk\(\omega\) then there is a walk \(\omega'\) in \(\text{\rmfamily\upshape Anterialize}(G)\) such that \(\omega' \equiv \omega\).

Proof. Let graph \(G\) contains a minimal inducing walk\(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and let \(G'=\text{\rmfamily\upshape Anterialize}(G)\).

From Lemma 33 there is a walk \(\omega'\) in \(G'\) such that \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\). We consider the possible edge types for each edge \({e(v_{i}, v_{i + 1})}\) for \(1 \leq i < n\) on \(\omega\) and the corresponding type of edge in \(\omega'\).

Case 1:  \(v_i \ \text{---}\ v_{i+1}\). In this case, the edge must be an internal edge (i.e.,\(1 < i < n-1\)) and the corresponding edge on \(\omega'\) must be undirected as \(v_i\in \mathop{\mathrm{Ant}}(v_j,G)\) and \(v_j\in \mathop{\mathrm{Ant}}(v_i,G)\).

Case 2:  \(v_i \ \text{---}\!\!\!\!\succ\! \ v_j\). In this case, the edge must be a terminal edge of \(\omega\) and \(i=1\) or \(i=n\). By Lemma 22, the arrowhead at \(v_j\) must be an arrowhead in the corresponding edge on \(\omega'\).

Case 3:  \(v_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j\). In this case, either \(v_i\) or \(v_j\) must be an internal vertex on \(\omega\). If either endpoint is an internal vertex on \(\omega\), by Lemma 22, it must have an arrowhead endmark at the vertex in the corresponding edge on \(\omega'\).

In all cases, all internal endmarks of edges on \(\omega\) are preserved on edges in \(\omega'\) and thus \(\omega \equiv \omega'\). ◻

Lemma 37. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a minimal inducing walkin separable graph \(G\) then there is a minimal inducing walk\(\omega'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\) in \(\text{\rmfamily\upshape Anterialize}(G)\).

Proof. Let graph \(G\) contains a minimal inducing walk\(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and let \(G'=\text{\rmfamily\upshape Anterialize}(G)\). From Lemma 36 there is a walk \(\omega'\equiv \omega\) in \(G'.\) Due to the fact that \(\omega\) is an inducing walk and Lemma 33, \(\omega'\) must be an inducing walk. Next we show that inducing walk \(\omega'\) is a minimal inducing walk. Suppose that \(\omega'\) is not a minimal inducing walk. In this case, there must be a minimal inducing walk\(\gamma'\) that uses a subset of the vertices of \(\omega'\). Let \({e'(v_i, v_j)}\) be the first edge on \(\gamma'\) that is a chord on \(\omega'\).

Case 1:  \({e'(v_i, v_j)}\) is the first edge of \(\gamma'\).

In this case, \(i = 1\) and the edge \({e'(v_i, v_j)}\) has an arrowhead at \(v_j\) and there must be an edge \({e(v_1, v_j)}\) in \(G\) with an arrowhead at \(v_j\). But this implies that \(\left( {e(v_1, v_j)} \right) \mathbin{+}\omega(v_j,v_n)\) is a shorter inducing walkusing a subset of the vertices on \(\omega\). This implies that \(\omega\) is not a minimal inducing walkwhich is a contradiction.

Case 2:  \({e'(v_i, v_j)}\) is the last edge of \(\gamma'\). In this case \(j=n\) and the proof follows as in Case 1.

Case 3:  \({e'(v_i, v_j)}\) is an internal edge of \(\gamma'\). In this case \(v_i\) and \(v_j\) must both be on collider sections of \(\omega'\). From the fact that the edge is on a minimal inducing walkit must either be bidirected or undirected.

Case 3.1:  \(v_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j\). In this case, there must be an edge \(v_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j\) in \(G\). This, however, implies that \(\omega(v_1,v_i)\mathbin{+}\left( v_j \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j \right) \mathbin{+}\omega(v_j,v_n)\) is a shorter inducing walk using a subset of vertices on \(\omega\). This implies that \(\omega\) is not a minimal inducing walkwhich is a contradiction.

Case 3.2:  \(v_i \ \text{---}\ v_j\). In this case, there must either be an chord \(v_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j\) or a chord with a directed edge between \(v_i\) and \(v_j\) in \(G\). As in Case 3.1, a bidirected edge leads to a contradiction. If, however, there is a directed edge in \(G\), from Lemma 25, we obtain a contradiction.

Thus in all cases we have a contradiction and the lemma must hold. ◻

Lemma 38. If \(G\) is a separable graph and \(\omega'\) is a minimal inducing walkin \(\text{\rmfamily\upshape Anterialize}(G)\) then there is a walk \(\omega \equiv \omega'\) in \(G\).

Proof. Let \(G\) be a separable graph and let \(G' = \text{\rmfamily\upshape Anterialize}(G)\) contain a minimal inducing walk\(\omega'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega'})=\left( {\sigma'}_{1}, \ldots, {\sigma'}_{m} \right)\).

From Lemma 33 there is a walk \(\omega\) in \(G\) such that \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\). Suppose the lemma is not true and that \(\omega \not \equiv \omega'\). Because \(\text{\rmfamily\upshape Anterialize}\) only removes arrowheads there is some \(\sigma_k'\) with \(1 < k < m\) on \(\omega'\) that contains an edge \(v_{l} \ \text{---}\ v_{l + 1}\) such that the edge \({e(v_l, v_{l+1})}\) on \(\omega\) either has an arrowhead at \(v_l\) or \(v_{l+1}\). Without loss of generality assume that \({e(v_l, v_{l+1})}\) has an arrowhead at \(v_l\). Choose \(\sigma_j'\) to be the collider section on \(\omega'\) closest to \(\sigma_1\) that contains an edge \(v_{i} \ \text{---}\ v_{i + 1}\) and an edge \({e(v_i, v_{i+1})}\) with an arrowhead at \(v_i\) on \(\omega\).

Case 1:  \(\omega(v_1,v_{i+1})\) is a collider walk.

By Lemma 32, \(G'\) is an anterial graph. This implies that there can be no chord \({e'(v_{i+1}, v_h)}\) for \(v_h\) on section \(\sigma_{j-1}'\) of \(\omega'\) as the chord must be directed due to the fact that \(\omega'\) is a minimal inducing walkand this would imply there is a bidirected edge with anterial endpoints. This implies, by Lemma 33 and the fact that does not add arrowheads, that \(\omega(l_{j-1},v_{i+1})\) with \(l_{j-1}=\mathop{\mathrm{last}}(\sigma_j)\) is a minimal inducing walkin \(G\). By Lemma 37, this would imply that \({e'(v_{i}, v_{i+1})}\) on \(\omega'\) has an arrowhead at \(v_i\) which is a contradiction.

Case 2:  \(\omega(v_1,v_{i+1})\) is a not a collider walk.

In this case, there must be an edge \(v_{l} \ \text{---}\ v_{l + 1}\) on \(\omega'(v_1,v_{i+1})\) such that the edge \({e(v_l, v_{l+1})}\) has an arrowhead at \(v_{l+1}\) on \(\omega\). Choose \(\sigma_f'\) to be the collider section on \(\omega'\) closest to and before \(\sigma_j'\) that contains an edge \(v_{h} \ \text{---}\ v_{h + 1}\) and an edge \({e(v_h, v_{h+1})}\) with an arrowhead at \(v_h\) on \(\omega\).

Again by Lemma 32, there can be no chord \({e'(v_{h}, v_l)}\) for \(v_l\) on \(\sigma_{f+1}'\) as the chord must be directed due to the fact that \(\omega'\) is a minimal inducing walkand this would imply the existence of a bidirected edge with anterial endpoints. This implies, by Lemma 33 and the fact that does not add arrowheads, that \(\omega(l_{j-1},v_{i+1})\) with \(l_{j-1}=\mathop{\mathrm{last}}(\sigma_j)\) is a minimal inducing walkin \(G\). By Lemma 37, this would imply that \({e'(v_{h}, v_{h+1})}\) on \(\omega'\) has an arrowhead at \(v_{h+1}\) which is a contradiction.

In both cases we have a contradiction and thus \(\omega \equiv \omega'\). ◻

Theorem 12

Proof. Let \(G\) be a graph and \(G' = \text{\rmfamily\upshape Anterialize}(G)\).

First, by Lemma 32, the graph \(G'\) is anterial.

Next we show that if \(G\) is a separable graph then \(G \equiv G'\). To prove equivalence, from the definition of equivalence and Lemma 3, we show that \(G\) and \(\text{\rmfamily\upshape Anterialize}(G)\) have the same open walks. For the forward direction, let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) be a shortest open walk given \(C\) in \(G\). From Lemma 28, every maximal collider walk on \(\omega\) is a minimal inducing walk. From Lemma 36, there is a walk \(\omega'\) in \(G'\) such that \(\omega \equiv \omega'\). From Lemma 35, \(\omega'\) must be an open walk given \(C\) in \(G'\). For the backward direction, let \(\omega'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\) be a shortest open walk given \(C\) in \(G'\). From Lemma 28, every maximal collider walk on \(\omega'\) is a minimal inducing walk. From Lemma 38, there is a walk \(\omega'\) in \(G'\) such that \(\omega \equiv \omega'\). From Lemma 35, \(\omega'\) must be an open walk given \(C\) in \(G'\). Combining the forward and backward directions we have shown that \(G\equiv G'\).

Finally, if \(G\) is a separable graph then the graph \(G'\) must be separable as it is equivalent to separable graph and has the same adjacencies. ◻

The next lemma is directly implied by results from [13].

Lemma 39. if \(G\) is acyclic then there is an equivalent separable anterial graph.

Proof. The result is a consequence of Theorem 3 and Corollary 2 of [13]. ◻

Theorem 11

Proof. For the forward direction, assume \(G\) be an essentially separable graph. By definition, there is an equivalent separable graph \(G_{sep}\). From Theorem 12 there is an equivalent separable anterial graph \(G_{ant}\). As \(G_{ant}\) is an acylic graph, thus the forward direction is proved.

For the backward direction, assume \(G\) is essentially acyclic. Thus there is an acyclic equivalent graph \(G_{acyc}\equiv G\). From Lemma 39, there is an equivalent separable acyclic graph \(G_{sep}\equiv G_{acyc}\). Thus the backward direction is proved. ◻

In order to prove Corollaries 1 and 2 it is useful to define comparison of graph families. The relations \(\subseteq\) and \(=\) are the standard set theoretic comparison of the sets of graphs that allow for the comparison of graphical expressivity of two graph families.

We define \(\sqsubseteq\) and \(\equiv\) in terms of the independence models of the two graph families. These relations are a comparison of the separation expressivity of graph families and are defined as

\[\begin{align} {\cal F}\equiv {\cal H}&\quad \mathrm{if}\quad& \text{\rmfamily\upshape Imodels}({\cal F}) = \text{\rmfamily\upshape Imodels}({\cal H}) \\ {\cal F}\sqsubseteq {\cal H}&\quad \mathrm{if}\quad& \text{\rmfamily\upshape Imodels}({\cal F}) \subseteq \text{\rmfamily\upshape Imodels}({\cal H}) \\ \end{align}\] where \(\text{\rmfamily\upshape Imodels}({\cal H})=\{\, {I}{(H)} \;| \;H\in {\cal H} \,\}\).

The following lemmas related graphical expressivity of graph families to the separational expressivity of graph families and the statistical expressivity of graphical model families.

Lemma 40. If \({\cal F}\sqsubseteq {\cal H}\) then \({\cal M}_{{\cal F}}\sqsubseteq {\cal M}_{{\cal H}}\).

Proof. The lemma holds due to the fact that equivalent graphs define equivalent independence models (Proposition 6) and the set of distributions defined by a graphical model is defined in terms of the independence modelof the defining graph and the fixed defining family of distributions. ◻

Corollary 2

Proof. By definition, \({\cal G}_{sep}\equiv \mathcal{E}({\cal G}_{sep})\). \({\cal G}_{ant}^{sep}= {\cal G}_{ant}\cap {\cal G}_{sep}\) and thus \({\cal G}_{ant}^{sep}\subseteq {\cal G}_{sep}\) which implies that \({\cal G}_{ant}^{sep}\sqsubseteq {\cal G}_{sep}\). From Theorem 12, we have that \({\cal G}_{sep}\sqsubseteq {\cal G}_{ant}^{sep}\). Combining these facts we have \({\cal G}_{sep}\equiv {\cal G}_{ant}^{sep}\). By transitivity, we have \(\mathcal{E}({\cal G}_{sep})\equiv {\cal G}_{ant}^{sep}\), and, by Lemma 40, \({\cal M}_{\mathcal{E}({\cal G}_{sep})}\equiv {\cal M}_{{\cal G}_{ant}^{sep}}\). ◻

Corollary 1

Proof. From Lemma 39 we have \({\cal G}_{acyc}\sqsubseteq {\cal G}_{ant}^{sep}\). From the fact that \({\cal G}_{ant}^{sep}\subseteq {\cal G}_{acyc}\) we also have \({\cal G}_{ant}^{sep}\sqsubseteq {\cal G}_{acyc}\). This implies that \({\cal G}_{acyc}\equiv {\cal G}_{ant}^{sep}\). Using this fact and Corollary 2, we have \(\mathcal{E}({\cal G}_{sep})\equiv {\cal G}_{acyc}\). Then, by Lemma 40, it also follows that \({\cal M}_{\mathcal{E}({\cal G}_{sep})}\equiv {\cal M}_{{\cal G}_{ant}^{sep}}\). ◻

16 Proofs related to inducing vertices and graphical characterizations of essential graph families↩︎

We prove propositions related to inducing vertices and graphical characterizations of essential graph families presented in Section 6 and that are useful in many of the proofs in subsequent sections.

Proposition 13

Proof. Suppose that the induced independence property does not hold in some semi-graphoid independence model.

Let independence model\(I=\left( V,T \right)\) be such a semi-graphoid and let \(A,B,C,D\) be disjoint subsets of \(V\) such that the induced independence property does not hold. In that case, it must be the case that (1) \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and (2) \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {CD}\). In order for the property to not hold it must be the case that either \({A} \perp\!\!\!\!\perp_{I} {D}\ |\ {CB}\) or \({D} \perp\!\!\!\!\perp_{I} {B}\ |\ {CA}\). We consider these two cases.

Case 1:  (3) \({A} \perp\!\!\!\!\perp_{I} {D}\ |\ {CB}\). From (1) and (3) and contraction we have (4) \({A} \perp\!\!\!\!\perp_{I} {BD}\ |\ {C}\). From (4) and weak union we get (5) \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {CD}\) which contradicts (2).

Case 2:  (6) \({D} \perp\!\!\!\!\perp_{I} {B}\ |\ {CA}\). From (1) and (6), symmetry and contraction we have (7) \({B} \perp\!\!\!\!\perp_{I} {AD}\ |\ {C}\). From (7) and weak union and symmetry we get (8) \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {CD}\) which contradicts (2).

In either case we have a contradiction so the induced independence property must hold in every semi-graphoid independence model. ◻

In this section we prove Theorem 14.

An independence model I satisfies the pairwise upward stable property if for all \(C\subseteq D\), if \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C} \Rightarrow {i} \perp\!\!\!\!\perp_{I} {j}\ |\ {D}\).

The following was proved in [20].

Theorem 35. [Corollary 29, Sadeghi 2017] If \(G\) is a graph and independence model \(I\) is such that \(I={I}{(G)}\) then \(G\) is essentially undirected if and only if \(I\) is a graphoid and both the pairwise upward stability and weak transitivity independence properties hold.

Lemma 41. Graph \(G\) is essentially undirected if and only if \({I}{(G)}\) satisfies pairwise upward stability.

Proof. Let \(G\) be a graph. From Propositions 4 and 5, \({I}{(G)}\) is a graphoid that satisfies weak-transitivity. The result then follow from Theorem 35. ◻

An independence model \(I\) is graphical if there is a graph \(G\) such that \(I={I}{(G)}\). Note that graphical independence mdoels as defined in [20] is subset of graphical independence models in our paper as [20] only considers acyclic graph.

Lemma 42. If independence model \(I\) is graphical then \(I\) satisfies pairwise upward stable if and only if contains no inducing vertices.

Proof. Let independence model \(I\) be graphical. This implies there is a graph \(G\) such that \(I={I}{(G)}\). From Propositions 4 and 5, \({I}{(G)}\) is a composition graphoid that satisfies weak-transitivity.

For the forward direction, assume that \(I\) satisfies pairwise upward stability. Aiming for a contradiction, assume that \(I\) contains an inducing vertex \(k\) for \(\left( A,B,C \right)\). Thus we have \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {Ck}\). From \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {Ck}\) and composition there is some \(a\in A\) and \(b\in B\) such that \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {b}\ |\ {Ck}\). From \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and decomposition we have \({a} \perp\!\!\!\!\perp_{I} {b}\ |\ {C}\). Thus, \(I\) does not satisfy pairwise upward stability. This is a contradiction and this direction must hold.

For the reverse direction, assume that \(I\) contains no inducing vertex. Aiming for a contradiction, assume \(I\) does not satisfy pairwise upward stability. In this case there are vertices \(i,j\) and sets \(C\subset D\) such that \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {D}\). If \(|D\setminus C|>1\), we can choose sets \(C' \supseteq C\) and \(D'\subseteq D\) such that \(|D' \setminus C'| < |D\setminus C|\), \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {D}\). Thus, without loss of generality, we assume \(|D\setminus C|=1\). Let \(k=D\setminus C\). In this case \(k\) is an inducing vertex for \(\left( i,j,C \right)\). This is a contradiction and this direction must hold. ◻

Theorem 14

Proof. Let \(G\) be a graph. For the forward direction, assume \(G\) is essentially undirected. By Lemma 41, \({I}{(G)}\) satisfies pairwise upward stability. In addition, \({I}{(G)}\) is graphical, thus by Lemma 42, we have that \({I}{(G)}\) has no inducing vertices.

For the backward direction, assume that \({I}{(G)}\) contains no inducing vertices. By Lemma 42, we have that \({I}{(G)}\) satisfies pairwise upward stability. By Lemma 41 we have that \(I(G)\) must be equivalent to some undirected graph and thus \(G\) is essentially undirected. ◻

In Section 6, we defined the concept of an induced preorder \(\mathrel{\lessapprox}_G\) of a graph \(G\). We consider several ordered independence properties for graphs \(G\) and prove two propositions related to ordering; Propositions 16 and 17.

Lemma 43. If \(b\in \operatorname{IV}(i,j,C,G)\) then there exists a walk between \(i\) and \(b\) that is open given \(Cj\) and, furthermore, any walk between \(i\) and \(b\) that is open given \(Cj\) is weakly into \(b\).

Proof. Let \(G\) be a graph such \(b\in \operatorname{IV}(i,j,C,G)\). From \(b\in \operatorname{IV}(i,j,C,G)\) we have that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\). From Proposition 13 we have \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {Cj}\) and \({j} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {Ci}\). This implies that the there are walks \(\omega_i\) between \(i\) and \(b\) that is open given \(Cj\) and \(\omega_j\) between \(j\) and \(b\) that is open given \(Ci\). The walk \(\omega_i(i,b) \mathbin{+}\omega_j(b,j)\) is a walk between \(i\) and \(j\) and is open given \(Cb\) if and only if both \(\omega_i\) and \(\omega_j\) are into \(b\). Suppose that there is a walk \(\omega_i'\) between \(i\) and \(b\) open given \(Cj\) that is not weakly into \(b\). In this case, the walk \(\omega_i' \mathbin{+}\omega_j\) is a walk open given \(C\) which is a contradiction. Similarly, suppose there is a walk \(\omega_j'\) between \(j\) and \(b\) open given \(Ci\) that is not weakly into \(b\). In this case, the walk \(\omega_i \mathbin{+}\omega_j'\) is a walk open given \(C\) which is a contradiction. Thus every such walk must be weakly into \(b\). ◻

Lemma 44. If \(b\in \operatorname{IV}(i,j,C,G)\) then \(b\not \in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\).

Proof. Suppose the proposition is false and that, \(b\in \operatorname{IV}(i,j,C,G)\) and \(b\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\). From the definition of an inducing vertex and \(b\in \operatorname{IV}(i,j,C,G)\) we know that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\). From \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\), there is a walk \(\omega\) between \(i\) and \(j\) that is a connecting walk given \(Cb\). This implies that \(b\not\in \{\, i,j \,\}\) otherwise the walks \(\omega\) would be closed. Thus we have \(b\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\). From \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\), \(\omega\) is not a connecting walk given \(C\). The fact that \(\omega\) is open given \(Cb\), implies that \(\omega\) contains no non-collider section with a vertex in \(Cb\). Thus \(\omega\) must contain one or more collider sections closed given \(C\) but open given \(Cb\). Thus, from \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\), each such closed collider sections must contain \(b\). Because \(b\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\) there must be an anterior walk from \(b\) to a vertex in \(C\cup\{\, i,j \,\}\) in \(G\). Thus, \(\omega\) is an open walk given \(C\) which, by Lemma 3 implies there is a connecting walk given \(C\) which is a contradiction. Therefore, the proposition must be true. ◻

An independence model\(I\) satisfies ordered upward separation stability property with respect to \(\mathrel{\lessapprox}\) if \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \(D \subseteq V_{\mathrel{\gtrapprox}ABC}\setminus ABC\) then \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {CD}\).

Lemma 45. \({I}{(G)}\) satisfies ordered upward separation stability with respect to \(\mathrel{\lessapprox}_G\).

Proof. Let \(G\) be a graph such that, \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {C}\), \(D \subseteq V_{\mathrel{\gtrapprox}ABC} = \mathop{\mathrm{Ant}}(ABC,G) \setminus ABC\). We prove by induction on the size of \(D\)

For the base case, \(|D|=0\) we have \(C=CD\) and thus the independence \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {CD}\) holds by assumption.

For this induction case we assume that the property holds for all sets \(D'\subset D\) (i.e., \(|D'|\leq n-1\)) and and show that it holds for \(|D|=n\). Choose a vertex \(k\in D\) and let \(E=CD\setminus \{\, k \,\}.\) By the induction hypothesis we have \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {E}.\) Aiming at a contradiction assume that \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {B}\ |\ {Ek}.\) This implies that there is some \(i\in A\) and \(b\in B\) such that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Ek}.\) From \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {E}\) we have that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {E}.\) Thus we have that \(k\in \operatorname{IV}(i,j,E,G)\). From Proposition 44, \(k\not \in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\) and, thus, \(k\in \mathop{\mathrm{Ant}}(E\setminus\{\, i,j \,\},G).\) From \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Ek}\), there is some connecting walk between \(i\) and \(j\) given \(Ck\) in \(G\). Let \(\omega\) be any such connecting walk. It must be the case that \(k\) in not on any non-collider section of \(\omega\) and every collider section on \(\omega\) contains a vertex in \(Ek\) otherwise \(\omega\) would not be a connecting walk. Next, from \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {E}\), there must be on some collider section in \(\omega\) that does not contain any vertex in \(E\) but contains \(k\). This, however, implies that \(\omega\) is open given \(E\) as every such collider section is anterior to \(E\) because \(k\in \mathop{\mathrm{Ant}}(E\setminus\{\, i,j \,\},G).\) From Lemma 3, this implies there is a connecting walk between \(i\) and \(j\) given \(E\) which contradicts \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {E}.\) Thus, we have a contradiction and the lemma must be true. ◻

Proposition 15

Proof. Follows from Lemma 45. ◻

Proposition 16

Proof. Follows from Lemma 45. ◻

An independence model\(I\) satisfies ordered downward separation stability property with respect to \(\mathrel{\lessapprox}\) if \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {CD}\) and \(D \cap V_{\mathrel{\gtrapprox}ABC}=\emptyset\) then \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\).

Lemma 46. \({I}{(G)}\) satisfies ordered downward separation stability with respect to \(\mathrel{\lessapprox}_G\).

Proof. Aiming for a contradiction, assume that the claim does not hold for graph \(G\).

Choose \(D\) to be a smallest set such that there exists \(A,B,C\) such that \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {CD}\), \(D\cap V_{\mathrel{\gtrapprox}ABC} = D\cap \mathop{\mathrm{Ant}}(ABC,G) =\emptyset\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {B}\ |\ {C}\). Due to the fact that \(D\cap \mathop{\mathrm{Ant}}(ABC,G) =\emptyset\), there exists a subset \(E \subseteq D\) such that \(E \cap \mathop{\mathrm{Ant}}(CD\setminus E,G) =\emptyset\). From the fact, \(D\) is chosen to be a smallest set and \(D \cap \mathop{\mathrm{Ant}}(ABC,G) = \emptyset\), it must be the case that \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {B}\ |\ {CD\setminus E}\). This implies that there is a connecting walk between \(i\in A\) and \(j\in B\) given \(CD\setminus E\) in \(G\). Let \(\omega\) be any such connecting walk. Because \(\omega\) is a connecting walk given \(CD\setminus E\), every collider section of \(\omega\) must contain a member of \(CD\setminus E\). From the choice of \(E \cap \mathop{\mathrm{Ant}}(CD\setminus E,G) =\emptyset\), no collider section containing a vertex in \(E\) can contain a vertex in \(CD\setminus E.\) This implies that \(\omega\) must also be a connecting walk given \(CD\). This is a contradiction so the proposition holds. ◻

An important property of vertices in the same equivalence class is that they have the same anterior sets.

Lemma 47. If \(a \mathrel{\approx_G}b\) then \(\mathop{\mathrm{Ant}}(a,G)=\mathop{\mathrm{Ant}}(b,G)\).

Proof. We assume that \(a \mathrel{\approx_G}b\) in graph \(G\). In this case, there is an anterior walk \(\omega_{ab}\) from \(a\) to \(b\) in \(G\) and an anterior walk \(\omega_{ba}\) from \(b\) to \(a\) in \(G\). For the first direction, let \(c\in \mathop{\mathrm{Ant}}(a,G)\). This implies that there is an walk \(\omega_{ca}\) from \(c\) to \(a\) in \(G\). The walk \(\omega_{ca} \mathbin{+}\omega_{ab}\) is an anterior walk from \(c\) to \(b\) which implies that \(c\in \mathop{\mathrm{Ant}}(b,G)\). The other directions follows by a similar argument. ◻

Proposition 17

Proof. Let graph \(G\) be such that \(a\in \operatorname{IV}(i,j,C)\) and \(b\in [a]_\approx^G\). This implies that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Ca}\). Thus there is an open walk \(\omega\) between \(i\) and \(j\) given \(Ca\) which implies \(\omega\) contains no non-collider section that contains a vertex in \(Ca\). Because, \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\), there are no non-collider section that is anterior to \(a\) but not \(C\). From Lemma 47, such a section is anterior to \(b\) for any \(b\in [a]_\approx\). This implies that the walk is open given \(Cb\) and thus the claim holds. ◻

We next prove Theorem 18

A useful equivalence relation for graphs is \(a \sim_G b\) which holds if there is an undirected walk between \(a\) and \(b\).

Lemma 48. if \(G\) is acyclic and \(a \mathrel{\approx_G}b\) then \(a \sim_G b.\)

Proof. Let \(G=\left( V,E \right)\) be acyclic, that is, it contains no semi-directed circuit, and let \(a =_G b\).

Case 1:  \(a = b\). In this case, the equality gives \(a \sim_G b\).

Case 2:  \(a \neq b.\) In this case, we have \(a \not\in \mathop{\mathrm{Ant}}(b,G) \wedge b \not\in \mathop{\mathrm{Ant}}(a,G)\). From that fact that \(a\neq b\) there must be anterior walks from \(a\) to \(b\) and from \(b\) to \(a\). Let \(\gamma_{ab}\) be an arbitrary anterior walk from \(a\) to \(b\) and let \(\gamma_{ba}\) be an arbitrary anterior walk from \(b\) to \(a\). If either or both of these walks is not undirected then the walk \(\gamma_{ab} \mathbin{+}\gamma_{ba}\) would be a semi-directed circuit and \(G\) would not be acyclic. This implies that all anterior walk between \(a\) and \(b\) are undirected and thus \(a \sim_G b.\) In either case we have \(a \sim_G b\) so the lemma holds. ◻

Lemma 49. If \(G\) is acyclic then \({I}{(G)}\) satisfies inducing set equivalence property with respect to \(\mathrel{\lessapprox}_G\).

Proof. Let \(G\) be an acyclic graph. Assume that the inducing set property does not hold. In that case there is a set \(D\) such that \(d\in D\) and \(D=[d]_\approx^G\) and \(D \in \operatorname{IS}(A,B,C,G)\) and for \(E\), a non-empty subset \(E\subseteq [d]_\approx^G\) we have \({A} \perp\!\!\!\!\perp_{G} {B}\ |\ {CE}\). From \(D \in \operatorname{IS}(A,B,C,G)\), we have \({A} \perp\!\!\!\!\perp_{I} {B}\ |\ {C}\) and \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {CD}\). From \({A} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {B}\ |\ {CD}\) there must be a walk \(\omega\) between \(i\in A\) and \(j\in B\) that is connecting given \(CD\). From Lemma 12, every vertex on \(\omega\) is in \(\mathop{\mathrm{Ant}}(CDij,G)\). This implies that no vertex in \(D\) can be a non-collider on \(\omega\) otherwise the walk \(\omega\) would not be a connecting walk given \(CD\). Note that for every non-empty \(E\subset [d]_\approx^G\) it is the case that \(\mathop{\mathrm{Ant}}(CDij,G)=\mathop{\mathrm{Ant}}(CDij,G)\). This fact implies that \(\omega\) is also open given \(CE\) which is a contradiction. Thus the claim holds. ◻

The proof of the following lemma relies on definitions of ordered upward-stability (OUS) and ordered downward-stability (ODS) with respect to \(\mathrel{\lessapprox}\) from [20].

An independence model\(I\) satisfies ordered upward-stability (OUS) with respect to \(\mathrel{\lessapprox}\) if \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\) and \(k\in V_{\mathrel{\gtrapprox}ij}\) or \(k \mathrel{\approx}l\in C\) then \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {Ck}\).

An independence model\(I\) satisfies ordered downward-stability (ODS) with respect to \(\mathrel{\lessapprox}\) if \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\) and \(k\in C\) is such that \(k\in V \setminus V_{> C\setminus k}\) and \(k\in V \setminus V_{\mathrel{\gtrapprox}ij}\) then \({i} \perp\!\!\!\!\perp_{} {j}\ |\ {C\setminus k}\)

Lemma 50. If there exists a preeorder \(\mathrel{\lessapprox}\) for \(V\) such that independence model\(I\) for \(V\) satisfies ordered upward separation stability, ordered downward separation stability, and the inducing set equivalence property with respect to \(\mathrel{\lessapprox}\) then OUS and ODS with respect to \(\mathrel{\lessapprox}\) hold for \(I\).

Proof. Let \(\mathrel{\lessapprox}\) be a preorder for \(V\) such that independence model\(I\) for \(V\) satisfies ordered upward separation stability, ordered downward separation stability, and the inducing set equivalence property with respect to \(\mathrel{\lessapprox}\). First, if \(I\) satisfies ordered upward separation stability it satisfies OUS.

Next, we show that \(I\) must satisfy ODS. Aiming for a contradiction, assume that \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C}\) and \(k\) be a vertex such that \(k \in V \setminus V_{>C\setminus k}\) and \(k\in V \setminus V_{\mathrel{\gtrapprox}ij}\) but that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {C\setminus k}.\)

Let \(E= C\cap [k]_\approx\) and \(D = C\setminus E.\) From ordered downward separation stability (Lemma 46), we have that \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {D}.\)

We continue by cases.

Case 1:  \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {Dk}\). We consider two sub-cases.

Case 1.1: , \(|E|=1\). In this case, \(C=Dk\), and from the fact that \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {D}\), we have \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {C\setminus k}\) which is a contradiction.

Case 1.2:  \(|E|>1\). In this case, we again have \(C=DE\). From the fact that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {C\setminus k}\) and \({i} \perp\!\!\!\!\perp_{I} {j}\ |\ {D}\), we have \(E\setminus k \in \operatorname{IS}(i,j,D,I)\). Thus we have that \(E\in \operatorname{IS}(i,j,D,I)\) and, by the inducing set equivalence property, we have \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {C}\) which is a contradiction.

Case 2:  \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{}\ {j}\ |\ {Dk}\). In this case, \(k\in \operatorname{IS}(i,j,D,G)\). From the inducing set equivalence property we have that \(E\in \operatorname{IS}(i,j,D,I)\) and it follows that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{I}\ {j}\ |\ {C}\). Again we have a contradiction.

In every case we have a contradiction and thus ODS must hold in \(I\). ◻

An independence model\(I\) is acyclic if there is an acyclic graph \(G\) such that \(I={I}{(G)}\). Note that in [20], only acyclic graphs are considered so graphical in [20] is equivalent to acyclic in this paper.

Theorem 36. [Theorem 17, Sadeghi 2017] If \(G\) is an acyclic graph then independence model \(I = {I}{(G)}\) if and only if \({I}{(G)}\) is a compositional graphoid that satisfies weak-transitivity and \(\mathrel{\lessapprox}_G\) such that \(I\) satisfies ordered upward-stability and ordered downward-stability with respect to \(\mathrel{\lessapprox}_G\).

Theorem 18

Proof. For forward direction, we assume \(G\) is essentially separable. By Theorem 11, \(G\) is essentially acyclic which implies that there is an equivalent acyclic graph \(H \equiv G\). By Proposition 49, \({I}{(G)}={I}{(H)}\) satisfies the inducing set equivalence property with respect to \(\mathrel{\lessapprox}_G\).

For the other direction, we assume there is a graph \(G\) such that \({I}{(G)}\) satisfies the inducing set equivalence property with respect to preorder \(\mathrel{\lessapprox}_G\). From Propositions 4 and 5, \({I}{(G)}\) is a compositional graphoid that satisfies weak-transitivity. From Lemmas 45 and 46, \({I}{(G)}\) satisfies ordered upward separation stability and ordered downward separation stability with respect to \(\mathrel{\lessapprox}_G\). From Lemma 50, \({I}{(G)}\) satisfies ODS and OUS with respect to \(\mathrel{\lessapprox}_G\). Thus we can apply Theorem 36 to obtain the conclusion that \(I\) is acyclic. From the definitions of an acyclic independence model and essentially acyclic and Theorem 11, we have that \(G\) is essentially separable. ◻

17 Proofs related to the characterizations of separation equivalence↩︎

=0In this section we prove Theorems 19, and 24. Each of these theorems provides an alternative equivalent characterization of the equivalence of two separable graphs. In addition, we prove Proposition 23 that proves that an edge with an induced arrowhead has an exclusive arrowhead.

The goal of this section is to prove Theorems 19, 22, and 24. Each of these theorems provides an alternative equivalent characterization of the equivalence of two separable graphs.

17.1 Equivalence to same adjacencies and induced arrowheads↩︎

Lemma 51. Two equivalent separable graphs have the same vertex separability and the same induced arrowheads.

Proof. Let \(G\) and \(H\) be two equivalent separable graphs. The properties of vertex separability and induced arrowheads are separational properties and invariant to separation equivalence. That is, these properties are completely determined by the independence and dependence statements true in the graph. As \(G\) and \(H\) are equivalent they must agree on these properties. ◻

Lemma 52. Two separable graphs have the same vertex separability if and only if they have the same adjacencies.

Proof. Let \(G\) and \(H\) be two separable graph. From the fact that the two graphs are separable, vertex separability corresponds to adjacency. Thus the two graphs have the same adjacency. ◻

17.2 Same adjacencies and same induced arrowheads to same minimal inducing walks↩︎

Lemma 53. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) is a minimal discriminating inducing walkthat discriminates section \(\sigma_k\) in a graph \(G\), and \(d\) is on \(\sigma_i \neq \sigma_k\) then for all \(C\subseteq V\) it is the case that \(d \not\in \operatorname{IV}(v_1,v_n,C,G)\)

Proof. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) be a minimal discriminating inducing walkthat discriminates section \(\sigma_k\) in a graph \(G\), and \(d\) is on \(\sigma_i \neq \sigma_j\). Suppose that there is a \(C\subseteq V\) such that \(d\in \operatorname{IV}(v_1,v_n,C,G)\). Then by Proposition 44, \(d\not\in \mathop{\mathrm{Ant}}(\{\, v_1,v_n \,\},G)\). This cannot be the case as all sections other than \(\sigma_k\) must be anterior to the endpoints of \(\omega\). Thus we have a contradiction and for all \(C\) it is the case that \(d \not\in \operatorname{IV}(v_1,v_n,C,G)\). ◻

Lemma 54. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a minimal discriminating inducing walkthat discriminates section \(\sigma\) in a separable graph \(G\), and \(b\in \mathop{\mathrm{Post}}(\sigma,G)\) then there is a \(C\subseteq V\) such that \(b\in \operatorname{IV}(v_1,v_n,C,G)\).

Proof. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) be a minimal discriminating inducing walkthat discriminates section \(\sigma\) in a separable graph \(G\) and \(b\in \mathop{\mathrm{Post}}(\sigma,G)\). From separability of \(G\) we have that \({v_1} \perp\!\!\!\!\perp_{G} {v_n}\ |\ {C}\) for \(C=\mathop{\mathrm{PropAnt}}(\{\, v_1,v_n \,\},G)\). The walk \(\omega\) is open given \(b\) and thus, by Lemma 3, \({v_1} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {v_n}\ |\ {Cb}\). Thus \(b \in \operatorname{IV}(v_1,v_n,C,G)\). ◻

Lemma 55. If separable graph \(G\) contains a minimal discriminating inducing walk\(\omega\) with \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) that discriminates \(\sigma_j\) and edge \({e(d, b)}\) such that \(d\) is on a section \(\sigma_i\neq \sigma_j\) of \(\omega\) and \(b\in \mathop{\mathrm{Post}}(\sigma_j,G)\) then the edge \({e(d, b)}\) has an induced arrowhead at \(b\) in \(G\).

Proof. Follows from Lemmas 53 and 54. ◻

Proposition 23

Proof. Let \(G\) be a graph containing an edge \({e(d, b)}\) that is an induced arrowhead at \(b\). In this case, there are vertices \(v_1\) and \(v_n\) vertex set \(C\) such that \(b\in \operatorname{IV}(v_1,v_n,C,G)\) and \(d\not\in \operatorname{IV}(v_1,v_n,C,G)\).

From \(b\in \operatorname{IV}(v_1,v_n,C,G)\) and Lemma 43 there is a vertex set \(C\) and connecting walks \(\gamma_1\) between \(v_1\) and \(b\) open given \(Cv_n\) and \(\gamma_n\) between \(v_n\) and \(b\) open given \(Cv_1\) both weakly into \(b\) such that \({v_1} \perp\!\!\!\!\perp_{G} {v_n}\ |\ {C}\).

Suppose that \({e(d, b)}\) does not have an exclusive arrowhead at \(b\) in \(G\). Let \({e'(d, b)}\) be an edge with a tail at \(b\) in \(G\). Consider the walk \(\omega'=\gamma_1(v_1,b) \mathbin{+}\left( {e'(d, b)}, {e'(d, b)} \right) \mathbin{+}\gamma_n(b,v_n)\). The walk \(\omega'\) is open given \(Cd\). This however implies that \(d\in \operatorname{IV}(i,j,C,G)\) and we have a contradiction. Thus the edge \({e(d, b)}\) must have an exclusive arrowhead at \(b\) in \(G\). ◻

Lemma 56. If separable graphs have the same adjacencies and same induced arrowheads then they have the same minimal inducing walks.

Proof. Let \(G\) and \(G'\) be anterial graphs with the same adjacencies and same induced arrowheads.

We prove that every minimal inducing walkin \(G\) is a minimal inducing walkin \(G'\) by induction on the number of collider sections.

For the base case, we consider a minimal inducing walk\(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and collider section \(\sigma=\left( v_2,v_{n-1} \right)\) in \(G\). By Lemma 55, the edge \({e(v_1, v_2)}\) on \(\omega\) has an induced arrowheadat \(v_2\) and the edge \({e(v_{n-1}, v_n)}\) on \(\omega\) has an induced arrowheadat \(v_{n-1}\). This implies the edge \({e'(v_1, v_2)}\) on \(\omega'\) has an induced arrowheadat \(v_2\) and the edge \({e'(v_{n-1}, v_n)}\) on \(\omega'\) has an induced arrowheadat \(v_{n-1}\) in \(G'\). By Proposition 23, these edges have arrowheads at \(v_2\) and \(v_{n-1}\).

By Lemma 24, \(\sigma\) is chordless in \(\omega\) and must also be chordless in \(\omega'\) due to \(G\) and \(G'\) having the same adjacencies.

Suppose \(\sigma\) is not a collider section on \(\omega'\) in \(G'\). In this case there must be an edge \({e'(v_{i}, v_{i + 1})}\) with \(1 < i < n-1\) with an arrowhead at either \(v_i\) or \(v_{i+1}\). Without loss of generalityassume there is an arrowhead at \(v_i\). Furthermore choose smallest \(j > 1\) such that there is an edge \({e'(v_{j}, v_{j + 1})}\) with an arrowhead at \(v_j\). In this case the walk \(\omega'(v_1,v_{j+1})\) is an unshielded collider trisection due to Lemma 23 and the fact that \(G\) and \(G'\) have the same adjacencies. This implies that \({e'(v_{j}, v_{j + 1})}\) has an induced arrowhead at \(v_j\) which in turn implies that \({e(v_{j}, v_{j + 1})}\) on \(\omega\) has an induced arrowhead. Finally, by Proposition 23, the arrowhead must be exclusive in \(G\) and \(\sigma\) is not a collider section which is a contradiction.

For the inductive case, we assume that the lemma is true for minimal inducing walks with \(n\) collider sections and prove for \(n+1\) collider section. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) be a minimal inducing walkwith \(n+1\) collider section. \(\omega\) must discriminate some section \(\sigma_j\) otherwise it would be a self-inducing walkand that would imply that \(G\) is not separable by Theorem 10.

Let \(\gamma'\) with \(\text{\rmfamily\upshape ver}({\gamma'})=\left( {v}_{i},\ldots,{v}_{k+1} \right)\) be the collider trisection containing \(\sigma_j\) on \(\omega'\). In that case, by an argument similar to the base case, the edge \({e'(v_{i}, v_{i + 1})}\) and the edge \({e'(v_{k}, v_{k + 1})}\) have arrowheads at their internal vertices and \(\gamma(v_{i+1},v_{k})\) is a collider section.

If \(i > 2\) then by Lemmas 16 and 17, \(\omega(v_1,v_{i+1})\) must be a minimal inducing walkand there must be must be a minimal inducing walk\(\omega'(v_1,v_{i+1})\).

Similarly, if \(k < n-1\) then by Lemmas 16 and 17, \(\omega(v_k, v_n)\) must be a minimal inducing walkand there must be a minimal inducing walk\(\omega'(v_k, v_n)\).

Thus, \(\omega'(v_1,v_n)\) is an inducing walk. If \(\omega'(v_1,v_n)\) is not a minimal inducing walkthen there must be an edge \({e((, v)}_h,v_j)\) with \(h < i\) and \(v_j\) on \(\sigma_j\) with an arrowhead at \(v_j\) or \({e((, l)},v_j)\) with \(l > k\) and \(v_j\) with an arrowhead at \(v_j\). In either case, \(\omega(v_1,v_n)\) cannot be a minimal inducing walkwhich is a contradiction. Thus \(\omega'(v_1,v_n)\) is a minimal inducing walk. ◻

17.3 Same adjacencies and minimal inducing walks to equivalence↩︎

Lemma 57. If anterial graphs \(G\) and \(G'\) have the same adjacencies and the same minimal inducing walks and \(\omega\) is a shortest open walk given \(C\) in \(G\) then there is a walk \(\omega'\) such that \(\omega \equiv \omega'\).

Proof. Let \(G\) and \(G'\) be two anterial graphs with the same adjacencies and same minimal inducing walks. Let walk \(\omega\) be a shortest open walk given \(C\) in \(G\) and let \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape decomp}_w(\omega)=\left( \tau_1, \gamma_1, \tau_2,\ldots, \gamma_{m-1},\tau_m \right)\). From \(G\) and \(G'\) having the same adjacencies, there is a walk \(\omega'\) in \(G'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\). Suppose that \(\omega \not \equiv \omega'\). In order for this to be the case, the walk decompositions of the two walks must be different. First note that if two walks have different maximal treks they must have different maximal collider walks. Thus there must be a \(\gamma_i\) on \(\omega\) such that \(\gamma_i'\) on \(\omega'\) is not a maximal collider walk on \(G'\). From Lemma 28, every \(\gamma_i\) on \(\omega\) must be a minimal inducing walkin \(G\). Anterial graphs are simple graphs and thus every endmark on an edge is exclusive, thus \(\gamma_i \equiv \gamma_i'\). Suppose, however, that \(\gamma_i'\) is not a maximal collider walk. In this case there must be a subwalk \(\omega'(v_h,v_j)\) that contains \(\gamma_i'\) that is a maximal collider walkon \(\omega'\). This must be an inducing walkdue to Lemma 27 and the fact that \(G\) and \(G'\) have the same adjacencies. In this case, there must be a minimal inducing walk\(\gamma'\) between \(v_h\) and \(v_j\) that contains a subset of the vertices on \(\omega'(v_h,v_j)\) in \(G'\). Thus there must be a minimal inducing walk\(\gamma \equiv \gamma'\) in \(G\). This however contradicts the assumption that \(\omega\) is a shortest open walk as the walk \(\omega(v_1,v_h)\mathbin{+}\gamma \mathbin{+}\omega(v_j,v_n)\) would be a shorter open walk given \(C\). Thus there is no such \(\gamma_i\) and \(\omega\equiv \omega'\). ◻

Lemma 58. If the endpoints of a discriminating inducing walk are separable and the walk discriminates section \(\sigma\) then every vertex in \(\mathop{\mathrm{Post}}(\sigma,G)\) is an inducing vertex for the endpoints of the walk.

Proof. Let \(\omega\) be a discriminating inducing walk between \(i\) and \(j\) that discriminates section \(\sigma\) in graph \(G\). Because \(i\) and \(j\) are separable there is some set that separates them. Let \(C\) be an arbitrary separating set for \(i\) and \(j\), that is, \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\). Let \(v\) be a arbitrary vertex in \(\mathop{\mathrm{Post}}(\sigma,G)\). The walk \(\omega\) is open given \(C\cup\{\, v \,\}\) and, by Lemma 3 there is a connecting walk \(\omega'\) in \(G\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cv}\). Thus \(v\) is an inducing vertex for \(i\) and \(j\) given \(C\). ◻

Lemma 59. Every shortest anterior walk in an anterial graph is chordless.

Proof. Let \(G\) be an anterial graph and \(\omega\) be a shortest anterior walk with vertex sequence \(\text{\rmfamily\upshape ver}({\omega})=\left( v_1,\ldots,v_n \right)\).

Suppose that there \(\omega\) has a chord \({e(v_i, v_j)}\) for \(i < j-1\). If the edge has a tail at \(b_i\) then there would be a shorter anterior walk \(\gamma(v_1,v_i)\mathbin{+}{e(v_i, v_j)}\mathbin{+}\gamma(v_j,v_m)\) an thus there must be an arrowhead at \(v_i\). However, if \(v_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_j\) then there would be a bidirected edge with one endpoint having anterior walk to the other which contradicts \(G\) being an anterial graph. Finally, if \(v_i \ \!\prec\!\!\!\!\text{---}\ v_j\) then there would be a semi-directed circuit in \(G\) which again contradicts \(G\) being an anterial graph. Thus, a shortest anterior walk must be chordless in an anterial graph. ◻

Lemma 60. In an anterial graph, no internal section on a minimal inducing walkcan be anterior to an adjacent section.

Proof. Let \(G\) be an anterial graph. Assume the lemma is not true and that \(\omega\) with \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) is a minimal inducing walkthat contains a section anterior to an adjacent section. Without loss of generalityassume that \(\sigma_i\) is anterior to \(\sigma_{i+1}\) and that there is an anterior walk \(\gamma'=\text{\rmfamily\upshape ver}({\gamma'})=\left( {v}_{p},\ldots,{v}_{q} \right)\) with \(v_p\) on \(\sigma_i\) and \(v_q\) on \(\sigma_j\). Let \(l_i=\mathop{\mathrm{last}}(\sigma_i)\) and \(f_{i+1}=\mathop{\mathrm{first}}(\sigma_{i+1})\) and \(\gamma= \omega(l_i, v_p) \mathbin{+}\gamma' \mathbin{+}\omega(v_q, f_{i+1})\). The edge \({e(l_i, f_{i+1})}\) on \(\omega\) must either be \(l_i \ \text{---}\!\!\!\!\succ\! \ f_{i+1}\) or \(l_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ f_{i+1}\). In the first case, the circuit \(\gamma \mathbin{+}\left( {e(l_i, f_{i+1})} \right)\) is a semi-directed circuit and \(G\) is not an anterial graph. This is a contradiction. In the second case, \(l_i \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ f_{i+1}\) has an anterior walk from one endpoint to the other and thus \(G\) is not an anterial graph. This is a contradiction. In either case, we have a contradiction and thus the lemma must be true. ◻

Lemma 61. If two separable anterial graph \(G\) and \(G'\) have the same adjacencies and same minimal inducing walks then they are equivalent; that is \(G\equiv G'\).

Proof. Let \(G\) and \(G'\) be separable anterial graphs with the same adjacencies and same minimal inducing walks.

Aiming for a contradiction, assume that \(G\not\equiv G'\). Let there be a walk between \(v_1\) and \(v_n\) that is connecting given \(C\) in one walk but not the other. Without loss of generality, assume \({v_1} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {v_n}\ |\ {C}\) and \({v_1} \perp\!\!\!\!\perp_{G'} {v_n}\ |\ {C}\).

Choose \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape decomp}_w(\omega)=\left( \tau_1, \gamma_1, \tau_2,\ldots, \gamma_{m-1},\tau_m \right)\) to be a shortest open walk given \(C\) in \(G\) and let \(\omega'\) be a walk in \(G'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\). \(\omega'\) must not be open given \(C\) in \(G'\) due to \({v_1} \perp\!\!\!\!\perp_{G'} {v_n}\ |\ {C}\).

From Lemma 57, we have \(\omega \equiv \omega'\) which implies that \(\text{\rmfamily\upshape sec}({\omega})=\text{\rmfamily\upshape sec}({\omega'})\). Let \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{p} \right)\), \(f_i=\mathop{\mathrm{first}}(\sigma_i)\) and \(l_i = \mathop{\mathrm{last}}(\sigma_i)\). Note that \(\text{\rmfamily\upshape sec}({\omega})=\text{\rmfamily\upshape sec}({\omega'})\) due to the fact that \(\omega \equiv \omega'\).

Choose smallest \(j\) with \(1 < j < p\) such that \(\omega'(v_1,f_{j+1})\) is not open given \(C\). There must be one otherwise \(\omega'(v_1,v_l)\) would be an open walk given \(C\).

Let \(\gamma_d=\omega(l_h,f_{j+1})\) be a minimal discriminating inducing walkthat discriminates \(\sigma_j\) on walk \(\omega(v_1,f_{j+1})\). Note that \(1 \leq h < j\). It must be the case that \(\sigma_j\) is anterior to \(Cv_1\) in \(G\) otherwise the walk \(\omega\) would not be open in \(G\). Furthermore, \(\sigma_j\) is not anterior to \(C\cup\{\, v_1,f_{j+1} \,\}\) in \(G'\) otherwise the walk \(\omega'(v_1,f_{j+1})\) would be open given \(C\).

Let \(\gamma_f= \text{\rmfamily\upshape ver}({\gamma'})=\left( {a}_{1},\ldots,{a}_{q} \right)\) be a shortest anterior walk from \(f_j\) to a vertex in \(C\cup \{\, v_1,f_{j+1} \,\}\) in \(G\) and let \(\gamma_f'\) be the corresponding walk in \(G'\). By Lemma 59, \(\gamma_f\) must be chordless and, thus, by \(G\) and \(G'\) having the same adjacencies, \(\gamma_f'\) is also chordless.

Choose \(r\) to be largest such that \(a_r\in \mathop{\mathrm{Post}}(\sigma_j,G')\) and let \(s=r+1\) and thus \(a_s \not \in \mathop{\mathrm{Post}}(\sigma_j,G')\). Note that \({e'(a_r, a_s)}\) on \(\gamma_f'\) must have an arrowhead at \(a_r\).

Suppose \(a_s \not \in \mathop{\mathrm{Adj}}(l_{j-1},G')\). In this case the walk \(\omega'(l_{j-1},f_j) \mathbin{+}\gamma'_f(f_j,a_r) \mathbin{+}\left( {e'(a_r, a_s)} \right)\) in \(G'\) must contain a unshielded collider trisection not in \(G\) which is a contradiction due to the fact that the two graphs have the same minimal inducing walks. Thus \(a_s \in \mathop{\mathrm{Adj}}(l_{j-1},G')\).

Suppose that \(a_s \not \in \mathop{\mathrm{Adj}}(f_{j+1},G')\) and let \(\gamma_l\) be a shortest anterior walk from \(l_j\) to \(a_r\) in \(G'\). By Lemma 59, \(\gamma'_l\) is chordless. In this case, the walk \(\omega'(f_{j+1},l_j) \mathbin{+}\gamma'_l(l_j,a_r) \mathbin{+}\left( {e'(a_r, a_s)} \right)\) in \(G'\) must contain an unshielded collider trisection not in \(G\) which is a contradiction. Thus \(a_s \in \mathop{\mathrm{Adj}}(f_{j+1},G')\).

Suppose that \(a_r \neq f_j\). In this case, The walk \(\gamma_f'(f_j,a_s)\) must be semi-directed since otherwise \(\sigma_j\) would be anterior to \(\sigma_{j-1}\). This implies that the walk \(\gamma_f'(f_j,a_s)\) must contain an unshielded collider trisection not in \(G\). This is a contradiction. Thus \(a_r = f_j\).

Both \({e(l_{j-1}, a_s)}\) and \({e(f_{j+1}, a_s)}\) must be into \(a_s\) by Lemma 58 due to the fact that \(l_{j-1}\) and \(f_{j+1}\) are on sections of discriminating inducing walk\(\gamma_d\) that discriminates \(\sigma_j\).

This implies that both \({e'(l_{j-1}, a_s)}\) and \({e'(f_{j+1}, a_s)}\) must be into \(a_s\) as \(G\) and \(G'\) have the same minimal inducing walks and the walk \(\left( {e(l_{j-1}, a_s)}, {e(f_{j+1}, a_s)} \right)\) is a minimal inducing walk.

Case 1:  There is no \(h\) with \(1 \leq h < j\) such that \(l_h \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ a_s\) in \(G'\) or \(l_h \not \in adj(a_s,G')\).

In this case, \(l_1 \ \text{---}\!\!\!\!\succ\! \ b\) and the walk \(\omega(v_1,l_1) \mathbin{+}\left( {e(l_1, a_s)}, {e(a_s, f_{j+1})} \right)\) is an open walk given \(Cb\) which is a contradiction.

Case 2:  There is an \(h\) with \(1 \leq h < j\) such that \(l_h \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ a_s\) in \(G'\) or \(l_h \not \in adj(a_s,G')\). Choose \(h\) be as large as possible such that \(l_h \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ a_s\) in \(G'\) or \(l_h \not \in adj(a_s,G')\).

Case 2.1:  \(l_h \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ a_s\). In this case, the walk \(\omega(v_1,l_h) \mathbin{+}\left( {e(l_h, a_s)}, {e(a_s, f_{j+1})} \right)\) is an open walk given \(Cb\) which is a contradiction.

Case 2.2:  \(l_h \not \in \mathop{\mathrm{Adj}}(a_s,G')\). In this case, the walk \(\omega'(l_h,f_j)\mathbin{+}\gamma_d'(f_j, a_s)\) is a minimal inducing walk. By assumption, this walk must be in \(G\), however, this cannot be the case as \(a_s \in \mathop{\mathrm{Ant}}(a_r,G)\) which leads to a contradiction by Lemma 60.

In all cases, we have a contradiction and thus the lemma holds. ◻

Lemma 62. If two separable graphs \(G\) and \(G'\) have the same adjacencies and same minimal inducing walks then they are equivalent.

Proof. Let \(G\) and \(G'\) be two separable graphs with the same adjacencies and same minimal inducing walks. let \(H=\text{\rmfamily\upshape Anterialize}(G)\) and \(H'=\text{\rmfamily\upshape Anterialize}(G')\). By Theorem 12 we have that \(G\equiv H\) and \(H\) is a separable anterial graph, and \(G'\equiv H'\) and \(H'\) is a separable anterial graph. From Lemmas 51, 52, and 56, we have that \(G\) and \(H\) have the same adjacencies and same minimal inducing walks and \(H'\) and \(G'\) have the same adjacencies and same minimal inducing walks. Thus we also have that \(H\) and \(H'\) have the same adjacencies and same minimal inducing walks. The conclusion then follows from Lemma 61 and the transitivity of equivalence. ◻

17.4 Minimal inducing walks and minimal discriminating inducing walks↩︎

We prove Proposition 21 and a lemma relating minimal inducing walks and minimal discriminating inducing walks.

Proposition 21

Proof. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) be a discriminating inducing walkin that discriminates collider section \(\sigma\) on \(\omega\) and let \({v_1} \perp\!\!\!\!\perp_{G} {v_n}\ |\ {C}\). Neither \(v_1\) nor \(v_n\) is in \(\operatorname{IV}(v_1,v_n,C,G).\) Next consider a vertex \(v_k\) not on \(\sigma\) with \(1<k<n\) and \(i \neq j\). From the definition of discriminating inducing walk, \(v_k \in \mathop{\mathrm{Ant}}(\{\, v_1,v_n \,\},G)\). From ordered upward separation stability (Lemma 45), we have that \({v_1} \perp\!\!\!\!\perp_{G} {v_n}\ |\ {Cv_k}\) which implies that \(v_k\not\in \operatorname{IV}(v_1,v_n,C,G).\) Finally consider a vertex \(v_l\) on \(\sigma_j\). In this case, \(\omega\) is open given \(Cv_l\) as every collider section is either anterior to an endpoint or a vertex in \(Cv_l\). This implies that \(v_l\in \operatorname{IV}(v_1,v_n,C,G).\) ◻

The next lemma relates minimal inducing walks and minimal discriminating inducing walks in separable graphs with the same adjacencies.

Lemma 63. Two separable graphs with the same adjacencies have the same minimal inducing walks if and only if they have the same minimal discriminating inducing walks.

Proof. Let \(G\) and \(G'\) be two separable graphs that have the same adjacencies.

The forward direction follows from the fact that every minimal discriminating inducing walkis a minimal inducing walk.

Next we consider the backward direction. Assume the lemma does not hold in the backward direction and let \(G\) and \(G'\) be two graph with the same adjacencies and the same minimal discriminating inducing walks but different minimal inducing walks. Without loss of generality, assume there is a minimal inducing walk\(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) in \(G\) such that there is no \(\omega'\) with \(\text{\rmfamily\upshape ver}({\omega'})=\left( {v}_{1},\ldots,{v}_{n} \right)\) that is a minimal inducing walkin \(G'\). Consider the minimal inducing walkdecomposition $ {_{iw}}(, G)= {, _1, , d ,}$ that contains a set of minimal discriminating inducing walks. There must be minimal discriminating inducing walks \(\gamma_i'\) in \(G'\). Next consider the walk \(\omega'= {\text{\rmfamily\upshape decomp}_{iw}}^{-1}(\{\, \gamma_1',\ldots,\gamma_d' \,\}, G')\) created by combining these minimal discriminating inducing walks. \(\omega'\) must be an inducing walk. If \(\omega'\) is a minimal inducing walkthen we have a contradiction. If \(\omega'\) is not a minimal inducing walkthen there must be a shorter minimal inducing walk\(\omega_m'\) in \(G'\) that uses a subset of vertices on \(\omega'\). Consider the decomposition $ {{iw}}(_m’, G’)={, _1’,,_e’ ,}\(. It must be the case that there are minimal discriminating inducing walks\)_i$ in \(G\). Consider the walk \(\omega_m= {\text{\rmfamily\upshape decomp}_{iw}}^{-1}(\{\, \beta_1,\ldots, \beta_e \,\}, G)\). It must be an inducing walk between \(v_1\) and \(v_n\) that uses a subset of the vertices of \(\omega\) and thus \(\omega\) is not a minimal inducing walk. This is a contradiction. Thus the backward direction must hold.

Both the forward and backward directions hold so the lemma must be true. ◻

17.5 Characterization theorems↩︎

Lemma 64. The following statements are equivalent for two separable graphs \(G\) and \(H\):

(1) \(G\) and \(H\) are separation equivalent,

(2) \(G\) and \(H\) have the same vertex separability and same induced arrowheads,

(3) \(G\) and \(H\) have the same adjacencies and same minimal inducing walks, and

(4) \(G\) and \(H\) have the same adjacencies and same minimal discriminating inducing walks.

Proof. The implication \((1)\implies(2)\) follows from Lemma 51. The implication \((1) \text{ and } (2)\implies(3)\) follows from Lemmas 52 and 56. The implication \((3)\implies(1)\) follows from Lemma 62. Finally the bi-implication \((3) \iff (4)\) follows from Lemma 63. Thus the lemma is true. ◻

Theorem 19

Proof. Follows from Lemma [lem:combined-chracterization]. ◻

Theorem 22

Proof. Follows from Lemma [lem:combined-chracterization]. ◻

Theorem 24

Proof. Follows from Lemma [lem:combined-chracterization]. ◻

=0

18 Proof related to testing equivalence of separable graphs↩︎

In this subsection we prove the correctness of our equivalence testing algorithm.

Theorem [thm:equivalence:correct]

Proof. From Theorem 12 we replace \(G\) with \(\text{\rmfamily\upshape Anterialize}(G)\) and \(H\) with \(\text{\rmfamily\upshape Anterialize}(H)\) as the algorithm preserves equivalence. The correctness then follows from Theorem 22. ◻

19 Proofs related representing equivalence classes of separable graphs↩︎

In this section we show that the function is a canonical projection for separable graphs with respect to separation equivalence and that preserves separation equivalence when applied to separable graphs.

Lemma 65. The graphs \(G\) and \(\text{\rmfamily\upshape InducedArrowheads}(G)\) have the same adjacencies.

Proof. The algorithm applied to \(G\) adds an edge if and only if there is an edge in \(G\) and thus the graphs have the same adjacencies. ◻

By removing arrowhead at \(i\) on the edge \(e(i,j)\) we mean turning \(j\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ i\) into \(j\ \!\prec\!\!\!\!\text{---}\ i\) or turning \(j\ \text{---}\!\!\!\!\succ\! \ i\) into \(j\ \text{---}\ i\). Removing arrowhead at \(i\) and \(j\) turns \(j\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ i\) into \(j\ \text{---}\ i\). This process of removing arrowheads is how the algorithm transforms \(G\) into \(\text{\rmfamily\upshape InducedArrowheads}(G)\).

Lemma 66. All internal arrowheads on a minimal inducing walk in a separable graph are induced arrowheads.

Proof. Consider a minimal inducing walk \(\gamma\) in a separable graph \(G\). We show that all internal arrowheads on \(\gamma\) are induced. Choose an arbitrary internal arrowhead at \(b\) on \(e(b,d)\) on \(\gamma\). Denote the section containing \(b\) by \(\sigma\). By Lemma 20, there is an discriminating inducing walk\(\pi\) that discriminates \(\sigma\). Denote the endpoints of \(\pi\) by \(i\) and \(j\). Because \(\pi\) is a discriminating inducing walk, \(i\not\in \mathop{\mathrm{Adj}}(j,G).\) From Theorem 9, we have that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) where \(C=\mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\setminus \{\, i,j \,\}\). In addition, again due to the fact that \(\pi\) is a discriminating inducing walk, \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\). These imply that \(b\in \operatorname{IV}(i,j,C,G).\) Since \(d\in C,\) we also have \(d\not\in IV(i,j,C,G)\), which then implies that the arrowhead at \(b\) on \({e(b, d)}\) is an induced arrowhead. ◻

Lemma 67. Assume \(G\) is a separable graph. Then a minimal inducing walk in \(G\) is an inducing walk in \(\text{\rmfamily\upshape InducedArrowheads}(G)\).

Proof. Consider a minimal inducing walk \(\gamma\) in separable graph \(G\). From Lemma 65 there is a walk \(\gamma'\) in \(\text{\rmfamily\upshape InducedArrowheads}(G)\) with the same vertex sequence as \(\gamma\). Again from Lemma 65, the endpoints of \(\gamma'\) are not adjacent. This fact, Lemma 66, and the fact that the algorithm only remove arrowheads that are not induced arrowheads imply that \(\gamma'\) is an inducing walk. ◻

Lemma 68. If \(G\) is separable and \(\gamma'\) is a minimal inducing walkin the graph \(\text{\rmfamily\upshape InducedArrowheads}(G)\) then there exists a walk \(\gamma\) in \(G\) such that \(\gamma' \equiv \gamma\).

Proof. Denote the endpoints of \(\gamma'\) by \(i\) and \(j\). By Lemma 65 we have that there is walk \(\gamma\) in \(G\) with \(\text{\rmfamily\upshape ver}({\gamma})=\text{\rmfamily\upshape ver}({\gamma'})\). If we show that all internal arrowheads on \(\gamma\) are induced arrowheads in \(G\) then we are done since \(\text{\rmfamily\upshape InducedArrowheads}(G)\) only removes arrowheads from \(G\). Suppose, for contradiction, that an internal arrowhead on \(\gamma\) at vertex \(b\) on \(e(d,b)\) is not induced.

We note that on \(\gamma'\), the edge \(e(d,b)\) is undirected since \(\gamma'\) is an inducing walk. Without loss of generality, we assume \(b\) is the closest vertex with a removed arrowhead to the endpoint of its section on its side on \(\gamma'\), i.e.\(b\) is such that on the subsection between \(b\) and an endpoint of the section that do not contain \(d\), the is no arrowhead removed. Consider the endpoint of this section that is close to \(b\) by \(b'\), and denote the vertex on \(\gamma'\) outside this section that is adjacent to \(b'\) by \(d'\). If \(b=b'\), we choose \(d'\) to be the other adjacent vertex of \(b\) than \(d\).

Notice that there exists at least a \(C\) such that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\) because \(i\) and \(j\) are not adjacent and \(G\) is separable. Since the arrowhead at \(b\) is not induced, by the contrapositive of the definition of induced arrowheads, we have that, for every \(i,j,C\), such that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {C}\), either (i) \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {Cb}\) or (ii) \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb}\) and \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cd}\).

We show that the arrowhead at \(b'\) on \(e(b',d')\) is not induced: Since \(b\) and \(b'\) are in the same section we have that \({i} \perp\!\!\!\!\perp_{G} {j}\ |\ {Cb}\iff {i} \perp\!\!\!\!\perp_{G} {j}\ |\ {Cb'}\). This implies that if case (i) holds for \(b\), the analogous of case (i) holds for \(b'\). In addition, if case (ii) holds for \(b\) then it holds that \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cb'}\).

What is left to show is if case (ii) holds for \(d\) then \({i} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {j}\ |\ {Cd'}\): Since \(G\) is separable, by Lemma 66, there is an edge between \(d\) and \(d'\). This edge cannot have an arrowhead at \(d\) since otherwise \(\gamma'\) is not the shortest self-inducing walk between \(u\) and \(v\). Therefore, regardless of whether there is an arrowhead at \(d'\) on \(e(d,d')\), if there is a connecting walk between \(i\) and \(j\) given \(Cd\), there is a connecting walk between \(i\) and \(j\) given \(Cd'\).

This completes the proof of the arrowhead at \(b'\) on \(e(b',d')\) is not induced, and consequently, there is no arrowhead at \(b'\) on this edge in \(\text{\rmfamily\upshape InducedArrowheads}(G)\). This is a contradiction since \(b'\) is an endpoint of a section on \(\gamma'\). Therefore, all internal arrowheads on \(\gamma\) are induced. ◻

Lemma 69. Assume \(G\) is a separable graph. A minimal inducing walk in \(G\) is a minimal inducing walk in \(\text{\rmfamily\upshape InducedArrowheads}(G)\) and vice versa.

Proof. Let \(\gamma\) be a minimal inducing walk in \(G\). Lemma 67 shows there is an inducing walk \(\gamma' \equiv \gamma\) in \(\text{\rmfamily\upshape InducedArrowheads}(G)\). Suppose \(\gamma'\) is not minimal. This implies that there is another walk \(\omega\) that is minimal in \(\text{\rmfamily\upshape InducedArrowheads}(G)\). From Lemma 68, there is an inducing walk in \(G\) that uses a subset of the vertices in \(\gamma\). This contradicts \(\gamma\) being minimal. Thus \(\gamma'\) must be minimal inducing walk in \(\text{\rmfamily\upshape InducedArrowheads}(G)\).

The other direction is proven with a similar argument. ◻

Lemma 70. If \(G\) is separable then \(\text{\rmfamily\upshape InducedArrowheads}(G)\) is separable.

Proof. By Theorem 10, \(G\) does not contain a self-inducing walk, and we need to show that \(\text{\rmfamily\upshape InducedArrowheads}(G)\) does not contain a self-inducing walk. Suppose, for contradiction, that there is a self-inducing walk \(\gamma'\) in \(\text{\rmfamily\upshape InducedArrowheads}(G)\). Assume, without loss of generality, that \(\gamma'\) is the shortest such walk, and denote the endpoints of \(\gamma'\) by \(u\) and \(v\). This implies that \(\gamma'\) is a minimal inducing walk.

We note, by Lemma 65, that \(G\) and \(\text{\rmfamily\upshape InducedArrowheads}(G)\) have the same adjacencies. Hence, each walk \(\nu'\) in \(\text{\rmfamily\upshape InducedArrowheads}(G)\) has a corresponding walk with the same vertices and edges, denoted by \(\nu\), in \(G\) on which some arrowheads are potentially removed on \(\nu'\). Also, each internal vertex of \(\gamma'\) is an anterior to one of its endpoints. For each vertex \(w\) on \(\gamma'\), consider the anterial walk from \(w\) to an endpoint of \(\gamma'\), denoted by \(\nu'_w\), such that \(\nu'_w\) has the fewest number of arrowheads removed among such anterior walks. Consider the subgraph of \(\text{\rmfamily\upshape InducedArrowheads}(G)\) consisting of the vertices of \(\gamma'\) and the vertices of all the walks \(\nu'_w\) for every internal vertex \(w\) of \(\gamma'\). Call this subgraph \(K'\).

Below we show that in the induced subgraph \(K\) of \(G\) with respect to the vertices of \(K'\), there exists an arrowhead at \(b\) on \(e(b,d)\) in \(K\) that does not exist in \(K'\), but is induced. This leads to a contradiction with the arrowhead not existing in \(K'\).

Again, we note, by Lemma 65, that \(K\) and \(K'\) have the same adjacencies, and any arrowhead in \(\text{\rmfamily\upshape InducedArrowheads}(G)\) exists in \(G\). Since \(\gamma'\) is a minimal inducing walk, by Lemma 69, there exists a walk \(\gamma\) in \(G\) with the same vetices that is a minimal inducing walk. Since all arrowheads on \(\gamma\) are induced in \(G\), as proven in Lemma 66, the arrowhead at \(b\) must be on an edge in \(K'\) that is not on \(\gamma\).

If vertices at which the arrowhead is removed are in \(\mathop{\mathrm{PropAnt}}(\{\, u,v \,\},G)\) then \(\gamma\) is self-inducing in \(G\), which is not possible. Hence, choose \(e(b,d)\) such that the arrowhead at \(b\) is removed and \(b\notin\mathop{\mathrm{PropAnt}}(\{\, u,v \,\},G)\).

Consider a vertex \(i\) in \(\gamma\) that is an anterior of \(b\) in the anterior walk from \(i\) to \(\{u,v\}\) in \(\text{\rmfamily\upshape InducedArrowheads}(G)\) (\(i\) can be \(b\) itself). Denote the section of \(i\) on \(\gamma\) by \(\rho\). Let \(C=\mathop{\mathrm{PropAnt}}(\{u,v\},G)\cup\text{\rmfamily\upshape ver}({\gamma})\setminus \rho\), i.e, be all proper anteriors of \(u\) and \(v\) and vertices of \(\gamma\) except the vertices in the section that is an anterior of \(b\).

First, \({u} \perp\!\!\!\!\perp_{G} {v}\ |\ {C}\) since otherwise \(i\in\mathop{\mathrm{PropAnt}}(\{u,v\},G)\), which implies that \(b\in\mathop{\mathrm{PropAnt}}(\{u,v\},G)\).

Secondly, let \(b\) be the closest vertex to \(i\). Clearly, \({u} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {v}\ |\ {Cb}\).

Thirdly, let \(b\) be the closest vertex to \(u\). The only option where \(d\) can be on a connecting walk between \(u\) and \(v\) given \(Cd\) is via the anterior walk from \(d\) to \(u\). However \(d\) is on a non-collider section in this walk and cannot make a connecting walk. Therefore, \({u} \perp\!\!\!\!\perp_{G} {v}\ |\ {Cd}\).

These imply that the arrowhead at \(b\) is indeed induced, which is a contradiction. ◻

Theorem 25

Proof. Since, by Lemma 70, \(G\) and \(\text{\rmfamily\upshape InducedArrowheads}(G)\) are separable, by Theorem 19, it is enough to show that \(G\) and \(\text{\rmfamily\upshape InducedArrowheads}(G)\) have the same adjacencies and minimal inducing walks. The former is Lemma 65 and the latter is Lemma 69. ◻

Theorem 26

Proof. If two graphs \(G\) and \(G'\) are separation equivalent and separable then they must have the same adjacencies and induced arrowheads by Theorem 24. This implies that \(\text{\rmfamily\upshape InducedArrowheads}(G)=\text{\rmfamily\upshape InducedArrowheads}(G')\). If \(G'\not \equiv G\) then, again by Theorem 24, they must have different adjacencies or induced arrowheads with implies that \(\text{\rmfamily\upshape InducedArrowheads}(G) \not \equiv \text{\rmfamily\upshape InducedArrowheads}(G')\). This proves that is a canonical representation function for separable graphs. Then, by Lemma 70 and Theorem 25, it follows that also a canonical projection function. ◻

Corollary 4

Proof. Let \(G\) be a separable graph. Every graph in \(\text{\rmfamily\upshape Largest}(G)\) is separable and equivalent to \(G\). Let \(H,H' \in \text{\rmfamily\upshape Largest}(G)\). By Theorem 24, \(H\) and \(H'\) have the same adjacencies and same induced arrowheads. Consider the graph \(\text{\rmfamily\upshape InducedArrowheads}{G}\). It has the same adjacencies and induced arrowheads. Furthermore, all of its arrowheads are induced arrowheads so it must be in \(\text{\rmfamily\upshape Largest}(G)\). If any of the edges in \(H\) or \(H'\) have an arrowhead that is not in \(\text{\rmfamily\upshape InducedArrowheads}{G}\) then it is not in \(\text{\rmfamily\upshape Largest}(G)\) thus \(H=H'=\text{\rmfamily\upshape InducedArrowheads}{G}\). ◻

Corollary 5

Proof. Let \(G\) be a separable graph. From Lemma 70, \(G'=\text{\rmfamily\upshape InducedArrowheads}(G)\) is separable and from Theorem 25, \(G\equiv G'\).

From Theorem 12, \(G''= \text{\rmfamily\upshape Anterialize}(G')\) is an anterial graph equivalent to \(G'\). Thus we also have, \(G''\equiv G\). From the fact that the algorithm only removes arrowheads and the fact that these graphs are equivalent it must be the case that \(G'=G''\) and thus \(G'\) is an anterial graph. ◻

20 Proofs related to the identification of essentially separable graphs↩︎

Proposition 27

Proof. From Lemma 46, if \(C\) is a minimal separating set for \(i\) and \(j\) in graph \(G\) then \(C\subseteq \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\). Thus any minimal separating set is an anterior separating set. ◻

Lemma 71. If an edge \({e(d, b)}\) has an induced arrowhead at \(b\) in graph \(G\) then there exist vertices \(i\) and \(j\) and vertex set \(C\) such that \(b\in \operatorname{IV}(i,j,C,G)\) and \(d\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\).

Proof. let \({e(d, b)}\) have an induced arrowhead at \(b\) in a graph \(G\). From the definition of induced arrowheads, there is some pair of vertices \(p\) and \(q\) and vertex set \(D\) such that \(b\in \operatorname{IV}(p,q,D,G)\) and \(d\not \in \operatorname{IV}(p,q,D,G)\). From \(b\in \operatorname{IV}(p,q,D,G)\), we have that \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\) and \({p} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {q}\ |\ {Db}\).

Case 1:  \(d\in \mathop{\mathrm{Ant}}(\{\, p,q \,\},G)\setminus \{\, p,q \,\}\). In this case, the lemma holds for vertices \(i=p\) and \(j=q\) and vertex set \(C=D\) and note that using this assignment we have \(b\in \operatorname{IV}(i,j,C,G)\) and \(d\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\). Thus the lemma holds in this case.

Case 2:  \(d\not\in \mathop{\mathrm{Ant}}(\{\, p,q \,\},G)\setminus \{\, p,q \,\}\). From \(d\not\in \operatorname{IV}(p,q,D,G)\), it must be the case that \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {Dd}\). From \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\) and \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {Dd}\), and weak transitivity, it must be the case that \({p} \perp\!\!\!\!\perp_{G} {d}\ |\ {D}\) or \({d} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\). Without loss of generality, assume that \({d} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\). From \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\), \({d} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\), and composition we have \({dp} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\) and, by weak union we have \({d} \perp\!\!\!\!\perp_{G} {q}\ |\ {Dp}\). From \({p} \perp\!\!\!\!\perp_{G} {q}\ |\ {D}\) and \({p} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {q}\ |\ {Db}\) and Lemma 43, there is a walk \(\gamma_q\) between \(b\) and \(q\) open given \(Dp\) and weakly into \(b\). In this case, the walk \(\left( {e(d, b)} \right)\mathbin{+}\gamma_q\) is open given \(Dpb\) which implies that \({d} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {q}\ |\ {Dpb}\). Thus we have shown \({d} \perp\!\!\!\!\perp_{G} {q}\ |\ {Dp}\) and \({d} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {q}\ |\ {Dpb}\) which implies that \(b\in IV(d,q,Dp,G)\). In this case, let \(i=d\), \(j=q\) and \(C=Dp\) and note that using this assignment we have \(b\in \operatorname{IV}(i,j,C,G)\) and \(d\in \mathop{\mathrm{Ant}}(\{\, i=d,j \,\},G)\). Thus the lemma holds in this case. ◻

20.1 Proof of anterior induced adjacency proposition↩︎

Next we prove Proposition 28

Proposition 28

Proof. Assume that that claim is not true and that there are separable vertices \(a\) and \(b\) in graph \(G\) such that \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {C}\) where \(C=\text{\rmfamily\upshape iAdj}(a,b,G)\cap \mathop{\mathrm{Ant}}(ab,G)=\text{\rmfamily\upshape aiAdj}(a,b,G)\). This implies that there is a connecting walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) with \(v_1=a\) and \(v_n=b\) that is open given \(C\). We consider three possible types of walks for \(\omega\).

Case 1:  \(\omega\) consist of a single edge \({e(a, b)}\). In this case, by Lemma 9, \(a\) and \(b\) are not separable. This is a contradiction with the assumption that \(a\) and \(b\) are separable.

Case 2:  \(\omega\) is a collider walk. In this case, every collider section on \(\omega\) must be anterior to the endpoints and thus is a self-inducing walk. This implies, by Theorem 10, that \(a\) and \(b\) are not separable. This is again a contradiction.

Case 3:  \(\omega\) is not a collider walk. In this case there is some non-trivial maximal trek. let \(\omega(v_{i-1},v_{j+1})\) with \(i\leq j\) be the maximal trek closest to \(a=v_1\) on \(\omega\). By Lemma 12, we have that \(v_i \in \mathop{\mathrm{Ant}}(abC,G)\). Furthermore, from \(C=\text{\rmfamily\upshape aiAdj}(a,b,G) \subseteq \mathop{\mathrm{Ant}}(\{\, a,b \,\},G)\) we have \(v_i \in \mathop{\mathrm{Ant}}(\{\, a,b \,\},G)\). Next, consider the subwalk \(\omega(a,v_i)\). The subwalk is a collider walk. From the fact that \(\omega\) is a connecting walk given \(C\), every collider section on the subwalk contains a vertex of \(C\). From \(C=\text{\rmfamily\upshape aiAdj}(a,b,G) \subseteq \mathop{\mathrm{Ant}}(\{\, a,b \,\},G)\), every collider section is anterior to \(\{\, a,b \,\}\) and thus \(v_i \in \text{\rmfamily\upshape iAdj}(a,b,G)\).

Thus \(v_i\in C\) and \(\omega\) is not a connecting walk as a non-collider section contains a vertex in \(C\). This is a contradiction.

In each case we have a contradiction so the claim must hold. ◻

20.2 Ordering and separation properties of anterial graphs↩︎

Anterial graphs play an essential role in proving the correctness of the algorithm. In this section we show several ordering and separation properties of anterial graphs.

Recall that \(\mathrel{\lessapprox}_G\) is the induced preorder of a graph \(G\) from which we define (1) \(a \mathrel{\approx_G}b\) if \(a \mathrel{\lessapprox}_Gb\) and \(b \mathrel{\lessapprox}_Ga\), (2) \(a \mathrel{\mathrel{\parallel}_G}b\) if \(a \mathrel{\not\lessapprox_G}b\) and \(b \mathrel{\not\lessapprox_G}a\), (3) \(a <_Gb\) if \(a \mathrel{\lessapprox}_Gb\) and \(b \mathrel{\not\lessapprox_G}a\). If \(a \mathrel{\mathrel{\parallel}_G}b\) we say that \(a\) and \(b\) are incomparable. If \(a <_Gb\) or \(b <_Ga\) then \(a\) and \(b\) are strictly ordered. Recall also, the equivalence relations \(a \mathrel{\sim_G}b\) defined to hold if there is an undirected walk between \(a\) and \(b\) in \(G\) or \(a = b\). Note that \(\mathrel{\approx_G}\) need not be equivalent to \(\mathrel{\sim_G}\) in general, but are equivalent if \(G\) is an anterial graph due to Lemma 48.

The next lemma shows that in an anterial graph every distinct pair of vertices is either connected by an undirected walk, strictly ordered, or incomparable.

Lemma 72. If \(G\) is an anterial graph and \(a \neq b\) then exactly one of the following properties holds \(a \mathrel{\mathrel{\parallel}_G}b\), \(a \mathrel{<_G}b\), \(b \mathrel{<_G}a\), \(a \mathrel{\sim_G}b\).

Proof. Let \(G=\left( V,E \right)\) be an anterial graph and for \(a,b\in V\) it is the case that \(a\neq b\).

Case 1:  \(a \mathrel{\mathrel{\parallel}_G}b\). In this case, by definition, we have that \(a \mathrel{\not\sim_G}b\), \(a \mathrel{\not <_G}b\), and \(b \mathrel{\not <_G}a\) and the property is exclusive.

Case 2:  \(a \mathrel{\sim_G}b\). First, by definition, we have that \(a \mathrel{\mathrel{\curlyvee}_G}b\). Next, due the fact that \(a \mathrel{\sim_G}b\) and that \(G\) contains no semi-directed cycle, we must have \(a \mathrel{\not <_G}b\) and \(b \mathrel{\not <_G}a\). In this case, the property is exclusive.

Case 3:  \(a \mathrel{<_G}b\) or \(b \mathrel{<_G}a\). Without loss of generality, assume \(a \mathrel{<_G}b\). In this case, by definition, we have that \(a \mathrel{\mathrel{\curlyvee}_G}b\). It cannot be the case that \(a \mathrel{\sim_G}b\) or \(b \mathrel{<_G}a\) otherwise, in either case, there would be a semi-directed cycle and \(G\) contains no semi-directed cycle. In this case, the property is exclusive.

Thus exactly one of the following holds for any distinct pair of vertices \(a,b\in V\), \(a \mathrel{\mathrel{\parallel}_G}b, a\mathrel{\sim_G}b, a\mathrel{<_G}b\), and \(b \mathrel{<_G}a\) and thus the proposition holds. ◻

The next lemma, first proved in [20], shows that the relationships between adjacent vertices in an anterial graph uniquely determines the edge type between those vertices.

Lemma 73. If \(G\) is anterial and \(a \in \mathop{\mathrm{Adj}}(b,G)\) then

  1. \(a\mathrel{\sim_G}b\) if and only if \(a \ \text{---}\ b\),

  2. \(a \mathrel{\mathrel{\parallel}_G}b\) if and only if \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\),

  3. \(a \mathrel{<_G}b\) if and only if \(a \ \text{---}\!\!\!\!\succ\! \ b\), and

  4. \(b \mathrel{<_G}a\) if and only if \(b \ \text{---}\!\!\!\!\succ\! \ a\).

Proof. Let \(G\) be an anterial graph such that \(a\in \mathop{\mathrm{Adj}}(b,G)\).

Case (i):  For the forward direction, let \(a \mathrel{\sim_G}b\). If \(a \ \text{---}\!\!\!\!\succ\! \ b\), or \(a \ \!\prec\!\!\!\!\text{---}\ b\) then there would be a semi-directed walk which contradicts \(G\) being anterial. Similarly, if \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\), then there would be a bidirected edge with an endpoint anterior to its other endpoint which also contradicts \(G\) being anterial. Thus the edge must be oriented \(a \ \text{---}\ b\). For the other direction, assume \(a \ \text{---}\ b\). In this case, the walk containing this edge is an undirected walk between \(a\) and \(b\) and thus \(a\mathrel{\sim_G}b\).

Case (ii):  For the forward direction, let \(a \mathrel{\mathrel{\parallel}_G}b\). By Lemma 72, we have that \(a\) and \(b\) are not ordered which rules out \(a \ \text{---}\!\!\!\!\succ\! \ b\) and \(a \ \!\prec\!\!\!\!\text{---}\ b\). Again, by Lemma 72, we have that \(a \mathrel{\not\sim_G}b\) which rules out \(a \ \text{---}\ b\). This implies that \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\). For the other direction, let \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\). If either \(a \mathrel{<_G}b\), \(b \mathrel{<_G}a\) or \(a \mathrel{\sim_G}b\) there would be a bidirected edge with an endpoint anterior to its other endpoint which contradicts \(G\) being anterial. Thus \(a \mathrel{\mathrel{\parallel}_G}b\).

Case (iii):  For the forward direction, let \(a \mathrel{<_G}b\). By Lemma 72, we have that \(b \mathrel{\not <_G}a\) and \(a \mathrel{\not\sim_G}b\) which rules out \(a \ \!\prec\!\!\!\!\text{---}\ b\) and \(a \ \text{---}\ b\). If \(a \ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ b\) then there would be a bidirected edge with an endpoint anterior to its other endpoint which cannot be the case due to \(G\) being anterial. This implies that \(a \ \text{---}\!\!\!\!\succ\! \ b\) For the other direction, let \(a \ \text{---}\!\!\!\!\succ\! \ b\). This implies that \(a \mathrel{<_G}b\).

Case (iv):  Similar to case (iii). ◻

Let \(\text{\rmfamily\upshape aAdj}(b,G)\) be the set of anterior adjacent vertices defined to be the set of vertices \(c\in V\) such that either \(c\ \text{---}\!\!\!\!\succ\! \ b\) or \(c \ \text{---}\ b\) in graph \(G\).

Lemma 74. If \(G\) is an anterial graph containing separable vertices \(a\) and \(b\) such that \(a \mathrel{\sim_G}b\) then \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {\text{\rmfamily\upshape aAdj}(a,G)}\).

Proof. Let \(G\) be an anterial graph containing separable vertices \(a\) and \(b\) such that \(a \mathrel{\sim_G}b\). Suppose that the claim does not hold and that \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {C}\) where \(C=\text{\rmfamily\upshape aAdj}(a,G)\). This implies that there is a walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) where \(v_1=a\) and \(v_n=b\) that is connecting given \(C\). Note that \(v_2 \neq b\), otherwise \(a\) and \(b\) are not separable.

From Lemma 72, it must be the case that \(a \mathrel{\not <_G}b\), \(b \mathrel{\not <_G}a\), and \(a \mathrel{\mathrel{\curlyvee}_G}b\).

Case 1:  \(a \ \text{---}\!\!\!\!\succ\! \ v_2\) or \(a\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_2\). From anterial endmark property, Lemma 31, we have that \(v_2 \not\in \mathop{\mathrm{Ant}}(a, G)\). As \(a\mathrel{\sim_G}b\) we also have \(v_2 \not\in \mathop{\mathrm{Ant}}(b,G).\) There must be some collider section \(\sigma_i\) for \(1<i<m\) as \(\sigma_2 \not\in \mathop{\mathrm{Ant}}(ab,G)\) and this section cannot contain a vertex in \(C\). This implies that the walk \(\omega\) is not a connecting walk given \(C\).

Case 2:  \(a \ \text{---}\ v_2\) or \(a \ \!\prec\!\!\!\!\text{---}\ v_2\). In either case, \(v_2\) is on a non-collider section of \(\omega\) and \(v_2\in C\). This implies that the walk \(\omega\) is not a connecting walk given \(C\).

In either case, the walk \(\omega\) is not a connecting walk given \(C\) so the claim holds. ◻

Lemma 75. If \(G\) is an anterial graph containing separable vertices \(a\) and \(b\) such that \(b \mathrel{<_G}a\) then \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {\text{\rmfamily\upshape aAdj}(a,G)}\).

Proof. Let \(G\) be an anterial graph containing separable vertices \(a\) and \(b\) such that \(b \mathrel{<_G}a\). Suppose that the claim does not hold and that \({a} { \perp\!\!\!\!\perp \raisebox{0.16em}{\smallsetminus} }_{G}\ {b}\ |\ {C}\) where \(C=\text{\rmfamily\upshape aAdj}(a,G)\). This implies that there is a walk \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) and \(\text{\rmfamily\upshape sec}({\omega})=\left( {\sigma}_{1}, \ldots, {\sigma}_{m} \right)\) where \(v_1=a\) and \(v_n=b\) that is connecting given \(C\). Note that \(v_2 \neq b\), otherwise \(a\) and \(b\) are not separable.

From Lemma 72, it must be the case that \(a \mathrel{\not <_G}b\), \(a \mathrel{\not\sim_G}b\), and \(a \mathrel{\mathrel{\curlyvee}_G}b\).

We show \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {\text{\rmfamily\upshape aAdj}(a,G)}\).

Case 1:  \(a \ \text{---}\!\!\!\!\succ\! \ v_2\) or \(a\ \!\prec\!\!\!\!\text{---}\!\!\!\!\succ\! \ v_2\). From the anterial endmark property, Lemma 31, we have that \(v_2 \not\in \mathop{\mathrm{Ant}}(a, G)\). As \(b \mathrel{<_G}a\) and \(G\) is anterial, we also have \(v_2 \not\in \mathop{\mathrm{Ant}}(b,G).\) There must be some collider section \(\sigma_i\) for \(1<i<m\) as \(\sigma_2 \not\in \mathop{\mathrm{Ant}}(ab,G)\) and this section cannot contain a vertex in \(C\). This implies that the walk \(\omega\) is not a connecting walk given \(C\).

Case 2:  \(a \ \text{---}\ v_2\) or \(a \ \!\prec\!\!\!\!\text{---}\ v_2\). In either case, \(v_2\) is on a non-collider section of \(\omega\) and \(v_2\in C\). This implies that the walk \(\omega\) is not a connecting walk given \(C\).

In either case (1) or (2), the walk \(\omega\) is not a connecting walk given \(C\) so the claim must hold. ◻

Lemma 76. If \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) and \(a\not \in \mathop{\mathrm{Adj}}(b,G_{final})\) then \(a\) and \(b\) are separable in \(G^*\).

Proof. Let \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) and \(G\) denote that current graph at various steps of running the algorithm. Initially, \(G\) is the complete graph. An edge \({e(a, b)}\) is removed only if a set \(C\) is found and \({a} \perp\!\!\!\!\perp_{{I}{(P^*)}} {b}\ |\ {C}\). This implies that \(a\) and \(b\) are separable in \(G^*\). ◻

Lemma 77. If \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) then for all \(a\in V\), \(\mathop{\mathrm{Ant}}(a,G_{final}) \supseteq \mathop{\mathrm{Ant}}(a,G^*)\).

Proof. Let \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) and \(G\) denote that current graph at various steps of running the algorithm. Initially, \(G\) is the complete graph and \(\mathop{\mathrm{Ant}}(i,G)=V\setminus i\) so the claim holds. The claim then follows from the soundness of the orientation rule used to add arrowheads to edges (Proposition 23). ◻

Lemma 78. If \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) then for all \(a\in V\), \(\text{\rmfamily\upshape aAdj}(a,G^*) \subseteq \text{\rmfamily\upshape aAdj}(a, G_{final})\).

Proof. This follows from Lemmas 76 and 77. ◻

The following lemma shows that every vertex equivalence class of \(G^*\) is a subset of some vertex equivalence class in \(G_{final}\), the output of the algorithm.

Lemma 79. If \(a \mathrel{\approx}_{G^*} b\), and \(a\in \mathop{\mathrm{Adj}}(b,G_{final})\) where \(G_{final}= \text{\rmfamily\upshape SGI}({I}{(G^*)})\) then \(a \ \text{---}\ b\) in \(G_{final}\).

Proof. Assume \(a \mathrel{\approx}_{G^*} b\), \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) and \(a\in \mathop{\mathrm{Adj}}(b,G_{final})\). Suppose the claim is not true and that the edge \({e(a, b)}\) in \(G_{final}\) has an arrowhead at \(a\), \(b\) or both \(a\) and \(b\). Without loss of generality, assume there is one at \(a\). The edge must have an induced arrowhead at \(a\) in \({I}{(P^*)}\). This implies that there exists \(\left( i, j, C \right)\) such that \(a\in IV(i,j,C,G^*)\). This, however, cannot be the case due to Proposition 17. Thus the claim must be true. ◻

Lemma 80. If \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) is a discriminating inducing walkthat discriminates collider section \(\sigma=\left( v_i,v_j \right)\) in \(G^*\) then if removed the edge \({e(v_1, v_n)}\) then the edge \({e(v_{i-1}, v_{i})}\) has an arrowhead at \(v_i\) in \(G_{final}\) and the edge \({e(v_{j}, v_{j+1})}\) has an arrowhead at \(v_j\) in \(G_{final}\).

Proof. Let \(\omega\) with \(\text{\rmfamily\upshape ver}({\omega})=\left( {v}_{1},\ldots,{v}_{n} \right)\) be a discriminating inducing walkthat discriminates collider section \(\sigma=\left( v_i,v_j \right)\) in \(G^*\) and assume that removed the edge \({e(v_1, v_n)}\). The fact that the edge \({e(v_{1}, v_{n})}\) was removed implies that there is a set \(C\) that separates \(v_1\) and \(v_n\) in \(G^*\) that was used by the algorithm to remove the edge. From Proposition 21, every vertex on a discriminated section of a discriminating inducing walkis an inducing vertex for the endpoints of the discriminating inducing walk(i.e., in \(\operatorname{IV}(v_1,v_n,C,G^*)\)) and that every other vertex on \(\omega\) is not an inducing vertex (i.e., not in \(\operatorname{IV}(v_1,v_n,C,G^*)\)). This implies that the edge closed to \(\sigma\) on the walk between \(a\) and \(\sigma\) has an induced arrowhead at \(\mathop{\mathrm{first}}(\sigma)\). This implies that the algorithm will add these arrowheads after removing the edge \({e(v_{1}, v_{n})}\). ◻

The next lemma captures a key algorithmic invariant about the algorithm. In particular, the invariant captures the fact that the current graph \(G\) in before and after considering candidate separating sets is an anterial graph.

Lemma 81. For graph \(G^*\), before and after considering a candidate separating set, the current graph \(G\) of the algorithm applies to \(G^*\) (i.e. a trace of \(\text{\rmfamily\upshape SGI}(G^*)\)) is an anterial graph.

Proof. We show this algorithmic invariant inductively on the length of the trace of \(\text{\rmfamily\upshape SGI}(G^*)\).

For the base case we consider the initial graph. This initial graph is a simple complete undirected graph and thus satisfies the anterial endmark property. By Lemma 31 the graph is anterial.

For the inductive case we assume that the current graph is anterial and show that after identifying a separating set \(C\) for \(i\) and \(j\), removing the edge between \(i\) and \(j\) and orienting, the resulting graph is again anterial. First note that the resulting graph is simple. Consider the set \(\operatorname{IV}=\operatorname{IV}(i,j,C, G^*)\) and \(D=V \setminus \operatorname{IV}\). Any new endmark is at an endpoint of an edge \({e(c, d)}\) with \(c\in D\) and \(d \in \operatorname{IV}\) with the new arrowhead at \(d\). The resulting graph satisfies the anterial endmark property as (1) for new endmarks (necessarily arrowheads), every edge between a vertex in \(D\) and a vertex in \(\operatorname{IV}\) has an arrowhead endmark at the vertex in \(\operatorname{IV}\) and thus there can be no anterior walk violating the anterial endmark property, (2) for old endmarks, the addition of an arrowhead does not create any new anterial walks. Thus, by Lemma 31 the graph is anterial. ◻

The anterior sets of a graph \(G=\left( V,E \right)\) is the set \[A(G)=\{\, {A}\in {2^{V}}\ | \ {A=\mathop{\mathrm{Ant}}(A,G)} \,\}.\]

Let anterial graph \(G\) have anterior sets \(A(G)=\{\, A_1,\ldots,A_a \,\}\). The pair \(\left( A(G),\subseteq \right)\) defines a bounded partially ordered set closed under union, that is, a join-semilattice with bottom. The bottom is the empty set \(\emptyset\) and the top if the set \(V\). The graph \(G\) defined to be \(a\ \text{---}\!\!\!\!\succ\! \ b \ \text{---}\!\!\!\!\succ\! \ c\) has \(A(G)=\{\, \emptyset, \{\, a \,\},\{\, a,b \,\},\{\, a,b,c \,\} \,\}\) which illustrates that \(A(G)\) is not necessarily closed under intersection.

The following proof uses well-founded induction. An alternative approach is to prove by induction on the number of chain components in the equivalent anterial graph — one must exist by Theorem 12. This approach, however, requires defining chain components and yields a proof that is similar to the proof below.

Lemma 82. If \(G^*\) is essentially separable, \(a\) and \(b\) are separable in \(G^*\) then \(a\not\in \mathop{\mathrm{Adj}}(b,G_{final})\) where \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\).

Proof. Let \(G^*\) be an essentially separable graph, \(G_{final}=\text{\rmfamily\upshape SGI}({I}{(P^*)})\).

let \(G\) be a separable anterial graph such that \(G \equiv G^*\); one exists due to the fact that \(G^*\) has an equivalent separable graph and Theorem 12.

First we recast the lemma in terms of separation completeness. A graph \(G_{final}\) is separation complete with respect to graph \(G\) and vertex set \(A\subseteq V\) if for all pairs of distinct vertices \(a,b \in A\), if \(a\not\in \mathop{\mathrm{Adj}}(b,G)\) then \(a \not\in \mathop{\mathrm{Adj}}(b,G_{final})\). Thus the lemma holds if we can show that \(G_{final}\) is separation complete with respect to \(G\) and \(V\).

Next, note that \(\left( A(G), \subseteq \right)\) is well-founded as \(A(G)\) is a finite set and \(\subseteq\) is a partial order over \(A(G)\). We prove the claim by well-founded induction on \(A(G)\) with respect to \(\subset\). In particular, we prove that \(G_{final}\) is separation complete with respect to \(G\) and \(A_j\) under the induction hypothesis that \(G_{final}\) is separation complete with respect to \(G\) and all \(A_i \subset A_j\).

Define \(\max(A)=\{\, {a}\in {A}\ | \ {\forall b\in A, b \mathrel{\lessapprox}_Ga} \,\}.\) Let \(A_i = A_j \setminus \max(A_j)\). The set \(A_i\) is an ancestral set, that is, \(A_i\in A(G)\). By induction assumption, all edges between separable vertices in \(A_i\) have been removed. Thus we need only consider pairs of vertices \(a,b \in A_j\) that are separable in \(G\) and such that at least one of the vertices is in the set \(\max(A_j)\). Without loss of generality, assume \(a\in \max(A_j)\).

Case 1:  \(a \mathrel{\approx_G}b\). In this case, from Lemmas 78 and 75 we know that \(\text{\rmfamily\upshape aAdj}(a,G_{final})\) and \(\text{\rmfamily\upshape aAdj}(b,G_{final})\) separate \(a\) and \(b\) and at least one of them must be smaller then \(\text{\rmfamily\upshape SepSetBound}(G_{final})\).

Case 2:  \(a \mathrel{<_G}b\) or \(b \mathrel{<_G}a\). Without loss of generality, assume \(b \mathrel{<_G}a\). In this case, from Lemmas 78 and 74 we know that \(\text{\rmfamily\upshape aAdj}(a,G_{final})\) separates \(a\) and \(b\) and that the set is smaller then \(\text{\rmfamily\upshape SepSetBound}(G_{final})\).

Case 3:  \(a \mathrel{\mathrel{\parallel}_G}b\). Let \(A_b= A_j \setminus [a]_\approx^G\) and \(A_a = A_j \setminus [b]_\approx^G\). In this case we have that \(b\in A_b\), \(a\in A_a\), \(A_a \subset A_j\), \(A_b \subset A_j\), \(A_a\in A(G)\), and \(A_b\in A(G)\).

From Proposition 28, we know that \({a} \perp\!\!\!\!\perp_{G} {b}\ |\ {C}\) when \(C=\text{\rmfamily\upshape aiAdj}(a,b,G)\) and when \(C=\text{\rmfamily\upshape aiAdj}(b,a,G)\).

Without loss of generality, we show that \(\text{\rmfamily\upshape aiAdj}(a,b,G_{final}) \supseteq \text{\rmfamily\upshape aiAdj}(a,b,G)\).

Suppose that this is not the case and there is a vertex \(d\in \text{\rmfamily\upshape aiAdj}(a,b,G) \setminus \text{\rmfamily\upshape aiAdj}(a,b,G_{final})\).

Case 3.1:  \(d=b\). This cannot be the case as there would be a self-inducing walk between \(a\) and \(b\) and \(a\) and \(b\) would not be separable.

Case 3.2:  \(d\in \text{\rmfamily\upshape aAdj}(a,G)\). In this case, by Lemma 78, we have that \(\text{\rmfamily\upshape aAdj}(a,G_{final})\subseteq \text{\rmfamily\upshape aAdj}(a, G)\) so this cannot be the case.

Case 3.3:  \(d \in \text{\rmfamily\upshape aiAdj}(a,b,G)\setminus \text{\rmfamily\upshape aAdj}(a,G)\). In this case, there must be an inducing walk between \(a\) and \(d\) that is open given \(b\) in \(G\). Let \(\omega\) be a minimal inducing walk between \(a\) and \(d\) in \(G\) that is open given \(b\). There is a walk \(\omega'\) in \(G_{final}\) with the same vertex sequence. We show that \(\omega'\) is an inducing walk open given \(b\) in \(G_{final}\).

From Lemma 79, we know that every collider section on \(\omega\) corresponds to an undirected walk on \(\omega'\).

From Lemma 12, every vertex is anterior to either \(a\) or \(b\) and thus every vertex on \(\omega\) is in \(A_j\) as,

From Lemma 20, every collider section on \(\omega\) is discriminated by some discriminating inducing walkthat is a subwalk of \(\omega\).

Consider a discriminating inducing walkbetween \(v_i\) and \(v_k\) on \(\omega\) that discriminates a section \(\sigma\) and let \(A_{ik}=\mathop{\mathrm{Ant}}(\{\, v_i,v_k \,\},G)\). Clearly the set is an anterior set in \(G\) (i.e., \(A_{ik}\in A(G)\)).

We know that \(\sigma \cap A_{ik}=\emptyset\). This implies that \(A_{ik}\subseteq A_j\). From the induction hypothesis, the edge between \(v_i\) and \(v_j\) has been removed. By Lemma 80, The arrowheads into \(\sigma\) on \(\omega\) are oriented in \(\omega'\). This implies that \(\omega'\) is an inducing walk in \(G_{final}\). Finally, by Lemma 77, \(d\in \text{\rmfamily\upshape aiAdj}(a,b, G_{final}).\) This implies that \(\text{\rmfamily\upshape aiAdj}(a,b,G_{final})\subseteq \text{\rmfamily\upshape aiAdj}(a,b,G)\).

From this it must be the case that the edge between \(a\) and \(b\) must be removed in \(G_{final}\) as there is a subset of \(\text{\rmfamily\upshape aiAdj}(a,b,G)\) which will be found as \(socs \geq \text{\rmfamily\upshape SepSetBound}(G_{final})>|\text{\rmfamily\upshape aiAdj}(a,b,G)|\). ◻

Theorem 30

Proof. Assume \(G^*\) is an essentially separable graph. Let \(G^*_{sep}\equiv G^*\) be a separable graph equivalent to \(G^*\), \(G_{SGI}=\text{\rmfamily\upshape SGI}({I}{(G^*)})\) and \(G_{IND}=\text{\rmfamily\upshape InducedArrowheads}(G^*_{sep})\).

We show \(\text{\rmfamily\upshape SGI}({I}{(G^*)})=\text{\rmfamily\upshape InducedArrowheads}(G^*_{sep})\), that is, \(G_{SGI}=G_{IND}\).

First we show that \(G_{SGI}\) and \(G_{IND}\) have the same adjacencies. From Lemma 76 we have \(\text{\rmfamily\upshape ADJ}(G_{SGI}) \supseteq \text{\rmfamily\upshape ADJ}(G^*_{sep})\) and from Lemma 82 we have \(\text{\rmfamily\upshape ADJ}(G_{SGI}) \subseteq \text{\rmfamily\upshape ADJ}(G^*_{sep})\). Thus \(G_{SGI}\) and \(G^*_{sep}\) have the same adjacencies. Next, \(G_{IND}\) and \(G^*_{sep}\) have the same adjacencies and minimal inducing walks by Theorems 26 and 19. Combining these facts we have that \(G_{SGI}\) and \(G_{IND}\) have the same adjacencies.

Second, we show that \(G_{SGI}\) and \(G_{IND}\) have the same arrowheads.

We identify the arrowheads in \(G_{IND}\) with induced arrowheads in \(G^*_{sep}\). By construction, \(G_{IND}\) has an arrowhead at \(b\) on edge \({e(d, b)}\) if and only if \({e(d, b)}\) has an induced arrowhead at \(b\) in \(G^*_{sep}\).

Next we identify the arrowheads in \(G_{SGI}\) with induced arrowheads in \(G^*_{sep}\).

Every arrowhead in \(G_{SGI}\) is to due to an induced arrowhead in \({I}{(G^*)}\), or equivalently, \({I}{(G^*_{sep})}\). Next we show that if edge \({e(d, b)}\) has in induced arrowheadat \(b\) in \(G^*_{sep}\) then there is an edge with \({e'(d, b)}\) in \(G_{SGI}\) with an arrowhead at \(b\). From the argument above, there must be an edge \({e'(d, b)}\) in \(G_{SGI}\). From Lemma 71, there exist vertices \(i\) and \(j\) and vertex set \(D\) such that \(b\in \operatorname{IV}(i,j,D,G^*_{sep})\) and \(d\in \mathop{\mathrm{Ant}}(\{\, i,j \,\},G)\). At some stage, the algorithm will identify a minimal separating set \(C\) for \(i\) and \(j\). After identifying the set \(C\) that separates \(i\) and \(j\) the algorithm will add the arrowhead at \(b\) on edge \({e'(d, b)}\) due to the fact that it will, determine that \(d\not\in \operatorname{IV}(i,j,G_{SGI})\) by testing \({i} \perp\!\!\!\!\perp_{G^*} {j}\ |\ {Cd}\) which must hold by Lemma 45. This implies that in \(G_{SGI}\) there is an arrowhead at \(b\) on edge \({e(d, b)}\) if and only if \({e(d, b)}\) has an induced arrowhead at \(b\) in \(G^*_{sep}\). This implies that \(G_{SGI}\) and \(G_{IND}\) have the same arrowheads.

From the fact that \(G_{SGI}\) and \(G_{IND}\) are simple graphs, have the same adjacencies and same arrowheads we have that \(G_{SGI}=G_{IND}\). ◻

Corollary 6

Proof. Assume \(G^*\in \mathcal{E}({\cal G}_{sep})\) is an essentially separable graph and that \({I}{(P^*)}\) provides perfect testing with respect to \(G^*\).

Let \(G^*_{sep}\equiv G^*\) be a separable graph equivalent to \(G^*\), \(G_{SGI}=\text{\rmfamily\upshape SGI}({I}{(P^*)})\) and \(G_{IND}=\text{\rmfamily\upshape InducedArrowheads}(G^*_{sep})\). From perfect testing, we have \(\text{\rmfamily\upshape SGI}({I}{(P^*)}) = \text{\rmfamily\upshape SGI}({I}{(G^*_{sep})})\). From Theorem 30, we have \(\text{\rmfamily\upshape SGI}({I}{(P^*)})=\text{\rmfamily\upshape InducedArrowheads}(G^*_{sep})\). From Theorem 26, for all separable graphs \(G,G'\) it is the case that \(\text{\rmfamily\upshape SGI}({I}{(G)}) = \text{\rmfamily\upshape SGI}({I}{(G')})\) if and only if \(G \equiv G'\). Thus if \(G^*\in \mathcal{E}({\cal G}_{sep})\) then \(\text{\rmfamily\upshape SGI}\) identifies the equivalence class \(\left[{G^*}\right]_{\mathcal{E}({\cal G}_{sep})}\) under perfect testing. ◻

Theorem 31

Proof. Let \(G^*\) be separable and \(P^*\) provide perfect testing for \(G^*\). Let \(G_{final}= \text{\rmfamily\upshape SGI}({I}{(P^*)})\) and note that \(G=G_{final}= \text{\rmfamily\upshape InducedArrowheads}(G^*)\) by Corollary 6. In this case, the algorithm terminates when \(socs \geq \text{\rmfamily\upshape SepSetBound}(G_{final})\). This implies that we consider at most \(O(|V|^{\text{\rmfamily\upshape SepSetBound}(G)})\) independence tests to guarantee that edges between separable pairs of vertices have been removed. In addition, the determination of the set of inducing vertices for a separated pair of vertices is bounded by \(O(|V|).\) Thus the total number of independence tests is bounded by \(O(|V|^{\text{\rmfamily\upshape SepSetBound}(G)+1})\). ◻

References↩︎

[1]
J. W. Gibbs, Elementary principles in statistical mechanics. Yale University Press, 1902.
[2]
S. Wright, “Correlation and causational,” Journal of Agricultural Research, vol. 20, pp. 162–177, 1925.
[3]
S. L. Lauritzen, Graphical Models. Oxford, UK: Oxford University Press, 1996.
[4]
T. Richardson, “A discovery algorithm for directed cyclic graphs,” in Proceedings of the twelfth international conference on uncertainty in artificial intelligence, 1996, pp. 454–461, doi: https://doi.org/10.48550/arXiv.1302.3599.
[5]
J. T. A. Koster, Markov properties of nonrecursive causal models,” The Annals of statistics, vol. 24, no. 5, pp. 2148–2177, 1996, doi: 10.1214/aos/1069362315.
[6]
P. Spirtes, C. Glymour, and R. Scheines, Causation, prediction, and search, vol. 81. New York, NY, USA: Springer-Verlag, 1993.
[7]
T. S. Richardson and P. Spirtes, “Ancestral graph markov models,” Annals of Statistics, vol. 30, pp. 962–1030, 2002, doi: 10.1214/aos/1031689015.
[8]
P. Spirtes, “Directed cyclic graphical representations of feedback models,” in Proceedings of the eleventh conference on uncertainty in artificial intelligence, 1995, pp. 491–498, doi: https://doi.org/10.48550/arXiv.1302.4982.
[9]
P. Forré and J. M. Mooij, “Causal calculus in the presence of cycles, latent confounders and selection bias,” in Proceedings of the 35th uncertainty in artificial intelligence conference (UAI-19), Jul. 2020, vol. 115, pp. 71–80, doi: https://doi.org/10.48550/arXiv.1901.00433.
[10]
S. A. Andersson, D. Madigan, and M. D. Perlman, “Alternative Markov properties for chain graphs,” Scandinavian Journal of Statistics, vol. 28, no. 1, pp. 33–85, 2001, doi: https://doi.org/10.1111/1467-9469.00224.
[11]
V. Didelez, “Graphical models for marked point processes based on local independence,” Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 70, no. 1, pp. 245–264, Jan. 2008, doi: 10.1111/j.1467-9868.2007.00634.x.
[12]
K. Sadeghi, Marginalization and conditioning for LWF chain graphs,” The Annals of Statistics, vol. 44, no. 4, pp. 1792–1816, 2016, doi: 10.1214/16-AOS1451.
[13]
S. Lauritzen and K. Sadeghi, Unifying Markov properties for graphical models,” The Annals of Statistics, vol. 46, no. 5, pp. 2251–2278, 2018, doi: 10.1214/17-AOS1618.
[14]
N. Wermuth and S. L. Lauritzen, “On substantive research hypotheses, conditional independence graphs and graphical chain models,” Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 52, no. 1, pp. 21–72, 1990, doi: 10.1111/j.2517-6161.1990.tb01771.x.
[15]
T. Verma and J. Pearl, On the equivalence of causal models,” in Proceedings of the sixth conference on uncertainty in artificial intelligence, Amsterdam, The Netherlands: Elsevier Science, 1990, pp. 220–227.
[16]
M. Frydenberg, “The chain graph Markov property,” Scandinavian Journal of Statistics, vol. 17, no. 4, pp. 333–353, 1990, doi: https://www.jstor.org/stable/4616181.
[17]
H. Zhao, Z. Zheng, and B. Liu, “On the Markov equivalence of maximal ancestral graphs,” Science in China Series A: Mathematics, vol. 48, p. 548—562, 2005, doi: 10.1360/04ys0023.
[18]
P. Spirtes, C. Meek, and T. Richardson, “Causal inference in the presence of latent variables and selection bias,” in Proceedings of the the Eleventh Conference on Uncertainty in Artificial Intelligence, Montreal, QU, 1995, pp. 499–506, [Online]. Available: https://www.microsoft.com/en-us/research/publication/causal-inference-in-the-presence-of-latent-variables-and-selection-bias/.
[19]
K. Sadeghi and S. L. Lauritzen, “Markov properties for mixed graphs,” Bernoulli, vol. 20, pp. 676–696, 2011, doi: 10.3150/12-BEJ502.
[20]
K. Sadeghi, “Faithfulness of probability distributions and graphs,” Journal of Machine Learning Research, vol. 18, no. 1, pp. 5429–5457, 2017, doi: https://doi.org/10.48550/arXiv.1701.08366.
[21]
T. Richardson, “A characterization of markov equivalence for directed cyclic graphs,” International Journal of Approximate Reasoning, vol. 17, no. 2, pp. 107–162, 1997, doi: https://doi.org/10.1016/S0888-613X(97)00020-0.
[22]
T. Claassen and J. M. Mooij, “Establishing Markov equivalence in cyclic directed graphs,” in Proceedings of the thirty-ninth conference on uncertainty in artificial intelligence (UAI-23), Aug. 2023, vol. 216, pp. 433–442, doi: https://doi.org/10.48550/arXiv.2309.03092.
[23]
C. Meek, “Causal inference and causal explanation with background knowledge,” in Proceedings of the eleventh conference on uncertainty in artificial intelligence, 1995, pp. 403–410, doi: https://doi.org/10.48550/arXiv.1302.4972.
[24]
J. Zhang, “A characterization of Markov equivalence classes for directed acyclic graphs with latent variables,” in Proceedings of the twenty-third conference on uncertainty in artificial intelligence, 2007, pp. 450–457, doi: https://doi.org/10.48550/arXiv.1206.5282.
[25]
C. Meek, “Strong completeness and faithfulness in Bayesian networks,” in Proceedings of the eleventh conference on uncertainty in artificial intelligence, 1995, pp. 411–418, doi: https://doi.org/10.48550/arXiv.1302.4973.
[26]
J. M. Peña, “Faithfulness in chain graphs: The discrete case,” International Journal of Approximate Reasoning, vol. 50, no. 8, pp. 1306–1313, 2009, doi: 10.1016/j.ijar.2009.06.006.
[27]
J. Zhang and P. Spirtes, “Detection of unfaithfulness and robust causal inference,” Minds and Machines, vol. 18, no. 2, pp. 239–271, 2008.
[28]
K. Z. Teh, K. Sadeghi, and T. Soo, “A general framework on conditions for constraint-based causal learning,” Scandinavian Journal of Statistics, vol. 52, no. 4, pp. 2209–2241, 2025, doi: https://doi.org/10.1111/sjos.70023.
[29]
T. Claassen, J. M. Mooij, and T. Heskes, “Learning sparse causal models is not NP-hard,” in Proceedings of the twenty-ninth conference on uncertainty in artificial intelligence (UAI 2013), 2013, pp. 172–181, doi: 10.48550/arXiv.1309.6824.
[30]
D. Colombo, M. H. Maathuis, M. Kalisch, and T. S. Richardson, “Learning high-dimensional directed acyclic graphs with latent and selection variables,” The Annals of Statistics, vol. 40, no. 1, pp. 294–321, 2012, doi: 10.1214/11-AOS940.

  1. A measurable space \(\left( \times_{v\in V}\mathscr{X}_v, \bigotimes_{v\in V}\mathscr{F}_v \right)\) where, for \(v\in V\), \(\mathscr{F}_v\) is a \(\sigma\)-field over the set \(\mathscr{X}_v\).↩︎

  2. Note that if a theorem, proposition, lemma, or corollary has no citation then its proof can be found in an Appendix.↩︎

  3. More formally, the defining family has a common product measurable space \(\left( \times_{v\in V}\mathscr{X}_v,\bigotimes_{v\in V}\mathscr{F}_v \right)\) indexed by \(V\). Typically, one also assumes that there is a common dominating measure but this is not required here.↩︎

  4. Unlike some definitions of circuit, we allow for repeated vertices and repeated edge.↩︎

  5. Separation equivalence is also called Markov equivalence.↩︎

  6. The relationship \({I}{(G)} \subset {I}{(P)}\) — all of the separation facts in the graph correspond to independence facts in the distribution — is sometimes referred to as \(P\) satisfying the global Markov condition with respect to graph \(G\). Other concepts relating independence in a distribution and separation in a graph exist. See [3] for a discussion of other such relationships between graphs and probability distributions.↩︎

  7. It is also natural to consider a structure identification algorithm that takes data sampled from a generative distribution as input. Assuming that we observe the generative distribution allows us to focus on identification rather than other notions of correctness like asymptotic consistency or rates of identification.↩︎

  8. A distribution is a product distribution if \(P(V)=\prod_{v_i\in V}P(v_i)\) where \(P(v_i)\) is the marginal distribution of \(v_i\).↩︎

  9. A self-inducing walkis closely related to both the primitive inducing path of [7] and the primitive inducing walk of [13]. In fact, if either a primitive inducing path or primitive inducing walk has no edge between its endpoints then it is a self-inducing walk.↩︎

  10. In Section [sec:sigma-separation], we show that for mixed graphs under under \(\sigma\)-separation, \(\sigma\)-maximal graphs correspond to \(\sigma\)-separable graphs.↩︎

  11. We extend this equivalence relation to all walks in Appendix 13.5.↩︎

  12. The set of induced adjacencies is a generalization of the set \(D\)-\(SEP\) defined by [6] and Proposition 28 is related to Theorem 6.2 and Lemma 6.2.4 proved in [6].↩︎

  13. This assumption is sometimes referred to as the distribution and the graph being faithful; see, for example, [20]. Faithfulness, however, often refers only one direction. In particular, the direction opposite of \(P^*\) being Markov with respect to \(G^*\); see [6].↩︎

  14. The definition of the termination properties of walks is given in Section 2.3.2.↩︎