E-graph

In computer science, an e-graph is a data structure that stores an equivalence relation over terms of some language.

Definition and operations

Let ${\displaystyle \Sigma }$ be a set of uninterpreted functions, where ${\displaystyle \Sigma _{n}}$ is the subset of ${\displaystyle \Sigma }$ consisting of functions of arity ${\displaystyle n}$. Let ${\displaystyle \mathbb {id} }$ be a countable set of opaque identifiers that may be compared for equality, called e-class IDs. The application of ${\displaystyle f\in \Sigma _{n}}$ to e-class IDs ${\displaystyle i_{1},i_{2},\ldots ,i_{n}\in \mathbb {id} }$ is denoted ${\displaystyle f(i_{1},i_{2},\ldots ,i_{n})}$ and called an e-node.

The e-graph then represents equivalence classes of e-nodes, using the following data structures:^[1]

• A union-find structure ${\displaystyle U}$ representing equivalence classes of e-class IDs, with the usual operations ${\displaystyle \mathrm {find} }$, ${\displaystyle \mathrm {add} }$ and ${\displaystyle \mathrm {merge} }$. An e-class ID ${\displaystyle e}$ is canonical if ${\displaystyle \mathrm {find} (U,e)=e}$; an e-node ${\displaystyle f(i_{1},\ldots ,i_{n})}$ is canonical if each ${\displaystyle i_{j}}$ is canonical (${\displaystyle j}$ in ${\displaystyle 1,\ldots ,n}$).
• An association of e-class IDs with sets of e-nodes, called e-classes. This consists of
  • a hashcons ${\displaystyle H}$ (i.e. a mapping) from canonical e-nodes to e-class IDs, and
  • an e-class map ${\displaystyle M}$ that maps e-class IDs to e-classes, such that ${\displaystyle M}$ maps equivalent IDs to the same set of e-nodes: ${\displaystyle \forall i,j\in \mathbb {id} ,M[i]=M[j]\Leftrightarrow \mathrm {find} (U,i)=\mathrm {find} (U,j)}$

Invariants

In addition to the above structure, a valid e-graph conforms to several data structure invariants.^[2] Two e-nodes are equivalent if they are in the same e-class. The congruence invariant states that an e-graph must ensure that equivalence is closed under congruence, where two e-nodes ${\displaystyle f(i_{1},\ldots ,i_{n}),f(j_{1},\ldots ,j_{n})}$ are congruent when ${\displaystyle \mathrm {find} (U,i_{k})=\mathrm {find} (U,j_{k}),k\in \{1,\ldots ,n\}}$. The hashcons invariant states that the hashcons maps canonical e-nodes to their e-class ID.

Operations

This section needs expansion. You can help by adding to it. (June 2021)

E-graphs expose wrappers around the ${\displaystyle \mathrm {add} }$, ${\displaystyle \mathrm {find} }$, and ${\displaystyle \mathrm {merge} }$ operations from the union-find that preserve the e-graph invariants. The last operation, e-matching, is described below.

E-matching

Let ${\displaystyle V}$ be a set of variables and let ${\displaystyle \mathrm {Term} (\Sigma ,V)}$ be the smallest set that includes the 0-arity function symbols (also called constants), includes the variables, and is closed under application of the function symbols. In other words, ${\displaystyle \mathrm {Term} (\Sigma ,V)}$ is the smallest set such that ${\displaystyle V\subset \mathrm {Term} (V,\Sigma )}$, ${\displaystyle \Sigma _{0}\subset \mathrm {Term} (\Sigma ,V)}$, and when ${\displaystyle x_{1},\ldots ,x_{n}\in \mathrm {Term} (\Sigma ,V)}$ and ${\displaystyle f\in \Sigma _{n}}$, then ${\displaystyle f(x_{1},\ldots ,x_{n})\in \mathrm {Term} (\Sigma ,V)}$. A term containing variables is called a pattern, a term without variables is called ground.

An e-graph ${\displaystyle E}$ represents a ground term ${\displaystyle t\in \mathrm {Term} (\Sigma ,\emptyset )}$ if one of its e-classes represents ${\displaystyle t}$. An e-class ${\displaystyle C}$ represents ${\displaystyle t}$ if some e-node ${\displaystyle f(i_{1},\ldots ,i_{n})\in C}$ does. An e-node ${\displaystyle f(i_{1},\ldots ,i_{n})\in C}$ represents a term ${\displaystyle g(j_{1},\ldots ,j_{n})}$ if ${\displaystyle f=g}$ and each e-class ${\displaystyle M[i_{k}]}$ represents the term ${\displaystyle j_{k}}$ (${\displaystyle k}$ in ${\displaystyle 1,\ldots ,n}$).

e-matching is an operation that takes a pattern ${\displaystyle p\in \mathrm {Term} (\Sigma ,V)}$ and an e-graph ${\displaystyle E}$, and yields all pairs ${\displaystyle (\sigma ,C)}$ where ${\displaystyle \sigma \subset V\times \mathbb {id} }$ is a substitution mapping the variables in ${\displaystyle p}$ to e-class IDs and ${\displaystyle C\in \mathbb {id} }$ is an e-class ID such that each term ${\displaystyle \sigma (p)}$ is represented by ${\displaystyle C}$. There are several known algorithms for e-matching,^[3][4] the relational e-matching algorithm is based on worst-case optimal joins and is worst-case optimal.^[5]

Complexity

• An e-graph with n equalities can be constructed in O(n log n) time.^[6]

Equality saturation

This section needs expansion. You can help by adding to it. (June 2021)

Equality saturation is a technique for building optimizing compilers using e-graphs.^[7] It operates by applying a set of rewrites using e-matching until the e-graph is saturated, a timeout is reached, an e-graph size limit is reached, a fixed number of iterations is exceeded, or some other halting condition is reached. After rewriting, an optimal term is extracted from the e-graph according to some cost function, usually related to AST size or performance considerations.

Applications

E-graphs are used in

E-graphs have been applied to several problems in program analysis, including fuzzing,^[16] abstract interpretation,^[17][18] and library learning.^[19]

References