1 Introduction

In [8], Woronowicz provided a Tannaka duality for the (today so-called) compact matrix quantum groups he defined in [7] and which can be seen as a certain class of complex Hopf-\(*\)-algebras (compare also [9] for general compact quantum groups). More precisely, Woronowicz’s theorem establishes a 2-equivalence between, on the one hand, the opposite of the (2, 1)-category \(\mathbf{CMQG}\) of compact matrix quantum groups and, on the other hand, the slice 2-category \(\mathbf{gm}C^*\mathbf{Cat}_{\mathrm{scfr}}/\mathsf{Hilb}_{\mathrm{f}}\) of small Cauchy-complete finite-dimensional rigid monoidal \(C^*\)-categories with a fixed a single-object generator (as 0-cells and with unitary monoidal functors as 1-cells and unitary monoidal natural transformations as 2-cells) over the category of finite-dimensional complex Hilbert spaces.

Banica and Speicher showed in [1] how to construct 0-cells of the 2-category \(\mathbf{gm}C^*\mathbf{Cat}_{\mathrm{scfr}}/\mathsf{Hilb}_{\mathrm{f}}\) from so-called categories of partitions, importantly utilizing combinatorics to produce heretofore scarce examples. Tarrago and the second author extended their construction in [6] to produce even more examples, now from categories of two-colored partitions. Moreover, they initiated a program to classify all such categories. The present article aims to further this effort.

Categories of two-colored partitions are explained in reference to a certain category \(\mathcal {P}^{\circ \bullet }\) . The latter is defined to have as objects all words \(c_1\ldots c_k\) over the alphabet \(\{\circ ,\bullet \}\). The morphism set from any word \(c_1\ldots c_k\) to any word \(d_1\ldots d_\ell \) consists of all set-theoretical partitions p of . Morphisms are composed by “vertical concatenation”, which importantly involves the (associative operation of) forming the join of two set-theoretical partitions. The identity of \(c_1\ldots c_k\) is the set containing exactly the sets for all \(i\in \{1,\ldots ,k\}\). Morphisms are frequently depicted graphically. E.g., the identity morphism of \(\circ \circ \bullet \) is addressed as .

Moreover, \(\mathcal {P}^{\circ \bullet }\) is equipped with the strict monoidal structure given on objects by the (“horizontal”) concatenation of words, \(c_1\ldots c_k\otimes c_1'\ldots c'_{k'}=c_1\ldots c_k c_1'\ldots c'_{k'}\), and on morphisms by an operation in the same spirit. The monoidal unit object is the empty word \(\varnothing \). The dagger functor acts by “reflection”, i.e., exchanging . With respect to this monoidal structure, \(\mathcal {P}^{\circ \bullet }\) is rigid. Moreover, it is generated as a rigid monoidal category by the single object given by the one-letter word \(\circ \), whose dual object is \(\bullet \). The (left) evaluation and co-evaluation morphisms of \(\circ \) correspond to and , respectively. (That is enough to know because \(\mathcal {P}^{\circ \bullet }\) can further be equipped with a symmetry, e.g., from \(\circ \bullet \) to \(\bullet \circ \).)

By definition, a category of two-colored partitions is now any wide (necessarily rigid) monoidal dagger-subcategory of \(\mathcal {P}^{\circ \bullet }\) containing the evaluation and co-evaluation morphisms of \(\circ \). Routinely, the symbol \(\mathcal {P}^{\circ \bullet }\) is also used for the set of all morphisms of \(\mathcal {P}^{\circ \bullet }\). And since categories of two-colored partitions are in particular supposed to be wide they are usually framed as subsets \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) of this set \(\mathcal {P}^{\circ \bullet }\), subject to corresponding closure conditions. (See [6] or [5] for an unabridged version of all those defini.)

Since the classification program for categories of two-colored partitions was begun, different subclasses have been indexed by various contributors (see [2,3,4, 6]). The present article is the second part of a series aiming to determine and describe all so-called non-hyperoctahedral categories, i.e., all categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) with or .

In this regard the first article [5] and the present one pursue complementary approaches to detecting whether a given set of partitions is a non-hyperoctahedral category: Part I gave sufficient conditions for being a non-hyperoctahedral category, Part II now provides necessary ones.

Let us take a closer look at the findings of Part I, [5]. Every two-colored partition can be equipped with two natural structures on its set of points: a measure-like one, the color sum, and a metric-like one, the color distance. Both [5] and the present article study tuples of six properties of any given partition:

  1. (1)

    the set of block sizes,

  2. (2)

    the set of block color sums,

  3. (3)

    the color sum of the set of all points,

  4. (4)

    the set of color distances between subsequent legs of the same block with identical (normalized) colors,

  5. (5)

    the set of color distances between subsequent legs of the same block with different (normalized) colors and

  6. (6)

    the set of color distances between legs belonging to crossing blocks.

By forming unions, one can aggregate these data over a given set of partitions. This information extracted from a set \(\mathcal S\subseteq \mathcal {P}^{\circ \bullet }\) of partitions was called \(Z(\mathcal S)\) in [5].

There it was shown that one can give constraints on the above six properties which are preserved under category operations: A partially ordered set \((\mathsf{Q},\le )\) of parameters was introduced to prove that the sets of the form

$$\begin{aligned} \mathcal R_Q{:}{=}\{p\in \mathcal {P}^{\circ \bullet }\mid Z(\{p\})\le Q\}\quad \text {for }Q\in \mathsf{Q} \end{aligned}$$

form non-hyperoctahedral categories.

The current article now shows that these constraints encoded in Z and \((\mathsf{Q},\le )\) are natural in the following sense. (See also Section 2 for the definitions.)

Main Theorem

[Theorem 9.1] Given any non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) of two-colored partitions, we have \(Z(\mathcal C)\in \mathsf{Q}\).

The importance of this result comes from its role in the overall program of the article series. On the one hand, it will be crucial to proving the main assertions of the ensuing articles. On the other hand, once those have been established, it will combine with them to show the final result of the entire series, roughly:

Main Theorem of the Series

(Excerpt). Z restricts to a one-to-one correspondence between the set \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\) of non-hyperoctahedral categories of two-colored partitions and the parameter set \(\mathsf{Q}\).

The proof will go as follows: By Part I of the series, \(\mathcal R_Q\subseteq \mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\) for every \(Q\in \mathsf{Q}\). Conversely, by the above Main Theorem of Part II, \(Z(\mathcal C)\in \mathsf{Q}\) for any \(\mathcal C\in \mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\). In the subsequent articles we will define a set \(\mathcal G_{Z(\mathcal C)}\subseteq \mathcal {P}^{\circ \bullet }\) and show

$$\begin{aligned} \mathcal G_{Z(\mathcal C)}\subseteq \mathcal C\subseteq \langle \mathcal G_{Z(\mathcal C)}\rangle \quad \text {and} \quad \mathcal G_{Z(\mathcal R_{Z(\mathcal C)})}\subseteq \mathcal R_{Z(\mathcal C)}\subseteq \langle \mathcal G_{Z(\mathcal R_{Z(\mathcal C)})}\rangle . \end{aligned}$$

Proving \(Z(\mathcal R_{Z(\mathcal C)})=Z(\mathcal C)\) will then let us conclude \(\mathcal C=\langle \mathcal G_{Z(\mathcal C)}\rangle =\langle \mathcal G_{Z(\mathcal R_{Z(\mathcal C)})}\rangle =\mathcal R_{Z(\mathcal C)}\).

2 Reminder on Definitions from Part I

For the convenience of the reader we briefly repeat those definitions from [5, Sections 3–5] which are relevant to the current article. For definitions of partitions and categories of partitions see [5, Sections 3.1 and 4.2]. Throughout this article we will use the notations and definitions from [5, Sections 3–5].

Notation 2.1

For every set S denote its power set by \(\mathfrak P(S)\).

Definition 2.2

[5, Definition 5.2] The parameter domain \(\mathsf{L}\) is the sixfold Cartesian product of \(\mathfrak {P}(\mathbb {Z})\).

Definition 2.3

[5, Definition 5.3] Using the notation from [5, Sections 3–5], we define the analyzer \(Z: \, \mathfrak {P}(\mathcal {P}^{\circ \bullet })\rightarrow \mathsf{L}\) by

$$\begin{aligned} Z{:}{=}(\, F,\, V,\, \Sigma ,\, L,\, K,\, X\,) \end{aligned}$$

where, for all \(\mathcal S\subseteq \mathcal {P}^{\circ \bullet }\),

  1. (a)

    \(F(\mathcal S){:}{=}\{\, |B| \mid p\in \mathcal S,\, B\text { block of } p\}\) is the set of block sizes,

  2. (b)

    \(V(\mathcal S){:}{=}\{\,\sigma _p(B)\mid p\in \mathcal S,\, B\text { block of }p\}\) is the set of block color sums,

  3. (c)

    \(\Sigma (\mathcal S){:}{=}\{\,\Sigma (p)\mid p\in \mathcal S\}\) is the set of total color sums,

  4. (d)

    is the set of color distances between any two subsequent legs of the same block having the same normalized color,

  5. (e)

    is the set of color distances between any two subsequent legs of the same block having different normalized colors and

  6. (f)

    is the set of color distances between any two legs belonging to two crossing blocks.

Notation 2.4

  1. (a)

    For all \(x,y\in \mathbb {Z}\) and \(A,B\subseteq \mathbb {Z}\) write

    $$\begin{aligned} xA+yB{:}{=}\{xa+yb\mid a\in A, \,b\in B\}. \end{aligned}$$

    Moreover, put \(xA-yB{:}{=}xA+(-y)B\). Per \(A=\{1\}\) expressions like \(x+yB\) are defined as well, and per \(x=1\) so are such like \(A+yB\).

  2. (b)

    Let \(\pm S{:}{=}S\cup (-S)\) for all sets \(S\subseteq \mathbb {Z}\).

  3. (c)

    For all \(m\in \mathbb {Z}\) and \(D\subseteq \mathbb {Z}\) define

    $$\begin{aligned} D_m{:}{=}(D\cup (m- D))+m\mathbb {Z}\quad \text {and}\quad D_m'{:}{=}(D\cup (m-D)\cup \{0\})+m\mathbb {Z}. \end{aligned}$$
  4. (d)

    Use the abbreviations and for all \(k\in \mathbb {N}\).

Definition 2.5

([5, Definition 5.7]). Define the parameter range \(\mathsf{Q}\) as the subset of \(\mathsf{L}\) comprising all tuples (fvslkx) listed below, where \(u\in \{0\}\cup \mathbb {N}\), where \(m\in \mathbb {N}\), where , where \(E\subseteq \{0\}\cup \mathbb {N}\) and where N is a subsemigroup of \((\mathbb {N},+)\):

The goal of this article, as sketched in the introduction, is to prove that Z restricts to a map \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\rightarrow \mathsf{Q}\) (see Theorem 9.1). Evidently, \(\mathsf{Q}\) is not a Cartesian product; the six entries of the tuples cannot vary independently. Rather, only very special tuples of sets are allowed. Hence, if the claim \(Z:\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\rightarrow \mathsf{Q}\) is to be true, then it is not enough to study the components of Z individually. We must also investigate the relations between them. In consequence, the argument follows a winding path, taking components into and out of consideration underway as required or convenient.

3 Tools: Equivalence and Projection

We introduce an equivalence relation on pairs of partitions and consecutive sets therein by which to compare partitions locally (cf. [3, Definition 6.2]).

Definition 3.1

For all \(i\in \{1,2\}\), let \(P_{p_i}\) denote the set of all points of \(p_i\in \mathcal {P}^{\circ \bullet }\) and let \(S_i\subseteq P_{p_i}\) be consecutive. We call \((p_1,S_1)\) and \((p_2,S_2)\) equivalent if \(S_1=S_2=\varnothing \) or if the following is true: There exist \(n\in \mathbb N\) and for each \(i\in \{1,2\}\) pairwise distinct points \(\gamma _{i,1},\ldots ,\gamma _{i,n}\) in \(p_i\) such that \((\gamma _{i,1},\ldots , \gamma _{i,n})\) is ordered in \(p_i\) and \(S_i=\{\gamma _{i,1},\ldots ,\gamma _{i,n}\}\) and such that for all \(j,j'\in \{1,\ldots ,n\}\) (possibly \(j=j'\)) the following are true:

  1. (1)

    The normalized colors of \(\gamma _{1,j}\) in \(p_1\) and \(\gamma _{2,j}\) in \(p_2\) agree.

  2. (2)

    The points \(\gamma _{1,j}\) and \(\gamma _{1,j'}\) both belong to a block \(B_1\) of \(p_1\) with \(B_1\subseteq S_1\) if and only if \(\gamma _{2,j}\) and \(\gamma _{2,j'}\) both belong to a block \(B_2\) of \(p_2\) with \(B_2\subseteq S_2\).

  3. (3)

    The points \(\gamma _{1,j}\) and \(\gamma _{1,j'}\) both belong to a block \(B_1\) of \(p_1\) with \(B_1\not \subseteq S_1\) if and only if \(\gamma _{2,j}\) and \(\gamma _{2,j'}\) both belong to a block \(B_2\) of \(p_2\) with \(B_2\not \subseteq S_2\).

figure a

If \((p_1,S_1)\) and \((p_2,S_2)\) are equivalent, then \(S_1\) and \(S_2\) agree in size and normalized coloring up to a rotation \(\varrho \) and the induced partitions \(\{B_1\cap S_1\,\vert \, B_1\text { block of }p_1\}\) of \(S_1\) and \(\{B_2\cap S_2\,\vert \, B_2\text { block of }p_2\}\) of \(S_2\) concur up to \(\varrho \). However, this is only a necessary condition. Equivalence further requires that a block \(B_1\cap S_1\) of the restriction of \(p_1\) stems from a block \(B_1\) of \(p_1\) which has legs outside \(S_1\) if and only if the corresponding statement \(B_2\not \subseteq S_2\) is true for the block \(B_2\) of \(p_2\) which \(B_1\) is mapped to under \(\varrho \).

We define and construct special representatives of the classes of this equivalence relation. Recall that a partition \(p\in \mathcal {P}^{\circ \bullet }\) is called projective if p is self-adjoint, i.e., \(p=p^*\), and idempotent, i.e., the pair (pp) is composable and \(pp=p\).

Definition 3.2

For every consecutive set S in \(p\in \mathcal {P}^{\circ \bullet }\) we call the unique projective partition q with lower row M such that (qM) and (pS) are equivalent the projection P(pS) of (pS).

figure b

In truth, of course, for any consecutive set S in \(p\in \mathcal {P}^{\circ \bullet }\) the projection P(pS) depends only on the equivalence class of (pS). The following lemma constitutes a generalization of [3, Lemma 6.4].

Lemma 3.3

\(P(p,S)\in \langle p\rangle \) for any consecutive set S in any \(p\in \mathcal {P}^{\circ \bullet }\).

Proof

As \(S=\varnothing \) implies \(P(p,S)=\varnothing \in \langle p\rangle \), let \(S\ne \varnothing \). By rotation we can assume that S is the lower row of p. Then S has the same size and coloring in p as in \(q{:}{=}pp^*\). We show \(q=P(p,S)\). By the nature of composition the blocks of p which are contained in S are blocks of q as well. We only need to care about the other blocks of q. If we identify the upper row of p and the lower row of \(p^*\), the same partition s is induced there by p and \(p^*\). Consequently, the meet of the two induced partitions is identical with s as well. That means that every block D of s intersects exactly one block B of p and exactly one block of \(p^*\), namely the mirror image of B. The block of q resulting from D therefore contains exactly the restriction of B to the lower row and the mirror image of that set on the upper row. That means \(q=P(p,S)\), which proves the claim. \(\square \)

4 Step 1: Component F in Isolation

We now take our first step towards proving the main result that the analyzer Z from Definition 2.3 restricts to a map \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\rightarrow \mathsf{Q}\) (see Theorem 9.1). Namely, we verify (see Proposition 4.3) that, for every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the set

$$\begin{aligned} F(\mathcal C){:}{=}\{|B| \mid p\in \mathcal C,\, B\text { block of }p\} \end{aligned}$$

of block sizes appearing in \(\mathcal C\) can only be one of the three sets of integers admissible as a first component for tuples in \(\mathsf{Q}\) by Definition 2.5.

Lemma 4.1

[6, Lemmata 1.3 (b), 2.1 (a)] Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a category.

  1. (a)

    .

  2. (b)

    The following statements are equivalent:

    1. (1)

      There exists in \(\mathcal C\) a partition with a singleton block.

    2. (2)

      .

  3. (c)

    If , then \(\mathcal C\) is closed under disconnecting points from their blocks.

Proof

  1. (a)

    All transformations can be achieved by basic and cyclic rotations.

  2. (b)

    Projecting to a singleton block produces or . Hence, Part (a) and Lemma 3.3 prove the claim.

  3. (c)

    Rotate a given partition such that the leg to disconnect from its block is the only lower point. Composing from below with or , depending on the color of the leg, and reversing the rotation achieves what is claimed. Hence, Part (a) concludes the proof. \(\square \)

Lemma 4.2

[6, Lemmata 1.3 (d), 2.1 (b)] Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a category.

  1. (a)

    .

  2. (b)

    The following statements are equivalent:

    1. (1)

      There exists in \(\mathcal C\) a partition with a block with at least three legs.

    2. (2)

      .

  3. (c)

    If , then \(\mathcal C\) is closed under connecting the two points in any turn.

Proof

  1. (a)

    Once again, by basic and cyclic rotations we can transform the partitions into each other.

  2. (b)

    Suppose B is a block in \(p\in \mathcal C\) with at least three legs, \(\alpha ,\beta \in B\), \(\alpha \ne \beta \) and \(]\alpha ,\beta [_p\cap B=\varnothing \). Let T be the set of the first lower and the first upper point of \(P(p,[\alpha ,\beta ]_p)\). The partition \(P(P(p,[\alpha ,\beta ]_p),T)\) is either or . Thus follows the claim by Part (a) and Lemma 3.3.

  3. (c)

    Let T be the turn in \(p\in \mathcal C\) whose points we want to connect. By rotation we can assume that T is the upper row of p. By composing p from above with or , depending on the sequence of colors in T, and reversing the initial rotation we achieve exactly what is claimed. So, Part (a) implies the assertion. \(\square \)

Recall the cases \(\mathcal O\), \(\mathcal B\), \(\mathcal S\) from [5, Definition 4.1].

Proposition 4.3

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a non-hyperoctahedral category.

  1. (a)

    The set \(F(\mathcal C)\) is given by \(\{2\}\), \(\{1,2\}\) or \(\mathbb {N}\).

  2. (b)

    If \(\mathcal C\) is case \(\mathcal O\), then \(F(\mathcal C)=\{2\}\).

  3. (c)

    If \(\mathcal C\) is case \(\mathcal B\), then \(F(\mathcal C)=\{1,2\}\).

  4. (d)

    If \(\mathcal C\) is case \(\mathcal S\), then \(F(\mathcal C)=\mathbb {N}\).

Proof

By definition of a category, and thus \(\{2\}\subseteq F(\mathcal C)\).

  1. (a)

    The first claim follows from the other three.

  2. (b)

    Because and , Lemmata 4.1 (b) and 4.2 (b) show that every block in every partition of \(\mathcal C\) has exactly two legs, i.e., \(F(\mathcal C)=\{2\}\).

  3. (c)

    The assumption implies by Lemma 4.2 (c) that no partition of \(\mathcal C\) has blocks with more than two legs: \(F(\mathcal C)\subseteq \{1,2\}\). Because , it is clear that \(\{1\}\subseteq F(\mathcal C)\). Thus, \(F(\mathcal C)=\{1,2\}\) has been proven.

  4. (d)

    It suffices to show \(\mathbb {N}\subseteq F(\mathcal C)\). Let \(n\in \mathbb {N}\) be arbitrary. Then,

    Thanks to we can, by Lemma 4.2 (c), connect the first n points in p to produce a partition in \(\mathcal C\) containing a block with n points, proving \(\{n\}\subseteq F(\mathcal C)\). \(\square \)

5 Step 2: Component V and its Relation to F and L

The next objective is to narrow down the range of the component V of Z over \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\). Given a non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), we show that the set

$$\begin{aligned} V(\mathcal C){:}{=}\{\sigma _p(B)\mid p\in \mathcal C,\, B\text { block of }p\} \end{aligned}$$

of block color sums occurring in \(\mathcal C\) can only be one of the five sets allowed as second components for tuples of \(\mathsf{Q}\) by Definition 2.5. Beyond that, we can use Proposition 4.3 to show a result about the three parameters \(V(\mathcal C)\), \(F(\mathcal C)\) and

$$\begin{aligned} L(\mathcal C){:}{=}\{\,\delta _p(\alpha _1,\alpha _2)\mid&\, p\in \mathcal C, \, B\text { block of }p,\, \alpha _1,\alpha _2\in B,\, \alpha _1\ne \alpha _2,\\&\, ]\alpha _1,\alpha _2[_p\cap B=\varnothing ,\, \sigma _p(\{\alpha _1,\alpha _2\})\ne 0\}, \end{aligned}$$

the set of color distances between legs of the same block with identical normalized colors appearing in \(\mathcal C\): Viewed together as \((F,V,L)(\mathcal C)\), they satisfy the conditions necessary for \(Z(\mathcal C)\) to be element of \(\mathsf{Q}\) by Definition 2.5.

Proposition 5.1

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a non-hyperoctahedral category.

  1. (a)

    The set \(V(\mathcal C)\) is given by \(\{0\}\), \(\pm \{0,2\}\), \(\pm \{0,1\}\), \(\pm \{0,1,2\}\) or \(\mathbb {Z}\).

  2. (b)

    If \(\mathcal C\) is case \(\mathcal O\), then

    $$\begin{aligned} V(\mathcal C)= {\left\{ \begin{array}{ll} \pm \{0,2\}&{}\text {if }L(\mathcal C)\ne \varnothing ,\\ \{0\}&{}\text {otherwise.} \end{array}\right. } \end{aligned}$$
  3. (c)

    If \(\mathcal C\) is case \(\mathcal B\), then

    $$\begin{aligned} V(\mathcal C)= {\left\{ \begin{array}{ll} \pm \{0,1,2\}&{}\text {if }L(\mathcal C)\ne \varnothing ,\\ \pm \{0,1\}&{}\text {otherwise.} \end{array}\right. } \end{aligned}$$
  4. (d)

    If \(\mathcal C\) is case \(\mathcal S\), then \(L(\mathcal C)\ne \varnothing \) and \(V(\mathcal C)=\mathbb {Z}\).

Proof

Two general facts about \(V(\mathcal C)\) in advance: In any case, \(0\in V(\mathcal C)\) since . And [5, Lemma 6.4], using the fact that \(p\in \mathcal C\) implies \(\tilde{p}\in \mathcal C\), showed \(V(\mathcal C)=-V(\mathcal C)\).

  1. (a)

    Claim (a) follows from the other three.

  2. (b)

    A pair block B in \(p\in \mathcal C\) satisfies \(\sigma _p(B)=0\) if and only if that block has no two (necessarily subsequent) legs of the same normalized colors. Otherwise it has color sum \(-2\) or 2.

  3. (c)

    And a singleton block always has color sums \(-1\) or 1. The rest follows from the proof of Part (b).

  4. (d)

    If \(\mathcal C\) is case \(\mathcal S\), then and . Hence, we can use to disconnect the left black point in by Lemma 4.1 (c) to obtain with \(V(\{p\})=\{-1, 1\}\). Given any \(n\in \mathbb {N}\), we use to connect in \(p^{\otimes n}\in \mathcal C\) all the n many three-leg blocks together (leaving the disconnected singletons alone) in accordance with Lemma 4.2 (c). That procedure results in the partition \(q\in \mathcal C\) with \(V(\{q\})=\{-1,n\}\). By \(V(\mathcal C)=-V(\mathcal C)\) it then follows \(V(\mathcal C)=\mathbb {Z}\) as claimed. \(\square \)

6 Step 3: Component \(\Sigma \) in Isolation

Easily, we can confirm that for all non-hyperoctahedral categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) the set

$$\begin{aligned} \Sigma (\mathcal C){:}{=}\{\Sigma (p)\mid p\in \mathcal C\} \end{aligned}$$

of all total color sums appearing in \(\mathcal C\) is within the range of allowed third entries of tuples in \(\mathsf{Q}\) by Definition 2.5. The following proposition contains a generalization of [6, Lemma 2.6] and [6, Proposition 2.7].

Proposition 6.1

For every category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) the set \(\Sigma (\mathcal C)\) is a subgroup of \(\mathbb {Z}\).

Proof

[5, Lemma 6.5 (c)] implies \(\Sigma (\mathcal C)+\Sigma (\mathcal C)\subseteq \Sigma (\mathcal C)\). And \(-\Sigma (\mathcal C)\subseteq \Sigma (\mathcal C)\) was shown in [5, Lemma 6.4]. As also and by definition, the set \(\Sigma (\mathcal C)\) is indeed a subgroup of \(\mathbb {Z}\). \(\square \)

7 Step 4: General Relations between \(\Sigma \), L, K and X

The goal remains proving that Z (see Definition 2.3) maps the set \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\) of non-hyperoctahedral categories to \(\mathsf{Q}\) (see Definition 2.5). So far, we have tackled this problem, more or less, one component of Z at a time. In that way, what we have managed to show is, mostly, that the values over \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\) of each of the three maps F, V and \(\Sigma \), viewed individually, are confined to the range of parameters allowed by \(\mathsf{Q}\) as corresponding entries of its elements. To complete this picture, we would also like to see that for any non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) the three sets \(L(\mathcal C)\),

$$\begin{aligned} K(\mathcal C){:}{=}\{\,\delta _p(\alpha _1,\alpha _2)\mid \,&p\in \mathcal C, \, B\text { block of }p,\, \alpha _1,\alpha _2\in B,\, \alpha _1\ne \alpha _2,\\&\, ]\alpha _1,\alpha _2[_p\cap B=\varnothing ,\, \sigma _p(\{\alpha _1,\alpha _2\})= 0\}\\ \text {and}\quad X(\mathcal C){:}{=}\{\,\delta _p(\alpha _1,\alpha _2) \mid \,&p\in \mathcal C,\, B_1,B_2\text { blocks of }p, \, B_1\text { crosses } B_2,\\&\, \alpha _1\in B_1,\,\alpha _2\in B_2\}, \end{aligned}$$

too, can only be of the kinds allowed as fourth, fifth and sixth components of tuples in \(\mathsf{Q}\), respectively, by Definition 2.5. However, due to the strong interdependences between these three components of Z, it is not even possible to prove this basic claim about the ranges of the individual maps by studying them one at a time. Instead, now, the reasonable thing to do is to consider the tuple \((\Sigma , L, K,X)\) and make inferences about its range over \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\). That will give us (see Proposition 7.23) the claim about the individual ranges of L, K and X but also many more of the relations between them (and \(\Sigma \)), which we need to verify the main result.

7.1 Abstract Arithmetic Lemma

As a first step, it is best to study the relationship between the \(\Sigma \)-, L-, K- and X-components of Z in an abstract context, merely talking about arbitrary subsets of \(\mathbb {Z}\) subject to certain axioms. Our goal for this subsection is to prove the Arithmetic Lemma (7.13): Assuming certain axioms (7.1), we may deduce a certain parameter range. We will show in Subsection 7.3 that for non-hyperoctahedral categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) our sets \(\Sigma (\mathcal C)\), \(L(\mathcal C)\), \(K(\mathcal C)\) and \(X(\mathcal C)\) satisfy these axioms. Recall \(\overline{\bullet }{:}{=}\circ \) and \(\overline{\circ }{:}{=}\bullet \).

Axioms 7.1

Let \(\sigma \) as well as \(\kappa _{c_1,c_2}\) and \(\xi _{c_1,c_2}\) for all \(c_1,c_2\in \{\circ ,\bullet \}\) be subsets of \(\mathbb {Z}\). Throughout this subsection, make the following assumptions:

  1. (i)

    \(\sigma \) is a subgroup of \(\mathbb {Z}\).

For all \((\omega _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}\in \{(\kappa _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}},(\xi _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}\}\) and for all \(c_1,c_2\in \{\circ ,\bullet \}\):

  1. (ii)

    \(\omega _{c_1,c_2}+\sigma \subseteq \omega _{c_1,c_2}\).

  2. (iii)

    \(\omega _{c_1,c_2}\subseteq - \omega _{\overline{c_2},\overline{c_1}}\).

  3. (iv)

    \(\omega _{c_1,c_2}\subseteq -\omega _{c_2,c_1}+\sigma \).

For all \(c_1,c_2,c_3\in \{\circ ,\bullet \}\):

  1. (v)

    \(\xi _{c_1,c_2}\subseteq \xi _{c_1,\overline{c_2}}\cup \left( -\xi _{c_2,\overline{c_1}}+\sigma \right) \).

  2. (vi)

    \(0\in \kappa _{\circ \bullet }\cap \kappa _{\bullet \circ }\).

  3. (vii)

    \(\kappa _{c_1,c_2}+\kappa _{\overline{c_2},c_3}\subseteq \kappa _{c_1,c_3}\).

  4. (viii)

    \(\kappa _{c_1,c_2}+\xi _{\overline{c_2},c_3}\subseteq \xi _{c_1,c_3}\).

Let us first study how much \(\kappa _{c_1,c_2}\) and \(\xi _{c_1,c_2}\) depend on \(c_1,c_2\in \{\circ ,\bullet \}\).

Lemma 7.2

For any \((\omega _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}\in \{(\kappa _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}},(\xi _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}\}\):

  1. (a)

    \(\omega _{\circ \circ }=\omega _{\bullet \bullet }\) and \(\omega _{\circ \circ }=-\omega _{\circ \circ }=\omega _{\circ \circ }+\sigma \).

  2. (b)

    \(\omega _{\circ \bullet }=\omega _{\bullet \circ }\) and \(\omega _{\circ \bullet }=-\omega _{\circ \bullet }=\omega _{\circ \bullet }+\sigma \).

Proof

Because \(0\in \sigma \) by Assumption (i), the Assumption (ii) actually means

$$\begin{aligned} \omega _{c_1,c_2}=\omega _{c_1,c_2}+\sigma \end{aligned}$$
(ii')

for all \(c_1,c_2\in \{\circ ,\bullet \}\). And with this new identity we can, for all \(c_1,c_2\in \{\circ ,\bullet \}\), refine Assumption (iv) to

$$\begin{aligned} \omega _{c_1,c_2}\subseteq -\omega _{c_2,c_1} \end{aligned}$$
(iv')

as \(-\omega _{c_2,c_1}+\sigma =-(\omega _{c_2,c_1}-\sigma )=-(\omega _{c_2,c_1}+ \sigma )=-\omega _{c_2,c_1}\) due to \(\sigma =-\sigma \).

  1. (a)

    Version (ii’) of Assumption (ii) yields \(\omega _{\circ \circ }=\omega _{\circ \circ }+\sigma \) as claimed. And Assumption (iv) in the form of (iv’) proves

    $$\begin{aligned} \omega _{\circ \circ }\overset{(iv)}{\subseteq }-\omega _{\circ \circ } \overset{(iv)}{\subseteq }\omega _{\circ \circ } \quad \text {and}\quad \omega _{\bullet \bullet }\overset{(iv)}{\subseteq }-\omega _{\bullet \bullet } \overset{(iv)}{\subseteq }\omega _{\bullet \bullet }, \end{aligned}$$

    thus verifying \(\omega _{\circ \circ }=-\omega _{\circ \circ }\) and \(\omega _{\bullet \bullet }=-\omega _{\bullet \bullet }\). Now, if we apply Assumption (iii) to conclude

    $$\begin{aligned} \omega _{\circ \circ }\overset{(iii)}{\subseteq }-\omega _{\bullet \bullet }\overset{(iii)}{\subseteq } \omega _{\circ \circ }, \end{aligned}$$

    we can infer \(\omega _{\circ \circ }=\omega _{\bullet \bullet }\). That proves the remainder of the claims about \(\omega _{\circ \circ }\) and \(\omega _{\bullet \bullet }\).

  2. (b)

    Here also, Version (ii’) of Assumption (ii) implies \(\omega _{\circ \bullet }=\omega _{\circ \bullet }+\sigma \). Now, though, for \(\omega _{\circ \bullet }\) and \(\omega _{\bullet \circ }\) the roles of Assumptions (iii) and (iv) reverse. First, we apply the former to conclude

    $$\begin{aligned} \omega _{\circ \bullet }\overset{(iii)}{\subseteq }-\omega _{\circ \bullet }\overset{(iii)}{\subseteq } \omega _{\circ \bullet }\quad \text {and}\quad \omega _{\bullet \circ }\overset{(iii)}{\subseteq }-\omega _{\bullet \circ }\overset{(iii)}{\subseteq } \omega _{\bullet \circ }, \end{aligned}$$

    which shows the claims \(\omega _{\circ \bullet }=-\omega _{\circ \bullet }\) and \(\omega _{\bullet \circ }=-\omega _{\bullet \circ }\). Then, it is the refined version (iv’) of Assumption (iv) that yields

    $$\begin{aligned} \omega _{\circ \bullet }\overset{(iv)}{\subseteq }-\omega _{\bullet \circ }\overset{(iv)}{\subseteq }\omega _{\circ \bullet }, \end{aligned}$$

    implying \(\omega _{\circ \bullet }=\omega _{\bullet \circ }\) and thus completing the proof. \(\square \)

In the case of \((\omega _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}=(\xi _{c_1,c_2})_{c_1,c_2\in \{\circ ,\bullet \}}\) of Lemma 7.2 we can go even further and combine the objects of Parts (a) and (b).

Lemma 7.3

\(\xi _{\circ \circ }=\xi _{\circ \bullet }\).

Proof

Since \(\xi _{c_2,\overline{c_1}}=\xi _{c_2,\overline{c_1}}+\sigma \) for all \(c_1,c_2\in \{\circ ,\bullet \}\) by Version (ii’) of Axiom (ii), our Assumption (v) actually spells

$$\begin{aligned} \xi _{c_1,c_2}\subseteq \xi _{c_1,\overline{c_2}}\cup (-\xi _{c_2,\overline{c_1}}) \end{aligned}$$
(v')

for all \(c_1,c_2\in \{\circ ,\bullet \}\) as \(\sigma =- \sigma \). Using this version of the assumption twice, we conclude

$$\begin{aligned} \xi _{\circ \circ }\overset{(v)}{\subseteq }\xi _{\circ \bullet }\cup (-\xi _{\circ \bullet })=\xi _{\circ \bullet }\overset{(v)}{\subseteq }\xi _{\circ \circ }\cup (-\xi _{\bullet \bullet })=\xi _{\circ \circ }, \end{aligned}$$

where we have used the results \(\xi _{\circ \bullet }=-\xi _{\circ \bullet }\) and \(\xi _{\circ \circ }=-\xi _{\bullet \bullet }\) of Lemma 7.2. It follows that indeed \(\xi _{\circ \circ }=\xi _{\circ \bullet }\). \(\square \)

Definition 7.4

Write \(\lambda {:}{=}\kappa _{\circ \circ }=\kappa _{\bullet \bullet }\) and \(\kappa {:}{=}\kappa _{\circ \bullet }=\kappa _{\bullet \circ }\) and \(\xi {:}{=}\xi _{\circ \circ }=\xi _{\bullet \bullet }=\xi _{\circ \bullet }=\xi _{\bullet \circ }\).

Our next step is to show that the pair \((\lambda ,\kappa )\) is of a very simple form (Lemma 7.7).

Definition 7.5

Define the non-negative integers

$$\begin{aligned} d{:}{=}{\left\{ \begin{array}{ll} \min \left( \kappa \cap \mathbb {N}\right) &{}\text {if }\kappa \cap \mathbb {N}\ne \varnothing ,\\ 0&{}\text {otherwise}, \end{array}\right. } \quad \text {and}\quad l{:}{=}{\left\{ \begin{array}{ll} \min \left( \lambda \cap \mathbb {N}\right) &{}\text {if }\lambda \cap \mathbb {N}\ne \varnothing ,\\ 0&{}\text {otherwise}. \end{array}\right. } \end{aligned}$$

Lemma 7.6

  1. (a)

    \(\kappa =d\mathbb {Z}\).

  2. (b)

    If \(\lambda \ne \varnothing \), then \(l\in \lambda \) and \(\lambda -l\supseteq \kappa \).

  3. (c)

    \(\lambda -l\subseteq \kappa \).

  4. (d)

    If \(\lambda \ne \varnothing \) and \(d\ne 0\), then \(l\le d\).

  5. (e)

    If \(\lambda \ne \varnothing \) and \(d\ne 0\), then \(l\ne 0\).

  6. (f)

    If \(\lambda \ne \varnothing \), then \(2l\mathbb {Z}\subseteq d\mathbb {Z}\).

  7. (g)

    If \(\lambda \ne \varnothing \), then \(d=l\) or \(d=2l\).

Proof

  1. (a)

    Of course, \(0\in \kappa \) by Assumption (vi). And \(-\kappa = \kappa \) was established in Lemma 7.2 (b). And with the choices \(c_1=\circ \), \(c_2=c_3=\bullet \), Assumption (vii) implies that

    $$\begin{aligned} \kappa +\kappa =\kappa _{\circ \bullet }+\kappa _{\circ \bullet }\overset{(vii)}{\subseteq } \kappa _{\circ \bullet }=\kappa . \end{aligned}$$

    Hence, \(\kappa \) is indeed a subgroup of \(\mathbb {Z}\). The definition of d makes d a generator of \(\kappa \), implying \(\kappa =d\mathbb {Z}\).

  2. (b)

    As \(\lambda =-\lambda \) by Lemma 7.2 (a), assuming \(\lambda \ne \varnothing \) ensures \(\lambda \cap (\{0\}\cup \mathbb {N})\ne \varnothing \). Hence, under this assumption, \(l\in \lambda \) by definition of l. If we choose \(c_1=c_3=\circ \) and \(c_2=\bullet \) in Assumption (vii), it follows that

    $$\begin{aligned} \kappa +\lambda =\kappa _{\circ \bullet }+\kappa _{\circ \circ }\overset{(vii)}{\subseteq } \kappa _{\circ \circ }=\lambda . \end{aligned}$$

    Since \(l\in \lambda \), we can specialize the \(\lambda \) on the left hand side of that inclusion to l and then subtract l on both sides. We obtain \(\kappa \subseteq \lambda -l\).

  3. (c)

    If \(\lambda = \varnothing \), there is nothing to prove. Hence, let \(\lambda \ne \varnothing \), implying \(l\in \lambda \) by Part (b). Using Assumption (vii) once more, this time with the choices \(c_1=c_2=\circ \) and \(c_3=\bullet \), yields

    $$\begin{aligned} \lambda -\lambda =\lambda +\lambda =\kappa _{\circ \circ }+\kappa _{\bullet \bullet }\overset{(vii)}{\subseteq } \kappa _{\circ \bullet }=\kappa , \end{aligned}$$

    where we have used \(\lambda =-\lambda \) (Lemma 7.2 (a)) in the first step. Specializing on the left hand side the second instance of \(\lambda \) to l yields \(\lambda -l\subseteq \kappa \).

  4. (d)

    Actually, we show the contraposition. Hence, suppose \(\lambda \ne \varnothing \) and \(l>d\). Since \(\lambda =l+d\mathbb {Z}\) by Parts (a)–(c), it then follows that \(l-d\in \lambda \cap \mathbb {N}\). The definition of l consequently requires \(l\le l-d\), i.e. \(d\le 0\). As \(d\ge 0\) by definition, \(d=0\) is the only possibility.

  5. (e)

    We prove the contraposition indirectly. As \(\lambda =l+d\mathbb {Z}\) by Parts (a)–(c), supposing \(l=0\) entails \(\lambda =d\mathbb {Z}\). Thus, if \(d\ne 0\) were true, then \(\varnothing \ne d\mathbb {Z}\cap \mathbb {N}= \lambda \cap \mathbb {N}\) would yield the contradiction \(0<\min (\lambda \cap \mathbb {N})=l=0\) by definition of l.

  6. (f)

    In the proof of Part (c) we saw \(\lambda +\lambda \subseteq \kappa \). Specializing therein both instances of \(\lambda \) on the left hand side to l (which we can do due to \(\lambda \ne \varnothing \) by Part (b)) yields \(2l\in \kappa =d\mathbb {Z}\). It follows \(2l\mathbb {Z}\subseteq d\mathbb {Z}\) as asserted.

  7. (g)

    From \(2l\mathbb {Z}\subseteq d\mathbb {Z}\), as shown in Part (f), it is immediate that, if \(d=0\), then \(l=0=d\) as claimed. If \(d\ne 0\), we know, firstly, \(l\le d\) by Part (d), secondly, \(l\ne 0\) by Part (e) and, thirdly, \(2l\mathbb {Z}\subseteq d\mathbb {Z}\) by Part (f). That is only possible if \(d=l\) or \(d=2l\): Indeed, if \(c\in \mathbb {Z}\) is such that \(2l=cd\), then \(l> 0\) and \(d\ge 0\) ensure \(c> 0\). Moreover, \(l\le d\) implies \(2l\le 2d\), i.e., \(cd\le 2d\). We infer \(c\le 2\) by \(d> 0\). Hence, \(c\in \{1,2\}\) by \(c>0\). \(\square \)

Lemma 7.7

  1. (a)

    If \(\lambda =\varnothing \), then \((\lambda ,\kappa )=(\varnothing ,d\mathbb {Z})\).

  2. (b)

    If \(\lambda \ne \varnothing \), then \((\lambda ,\kappa )\) is equal to \((l+2l\mathbb {Z},2l\mathbb {Z})\) or \((l\mathbb {Z},l\mathbb {Z})\).

Proof

In Lemma 7.6 we established that \(\kappa =d\mathbb {Z}\) (Part (a)) and that \(\lambda =\varnothing \) or \(\lambda =l+d\mathbb {Z}\) (Parts (b) and (c)), where \(d=l\) or \(d=2l\) (Part (g)). In other words, we have proven that \((\lambda ,\kappa )\) is of the asserted form. \(\square \)

We can immediately relate \(\sigma \) to \(\kappa \).

Definition 7.8

Define

$$\begin{aligned} k{:}{=}{\left\{ \begin{array}{ll} \min \left( \sigma \cap \mathbb {N}\right) &{}\text {if }\sigma \cap \mathbb {N}\ne \varnothing ,\\ 0&{}\text {otherwise}. \end{array}\right. } \end{aligned}$$

Lemma 7.9

\(\sigma =k\mathbb {Z}\subseteq d\mathbb {Z}=\kappa \).

Proof

Because \(\sigma \) is a subgroup of \(\mathbb {Z}\), the definition of k implies \(\sigma =k\mathbb {Z}\). Moreover, we know \(\kappa =\kappa +\sigma \) by Lemma 7.2 (b). Hence Assumption (vi), namely \(0\in \kappa \), implies \(k\mathbb {Z}=\sigma \subseteq \kappa +\sigma \subseteq \kappa =d\mathbb {Z}\). \(\square \)

Let us now turn to the description of \(\xi \).

Lemma 7.10

  1. (a)

    \(\xi =\xi +d\mathbb {Z}\).

  2. (b)

    If \(\lambda \ne \varnothing \), then \(\xi =\xi +l\mathbb {Z}\).

Proof

  1. (a)

    Picking \(c_1=\circ \), \(c_2=c_3=\bullet \), Assumption (viii) implies the inclusion

    $$\begin{aligned} \kappa +\xi =\kappa _{\circ \bullet }+\xi _{\circ \bullet }\overset{(viii)}{\subseteq }\xi _{\circ \bullet }=\xi . \end{aligned}$$

    As the reverse inclusion is trivially true by \(0\in \kappa \) (Assumption (vi)), we have thus verified our claim \(\xi =\xi +d\mathbb {Z}\) by Lemma 7.6 (a).

  2. (b)

    Assumption (viii), applied a second time, now with \(c_1=c_2=c_3=\circ \), allows us to conclude

    $$\begin{aligned} \lambda +\xi =\kappa _{\circ \circ }+\xi _{\bullet \circ }\overset{(viii)}{\subseteq } \xi _{\circ \circ }=\xi . \end{aligned}$$

    If \(\lambda \ne \varnothing \), then \(l\in \lambda \) by Lemma 7.6 (b). Hence, the above inclusion shows in particular \(\xi +l\subseteq \xi \). Using this, induction proves \(\xi +l\mathbb {N}\subseteq \xi \). Lemma 7.6 (g) established that \(d=l\) or \(d=2l\). Either way, \(\xi =\xi +d\mathbb {Z}\), as seen in Part (a), then ensures \(\xi -2l\subseteq \xi \). Combining this conclusion with \(\xi +l\subseteq \xi \) lets us infer \(\xi -l=(\xi +l)-2l\subseteq \xi \). Again, it follows \(\xi -l\mathbb {N}\subseteq \xi \) by induction. Hence, altogether we have shown \(\xi +l\mathbb {Z}=(\xi -l\mathbb {N})\cup \xi \cup (\xi +l\mathbb {N})\subseteq \xi \). Of course, the converse inclusion is true as well because \(0\in \mathbb {Z}\), proving \(\xi =\xi +l\mathbb {Z}\) as claimed. \(\square \)

In order to obtain a refined understanding of \(\xi \) we need the following preparatory lemma.

Lemma 7.11

Let \(\chi \subseteq \mathbb {Z}\) and \(m\in \mathbb {N}\) satisfy \(\chi =-\chi =\chi +m\mathbb {Z}\).

  1. (a)

    .

  2. (b)

    .

  3. (c)

    .

  4. (d)

    .

Proof

The mapping \(S\mapsto S_m{:}{=}(S\cup (m-S))+m\mathbb {Z}\) of subsets \(S\subseteq \mathbb {Z}\) is a closure operator with respect to \(\subseteq \), i.e., for all \(S,T\subseteq \mathbb {Z}\) with \(S\subseteq T\) we have \(S\subseteq S_m\) and \(S_m\subseteq T_m\) and \((S_m)_m=S_m\). In particular \(S=S_m\) if and only if \(S=-S=S+m\mathbb {Z}\).

  1. (a)

    The assumption \(\chi =-\chi =\chi +m\mathbb {Z}\) implies \(\chi =\chi _m\). Hence, is clear by monotonicity of \(S\mapsto S_m\). We show the converse: If \(x\in \chi \), we find such that \(x'-x\in m\mathbb {Z}\). Consequently, \(x'\in x+m\mathbb {Z}\subseteq \chi +m\mathbb {Z}\subseteq \chi \) by assumption. We conclude , which is what we needed to show.

  2. (b)

    We further deduce from \(\chi =-\chi =\chi +m\mathbb {Z}\) that \(m-\chi \subseteq \chi \). Naturally, . Combining this with yields . We conclude , which proves one inclusion.

    Now, the converse. From \(\chi =-\chi =\chi +m\mathbb {Z}\) we can infer \(m-\chi =-(m-\chi )=(m-\chi )+m\mathbb {Z}\). In consequence we can apply the inclusion we just proved to the set \(m-\chi \) in the role of \(\chi \). Since , the resulting inclusion actually spells . That is just what we had to show.

  3. (c)

    Due to the monotonicity and idempotency of the mapping \(S\mapsto S_m\), it suffices by Part (a) to prove . Let be arbitrary. If \(x\le \lfloor \frac{m}{2}\rfloor \), then, naturally, . Hence, we can assume \(x>\lfloor \frac{m}{2}\rfloor \). By Part (b) we know \(m-x\in \chi \). By assumption, \(m-x<m-\lfloor \frac{m}{2}\rfloor \). If m is even, then this inequality says \(m-x<m-\frac{m}{2}=\frac{m}{2}=\lfloor \frac{m}{2}\rfloor \). Should m be odd instead, it means \(m-x<m-\frac{m-1}{2}=\frac{m+1}{2}\), which implies \(m-x\le \frac{m+1}{2}-1=\frac{m-1}{2}=\lfloor \frac{m}{2}\rfloor \). Thus, \(m-x\le \lfloor \frac{m}{2}\rfloor \) in all cases. Hence we have shown . It follows . That is what we needed to see.

  4. (d)

    The assumption \(\chi =-\chi =\chi +m\mathbb {Z}\) implies . Hence, we can apply Part (c) to the set \(\mathbb {Z}\backslash \chi \) in the role of \(\chi \) and obtain . Since we have shown \(\mathbb {Z}\backslash \chi =D_m\). It follows \(\chi =\mathbb {Z}\backslash D_m\) as claimed. \(\square \)

Lemma 7.12

  1. (a)

    If \(d=0\), then \(\xi =\mathbb {Z}\backslash E_0\) for \(E=(\{0\}\cup \mathbb {N})\backslash \xi \).

  2. (b)

    If \(d\ge 1\) and \(\lambda \ne \varnothing \), then \(\xi =\mathbb {Z}\backslash D_l\) for .

  3. (c)

    If \(d\ge 1\) and \(\lambda = \varnothing \), then for .

Proof

  1. (a)

    The defining equations \(E=(\{0\}\cup \mathbb {N})\backslash \xi \) and \(E_0=E\cup (-E)\) imply \(E_0=((\{0\}\cup \mathbb {N}) \backslash \xi )\cup ((-(\{0\}\cup \mathbb {N}))\backslash (-\xi ))\). Hence, \(\xi =-\xi \) (by Lemma 7.2) shows \(E_0=\mathbb {Z}\backslash \xi \) and thus the claim \(\xi =\mathbb {Z}\backslash E_0\).

  2. (b)

    Because \(\lambda \ne \varnothing \), Lemma 7.6 (g) guarantees \(d=l\) or \(d=2l\). Hence, the assumption \(d\ge 1\) implies \(l\ge 1\). Moreover, Lemma 7.10 (b) assures us that \(\xi =\xi +l\mathbb {Z}\). And, we already know \(\xi =-\xi \) by Lemma 7.2. Hence, Lemma 7.11 (d) yields the claim.

  3. (c)

    Still, \(\xi =-\xi \), of course. And \(\xi =\xi +d\mathbb {Z}\) by Lemma 7.10 (a) as \(d\ge 1\). Thus, once more, Lemma 7.11 (d) proves the claim. \(\square \)

In conclusion we have shown the following auxiliary result.

Lemma 7.13

(Arithmetic Lemma). If the nine sets of integers \(\sigma \) and \(\kappa _{c_1,c_2}\), \(\xi _{c_1,c_2}\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axioms 7.1, then

$$\begin{aligned} \kappa _{\circ \circ }=\kappa _{\bullet \bullet }=:\lambda ,\quad \kappa _{\circ \bullet }=\kappa _{\bullet \circ }=:\kappa \quad \text {and}\quad \xi _{\circ \circ }=\xi _{\bullet \bullet }=\xi _{\circ \bullet }=\xi _{\bullet \circ }=:\xi \end{aligned}$$

and there exist \(u\in \{0\}\cup \mathbb {N}\), \(m\in \mathbb {N}\), and \(E\subseteq \{0\}\cup \mathbb {N}\) such that the tuple \((\sigma ,\lambda ,\kappa ,\xi )\) is given by one of the following:

Proof

That \(\lambda \), \(\kappa \) and \(\xi \) are well-defined was shown in Lemmata 7.2 and 7.3. Hence, we can let k, d and l be as in Definitions 7.8 and 7.5. We distinguish five cases in total.

Case 1: First, suppose that \(\lambda =\varnothing \). Then, \(\kappa =d\mathbb {Z}\). By Lemma 7.7 (a). There are now two possibilities depending on the value of \(d\in \{0\}\cup \mathbb {N}\).

Case 1.1: If \(d=0\), which is to say \(\kappa =\{0\}\), then Lemma 7.12 (a) yields \(\xi =\mathbb {Z}\backslash E_0\) for \(E{:}{=}(\{0\}\cup \mathbb {N})\backslash \xi \). And Lemma 7.9 proves \(\sigma =k\mathbb {Z}\subseteq d\mathbb {Z}=\{0\}\), implying \(k=0\) and thus \(\sigma =\{0\}\). As, naturally, \(E\subseteq \{0\}\cup \mathbb {N}\), the tuple \((\sigma ,\lambda ,\kappa ,\xi )\) is indeed as claimed in the fifth row of the table.

Case 1.2: Should \(d\ge 1\) on the other hand, then by Lemma 7.12 (c) we infer \(\xi =\mathbb {Z}\backslash D_d\) for . Since \(\sigma =k\mathbb {Z}\subseteq d\mathbb {Z}\) by Lemma 7.9, if we put \(u{:}{=}\frac{k}{d}\), then \(\sigma =ud\mathbb {Z}\). Recognizing and defining \(m{:}{=}d\) thus proves that \((\sigma ,\lambda ,\kappa ,\xi )\) is as asserted by the third row of the table.

Case 2: Now, let \(\lambda \ne \varnothing \) instead. Then, \((\lambda ,\kappa )=(l+2l\mathbb {Z},2l\mathbb {Z})\) or \((\lambda ,\kappa )=(l\mathbb {Z},l\mathbb {Z})\) by Lemma 7.7 (a). Respectively, \(d=2l\) or \(d=l\). We now distinguish two cases based on the value of \(l\in \{0\}\cup \mathbb {N}\).

Case 2.1: Assuming \(l=0\) lets us conclude \(l\mathbb {Z}=2l\mathbb {Z}=l+2l\mathbb {Z}=\{0\}\), which implies \((\lambda ,\kappa )=(\{0\},\{0\})\). Lemma 7.9 gives \(\sigma =k\mathbb {Z}\subseteq \kappa =\{0\}\) and thus \(k=0\) and \(\sigma =\{0\}\). Because \(d=l=2l=0\) we can infer \(\xi =\mathbb {Z}\backslash E_0\) for \(E{:}{=}(\{0\}\cup \mathbb {N})\backslash \xi \) by Lemma 7.12 (a). As \(E\subseteq \{0\}\cup \mathbb {N}\), the tuple \((\sigma ,\lambda ,\kappa ,\xi )\) is hence given by the fourth row of the table.

Case 2.2: Finally, let \(l\ge 0\). Then, also \(d\ge 0\), no matter whether \(d=l\) or \(d=2l\). In conclusion, \(\xi =\mathbb {Z}\backslash D_l\) for by Lemma 7.12 (c).

Case 2.2.1: If \((\lambda ,\kappa )=(l+2l\mathbb {Z},2l\mathbb {Z})\), i.e., \(d=2l\), then the implication \(\sigma =k\mathbb {Z}\subseteq d\mathbb {Z}=2l\mathbb {Z}\) of Lemma 7.9 lets us define \(u\in \{0\}\cup \mathbb {N}\) by \(u{:}{=}\frac{k}{2l}\) and obtain \(\sigma =2ul\mathbb {Z}\). Hence, choosing \(m{:}{=}l\) proves that \((\sigma ,\lambda ,\kappa ,\xi )\) fits the second row of the table.

Case 2.2.2: If instead, \((\lambda ,\kappa )=(l\mathbb {Z},l\mathbb {Z})\), i.e., \(d=l\), then Lemma 7.9 yields \(\sigma =k\mathbb {Z}\subseteq d\mathbb {Z}=l\mathbb {Z}\), thus permitting us to define \(u\in \{0\}\cup \mathbb {N}\) by \(u{:}{=}\frac{k}{l}\) and obtain \(\sigma =ul\mathbb {Z}\). The choice \(m{:}{=}l\) hence shows \((\sigma ,\lambda ,\kappa ,\xi )\) to be given by the first row. \(\square \)

As mentioned before, our goal will be to show (Section 7.3) that for every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) the tuple \((\Sigma ,L,K,X)(\mathcal C)\) is of the form given in the table of the Arithmetic Lemma.

7.2 Reduction to Singleton and Pair Blocks

Let us return to categories of partitions. To elucidate the ranges of K, L and X over \(\mathsf{PCat}^{\circ \bullet }_{\mathrm{NHO}}\) and central relations between \(\Sigma (\mathcal C)\), \(K(\mathcal C)\), \(L(\mathcal C)\) and \(X(\mathcal C)\) for non-hyperoctahedral categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), we must consider certain decompositions of K, L and X according to leg colors.

Definition 7.14

Let \(\mathcal S\subseteq \mathcal {P}^{\circ \bullet }\) and \(c_1,c_2\in \{\circ ,\bullet \}\) be abitrary. Then, define

$$\begin{aligned} K_{c_1,c_2}(\mathcal S){:}{=}\{\,\delta _p(\alpha _1,\alpha _2)\mid&\;p\in \mathcal S, \, B\text { block of }p,\, \alpha _1,\alpha _2\in B,\, \alpha _1\ne \alpha _2,\nonumber \\&\; ]\alpha _1,\alpha _2[_p\cap B=\varnothing ,\, \forall i=1,2: \alpha _i\text { of normalized color }c_i\}, \end{aligned}$$
(a)
$$\begin{aligned} X_{c_1,c_2}(\mathcal S){:}{=}\{\,\delta _p(\alpha _1,\alpha _2) \mid&\; p\in \mathcal S,\, B_1,B_2\text { blocks of }p,\, B_1 \text { and }B_2 \text { cross}, \nonumber \\&\; \alpha _1\in B_1,\,\alpha _2\in B_2,\, \forall i=1,2: \alpha _i\text { of normalized color }c_i\}. \end{aligned}$$
(b)

L, K and X can then be written as, where the union occurs pointwise,

$$\begin{aligned} L=\bigcup _{\begin{array}{c} c_1,c_2\in \{\circ ,\bullet \}\\ c_1= c_2 \end{array}} K_{c_1,c_2},\quad K=\bigcup _{\begin{array}{c} c_1,c_2\in \{\circ ,\bullet \}\\ c_1\ne c_2 \end{array}} K_{c_1,c_2},\quad \text {and}\quad X=\bigcup _{c_1,c_2\in \{\circ ,\bullet \}}X_{c_1,c_2}. \end{aligned}$$

Recall that \(\mathcal {P}^{\circ \bullet }_{\le 2}\) denotes the set of all partitions with block sizes one or two and that it is a category (see [5, Lemma 4.4 (a)]). By the next lemma we may always restrict to partitions in \(\mathcal {P}^{\circ \bullet }_{\le 2}\) when studying \(K_{c_1,c_2}\) and \(X_{c_1,c_2}\). This is trivial in cases \(\mathcal O\) and \(\mathcal B\), while for case \(\mathcal S\) this basically follows from Lemma 4.1(c).

Lemma 7.15

For all non-hyperoctahedral categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) and \(c_1,c_2\in \{\circ ,\bullet \}\):

  1. (a)

    \(K_{c_1,c_2}(\mathcal C)=K_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\).

  2. (b)

    \(X_{c_1,c_2}(\mathcal C)=X_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\).

Proof

  1. (a)

    If \(\mathcal C\) is case \(\mathcal O\) or case \(\mathcal B\), i.e., if \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }_{\le 2}\) by Proposition 4.3, there is nothing to show. Hence, suppose that \(\mathcal C\) is case \(\mathcal S\) and let \(c_1,c_2\in \{\circ ,\bullet \}\). We only need to prove \(K_{c_1,c_2}(\mathcal C)\subseteq K_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\). Let \(\alpha _1\) and \(\alpha _2\) with \(\alpha _1\ne \alpha _2\) be points in \(p\in \mathcal C\) such that \(\alpha _i\) is of normalized color \(c_i\) for every \(i\in \{1,2\}\) and such that \(\alpha _1,\alpha _2\in B\) and \(]\alpha _1,\alpha _2[_p\cap B=\varnothing \) for some block B in p. Because \(\mathcal C\) is case \(\mathcal S\), by Lemma 4.1 (c) we do not violate the assumption \(p\in \mathcal C\) by assuming that every block other than B is a singleton. In the same way we can assume that \(\alpha _1\) and \(\alpha _2\) are the only legs of B. None of these assumptions affect \(\delta _p(\alpha _1,\alpha _2)\) or the normalized colors of \(\alpha _1\) or \(\alpha _2\). As they ensure \(p\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2}\) though, we have shown \(\delta _p(\alpha _1,\alpha _2)\in K_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\), which is what we needed to see.

  2. (b)

    Again, all that we need to prove is that \(X_{c_1,c_2}(\mathcal C)\subseteq X_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\) if \(\mathcal C\) is case \(\mathcal S\) and if \(c_1,c_2\in \{\circ ,\bullet \}\). Let the points \(\alpha _1\) of normalized color \(c_1\) and \(\alpha _2\) of normalized color \(c_2\) in \(p\in \mathcal C\) belong to the blocks \(B_1\) and \(B_2\), respectively, and suppose that \(B_1\) and \(B_2\) cross. Because \(\mathcal C\) is case \(\mathcal S\) we can, by Lemma 4.1 (c), assume that all other blocks of p besides \(B_1\) and \(B_2\) are singletons. Now the only thing standing in the way of \(p\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2}\) is the possibility of at least one of \(B_1\) and \(B_2\) having more than two legs. We would like to assume that \(B_1\) and \(B_2\) have only two legs each and still maintain all the other assumptions including \(\alpha _1\in B_1\) and \(\alpha _2\in B_2\) and, of course, not alter \(\delta _p(\alpha _1,\alpha _2)\). By Lemma 4.1 (c), we can always remove surplus legs of \(B_1\) and \(B_2\). But it is not immediately clear that we can remove legs without affecting the other assumptions. A priori, the crossing between \(B_1\) and \(B_2\) only implies that we can find points \(\beta _1,\gamma _1\in B_1\) and \(\beta _2,\gamma _2\in B_2\) such that \((\beta _1,\beta _2,\gamma _1,\gamma _2)\) is ordered in p. If now \(\alpha _1\in \{\beta _1,\gamma _1\}\) and \(\alpha _2\in \{\beta _2,\gamma _2\}\), then we can certainly remove all legs except \(\{\beta _i,\gamma _i\}\) from \(B_i\) for all \(i\in \{1,2\}\) and still maintain the other assumptions. In fact, we can do so in general as well:

    Let us only consider the “worst case” that \(\alpha _1\notin \{\beta _1,\gamma _1\}\) and \(\alpha _2\notin \{\beta _2,\gamma _2\}\). There are 20 possible arrangements of the points \(\{\alpha _1,\beta _1,\gamma _1,\alpha _2,\beta _2,\gamma _2\}\) relative to each other with respect to the cyclic order respecting that \((\beta _1,\beta _2,\gamma _1,\gamma _2)\) is ordered.

    We remove all legs of \(B_1\) and \(B_2\) except for the underlined ones. Then the above table shows that we can always turn \(B_1\) and \(B_2\) into crossing pair blocks containing \(\alpha _1\) and \(\alpha _2\), respectively. That concludes the proof. \(\square \)

7.3 Verifying the Axioms

We want to apply the Arithmetic Lemma 7.13 to the sets \(\sigma {:}{=}\Sigma (\mathcal C)\), \(\kappa _{c_1,c_2}{:}{=}K_{c_1,c_2}(\mathcal C)\) and \(\xi _{c_1,c_2}{:}{=}X_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) and non-hyperoctahedral categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\). In order to be able to do so, we, of course, need to show that these sets actually satisfy the prerequisite Axioms 7.1. Proving that will crucially utilize the reduction to singleton and pair blocks from Lemma 7.15.

Lemma 7.16

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the set \(\sigma {:}{=}\Sigma (\mathcal C)\) satisfies Axiom (i) of 7.1: \(\sigma \) is a subgroup of \(\mathbb {Z}\).

Proof

That was shown in Proposition 6.1. \(\square \)

Lemma 7.17

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\kappa _{c_1,c_2}{:}{=}K_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axioms (ii)–(iv) of 7.1:

for all \(c_1,c_2\in \{\circ ,\bullet \}\).

Proof

Let \(c_1,c_2\in \{\circ ,\bullet \}\) be arbitrary and let \(\alpha _1\) and \(\alpha _2\) be distinct points of the same block B in \(p\in \mathcal C\) such that \(]\alpha _1,\alpha _2[_p\cap B=\varnothing \) and such that \(\alpha _i\) has normalized color \(c_i\) for every \(i\in \{1,2\}\). In other words, let \(\delta _{p}(\alpha _1,\alpha _2)\) be a generic element of \(K_{c_1,c_2}(\mathcal C)=\kappa _{c_1,c_2}\).

Axiom (ii): Let \(q\in \mathcal C\) be arbitrary. None of the assumptions about p, \(\alpha _1\), \(\alpha _2\) and \(\delta _p(\alpha _2,\alpha _2)\) are impacted by assuming that p is rotated in such a way that \(\alpha _1\) is the rightmost lower point of p. Then, B is a block of \(p\otimes q\in \mathcal C\) as well and \(]\alpha _1,\alpha _2[_{p\otimes q}\cap B=\varnothing \).

figure c

Now, because all points stemming from q lie within \(]\alpha _1,\alpha _2[_{p\otimes q}\),

$$\delta _{p\otimes q}(\alpha _1,\alpha _2)=\delta _p(\alpha _1,\alpha _2)+\Sigma (q).$$

That proves \(\delta _{p}(\alpha _1,\alpha _2)+\Sigma (q)\in K_{c_1,c_2}(\mathcal C)=\kappa _{c_1,c_2}\), which is what we needed to see.

Axiom (iii): The verticolor reflection \(\tilde{p}\) of p belongs to \(\mathcal C\). The set \(]\alpha _1,\alpha _2]_p\) in p is mapped by the reflection \(\rho \) to the set \([\rho (\alpha _2),\rho (\alpha _1)[_{\tilde{p}}\) in \(\tilde{p}\). As the operation of verticolor reflection inverts normalized colors, \(\sigma _{p}(S)=-\sigma _{\tilde{p}}(\rho (S))\) for any set S of points in p.

figure d

Using the case distinction free formula for \(\delta _p(\alpha _1,\alpha _2)\) given in the proof of [5, Lemma 3.1 (b)], we thus compute

$$\begin{aligned} \delta _{p}(\alpha _1,\alpha _2)&=\sigma _{p}(]\alpha _1,\alpha _2]_{ p})+{\textstyle \frac{1}{2}}(\sigma _{ p}(\alpha _1)-\sigma _{p}(\alpha _2)) \\&=-\sigma _{\tilde{p}}([\rho (\alpha _2),\rho (\alpha _1)[_{\tilde{p}})-{\textstyle \frac{1}{2}}(\sigma _{\tilde{p}}(\rho (\alpha _1))-\sigma _{\tilde{p}}(\rho (\alpha _2))) \\&=-\sigma _{\tilde{p}}(]\rho (\alpha _2),\rho (\alpha _1)]_{\tilde{p}})-\sigma _{\tilde{p}}(\rho (\alpha _2))+\sigma _{\tilde{p}}(\rho (\alpha _1)) \\&\quad -{\textstyle \frac{1}{2}}(\sigma _{\tilde{p}}(\rho (\alpha _1))-\sigma _{\tilde{p}}(\rho (\alpha _2))) \\&=-\sigma _{\tilde{p}}(]\rho (\alpha _2),\rho (\alpha _1)]_{\tilde{p}})-{\textstyle \frac{1}{2}}(\sigma _{\tilde{p}}(\rho (\alpha _2))-\sigma _{\tilde{p}}(\rho (\alpha _1))) \\&=-\delta _{\tilde{p}}(\rho (\alpha _2),\rho (\alpha _1)). \end{aligned}$$

Because, for every \(i\in \{1,2\}\), the point \(\rho (\alpha _i)\) has normalized color \(\overline{c_i}\) in \(\tilde{p}\) and because \(\rho (B)\) is a block of \(\tilde{p}\) with \(]\rho (\alpha _2),\rho (\alpha _1)[_{\tilde{p}}\cap \rho (B)=\varnothing \), we conclude \(\delta _p(\alpha _1,\alpha _2)\in -K_{\overline{c_2},\overline{c_1}}(\mathcal C)=-\kappa _{\overline{c_2},\overline{c_1}}\). And that is what we had to show.

Axiom (iv): So far, we have not made use of Lemma 7.15. Now, though, we employ it to additionally assume \(p\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2}\). In particular, then, \(B= \{\alpha _1,\alpha _2\}\) is a pair block. Consequently, not only \(]\alpha _1,\alpha _2[_p\cap B=\varnothing \) but also \(]\alpha _2,\alpha _1[_p\cap B=\varnothing \).

figure e

By [5, Lemma 2.1 (b)] we infer

$$\begin{aligned} \delta _p(\alpha _1,\alpha _2)= -\delta _{p}(\alpha _2,\alpha _1)\mod \Sigma (p). \end{aligned}$$

As \(\Sigma (p)\in \Sigma (\mathcal C)\), it follows \(\delta _p(\alpha _1,\alpha _2)\in -K_{c_2,c_1}(\mathcal C)+\Sigma (\mathcal C)=-\kappa _{c_2,c_1}+\sigma \), which is what we wanted to see. \(\square \)

Lemma 7.18

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\xi _{c_1,c_2}{:}{=}X_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axioms (ii)–(iv) of 7.1:

for all \(c_1,c_2\in \{\circ ,\bullet \}\).

Proof

The proof is similar to that of Lemma 7.17. Let \(c_1,c_2\in \{\circ ,\bullet \}\), let \(B_1\) and \(B_2\) be crossing blocks of \(p\in \mathcal C\) and let \(\alpha _1\in B_1\) and \(\alpha _2\in B_2\) have normalized colors \(c_1\) and \(c_2\), respectively. That makes \(\delta _{p}(\alpha _1,\alpha _2)\) a generic element of \(X_{c_1,c_2}(\mathcal C)=\xi _{c_1,c_2}\).

Axiom (ii): Just like in the proof of Lemma 7.17, we can assume that \(\alpha _1\) is the rightmost lower point. Given arbitrary \(q\in \mathcal C\), the sets \(B_1\) and \(B_2\) are crossing blocks of \(p\otimes q\) as well,

figure f

which proves

$$\begin{aligned} \delta _{p}(\alpha _1,\alpha _2)+\Sigma (q)=\delta _{p\otimes q}(\alpha _1,\alpha _2)\in X_{c_1,c_2}(\mathcal C)=\xi _{c_1,c_2}. \end{aligned}$$

Thus, \(\xi _{c_1,c_2}+\sigma \subseteq \xi _{c_1,c_2}\) as claimed.

Axiom (iii): Likewise, the sets \(\rho (B_1)\) and \(\rho (B_2)\) are still crossing blocks in \(\tilde{p}\in \mathcal C\). There, \(\alpha _i\) has normalized color \(\overline{c_i}\) for every \(i\in \{1,2\}\).

figure g

and because, \(\delta _p(\alpha _1,\alpha _2)\equiv -\delta _{p}(\alpha _2,\alpha _1)\mod \Sigma (p)\) (by [5, Lemma 2.1 (b)]), we can immediately conclude \(\delta _p(\alpha _1,\alpha _2)\in -X_{c_2,c_1}(\mathcal C)+\Sigma (\mathcal C)\). Thus, \(\xi _{c_1,c_2}\subseteq -\xi _{c_2,c_1}+\sigma \). Differently from Lemma 7.17, we did not need Lemma 7.15 to see this. \(\square \)

Lemma 7.19

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\xi _{c_1,c_2}{:}{=}X_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axiom (v) of 7.1: For all \(c_1,c_2\in \{\circ ,\bullet \}\),

$$\begin{aligned} \xi _{c_1,c_2}\subseteq \xi _{c_1,\overline{c_2}}\cup \left( -\xi _{c_2,\overline{c_1}}+\sigma \right) . \end{aligned}$$

Proof

Let \(B_1\) and \(B_2\) be crossing blocks in \(p\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2}\) and let \(\alpha _1\in B_1\) and \(\alpha _2\in B_2\) have normalized colors \(c_1\in \{\circ ,\bullet \}\) and \(c_2\in \{\circ ,\bullet \}\), respectively. According to Lemma 7.15 then, every element of \(\xi _{c_1,c_2}=X_{c_1,c_2}(\mathcal C)=X_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{\le 2})\) is of the form \(\delta _p(\alpha _1,\alpha _2)\). Because \(p\in \mathcal {P}^{\circ \bullet }_{\le 2}\), the blocks \(B_1\) and \(B_2\) are pairs. Hence, the crossing between these blocks means that we find points \(\beta _1\in B_1\) and \(\beta _2\in B_2\) with \(\alpha _1\ne \beta _1\) and \(\alpha _2\ne \beta _2\) such that either \((\alpha _1,\alpha _2,\beta _1,\beta _2)\) or \((\alpha _2,\alpha _1,\beta _2,\beta _1)\) is ordered.

Case 1: First, we suppose that \((\alpha _1,\alpha _2,\beta _1,\beta _2)\) is ordered and show \(\delta _p(\alpha _1,\alpha _2)\in X_{c_1,\overline{c_2}}(\mathcal C)\). We can assume that \(\alpha _1\) is the leftmost and \(\beta _1\) the rightmost lower point.

figure h

By Lemma 3.3, the partition \(p'{:}{=}P(p,[\alpha _1,\beta _1]_p)\) belongs to \(\mathcal C\). The definition of the projection operation has the following consequences: The three lower points \(\alpha _1,\alpha _2\) and \(\beta _1\) of p, also points of \(p'\), all retain their normalized colors in \(p'\); the set \(B_1=\{\alpha _1,\beta _1\}\) is still a block of \(p'\); the point \(\alpha _2\) is now connected to its counterpart \(\beta _2'\) on the upper row of \(p'\), implying in particular that the blocks of \(\alpha _1\) and \(\alpha _2\) still cross in \(p'\); and it holds

$$\begin{aligned} \delta _{p'}(\alpha _1,\alpha _2)=\delta _p(\alpha _1,\alpha _2). \end{aligned}$$
figure i

We apply Lemma 3.3 a second time to infer \(p''{:}{=}P(p',[\beta _2',\alpha _2])\in \mathcal C\). Denote the images of the points \(\beta _2'\), \(\alpha _1\) and \(\alpha _2\) of \(p'\) in \(p''\) by \(\beta _2''\), \(\alpha _1''\) and \(\alpha _2''\), respectively. Now, \(\beta _2''\) is the leftmost lower point and \(\alpha _2''\) the rightmost lower point of \(p''\) and the two form a block; the point \(\alpha _1''\in [\beta _2'',\alpha _2'']_{p''}\) is connected to its counterpart on the upper row; and

$$\begin{aligned} \delta _{p''}(\alpha _1'',\alpha _2'')=\delta _{p'}(\alpha _1,\alpha _2)=\delta _p(\alpha _1,\alpha _2). \end{aligned}$$
figure j

There are two crucial observations to make about the successor \(\gamma ''\) of \(\alpha _2''\) in \(p''\), the rightmost upper point of \(p''\). Firstly, \(\gamma ''\) has the inverse normalized color \(\overline{c_2}\) of \(\alpha _2''\), which in particular implies that \(\delta _{p''}(\alpha _2'',\gamma '')=0\). Secondly, \(\gamma ''\) forms a block of \(p''\) together with the leftmost upper point of \(p''\), which entails that its block crosses the block of \(\alpha _1''\) in \(p''\). Hence, \(\delta _{p''}(\alpha _1'',\gamma '')\in X_{c_1,\overline{c_2}}(\mathcal C)\) and

$$\begin{aligned} \delta _{p''}(\alpha _1'',\gamma '')=\delta _{p''}(\alpha _1'',\alpha _2'')+\delta _{p''}(\alpha _2'',\gamma '')=\delta _p(\alpha _1,\alpha _2) \end{aligned}$$

together show \(\delta _p(\alpha _1,\alpha _2)\in X_{c_1,\overline{c_2}}(\mathcal C)= \xi _{c_1,\overline{c_2}}\), which is what we set out to prove.

Case 2: Now, let \((\alpha _2,\alpha _1,\beta _2,\beta _1)\) be ordered instead. By Case 1 then, \(\delta _p(\alpha _2,\alpha _1)\in X_{c_2,\overline{c_1}}(\mathcal C)\). [5, Lemma 2.1 (b)] shows \(\delta _p(\alpha _2,\alpha _1)\equiv -\delta _p(\alpha _1,\alpha _2)\mod \Sigma (p)\). That implies \(\delta _p(\alpha _1,\alpha _2)\in -X_{c_2,\overline{c_1}}(\mathcal C)+\Sigma (\mathcal C)=-\xi _{c_2,\overline{c_1}}+ \sigma \), which is what we needed to see. \(\square \)

Lemma 7.20

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\kappa _{c_1,c_2}{:}{=}K_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axiom (vi) of 7.1: \(0\in \kappa _{\circ \bullet }\cap \kappa _{\bullet \circ }\).

Proof

Since and , this is clear. \(\square \)

Lemma 7.21

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\kappa _{c_1,c_2}{:}{=}K_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axiom (vii) of 7.1:

$$\begin{aligned} \kappa _{c_1,c_2}+\kappa _{\overline{c_2},c_3}\subseteq \kappa _{c_1,c_3} \end{aligned}$$

for all \(c_1,c_2,c_3\in \{\circ ,\bullet \}\).

Proof

Let \(c_1,c_2,c_3\in \{\circ ,\bullet \}\) be arbitrary and let \(\eta _1\) and \(\eta _2\) be distinct points of the same block B of \(p\in \mathcal C\) such that \(]\eta _1,\eta _2[_p\cap B=\varnothing \) and such that \(\eta _i\) has normalized color \(c_i\) in p for every \(i\in \{1,2\}\). Furthermore, let \(\theta _1\) and \(\theta _2\) be distinct points of the same block C of \(q\in \mathcal C\) with \(]\theta _1,\theta _2[_q\cap C=\varnothing \) such that \(\theta _1\) has normalized color \(\overline{c_2}\) in q and \(\theta _2\) normalized color \(c_3\). None of these assumptions are impacted and neither \(\delta _p(\eta _1,\eta _2)\) nor \(\delta _q(\theta _1,\theta _2)\) altered by assuming that \(\eta _2\) is the rightmost lower point of p and \(\theta _1\) the leftmost lower point of q.

figure k

Denote the images of the points \(\theta _1\) and \(\theta _2\) of q in \(p\otimes q\in \mathcal C\) by \(\theta _1'\) and \(\theta _2'\), respectively. The assumptions about the normalized colors of \(\eta _2\) and \(\theta _1\) imply that \(T{:}{=}\{\eta _2,\theta _1'\}\) is a turn in \(p\otimes q\), meaning in particular \(\delta _{p\otimes q}(\eta _2,\theta _1')=0\).

figure l

Moreover, \(\delta _{p\otimes q}(\eta _1,\eta _2)=\delta _p(\eta _1,\eta _2)\) and \(\delta _{p\otimes q}(\theta _1',\theta _2')=\delta _{q}(\theta _1,\theta _2)\) by nature of the tensor product.

Let \(\theta _2''\) denote the image of \(\theta _2'\) in \(r{:}{=}E(p\otimes q,T)\in \mathcal C\), the partition obtained from \(p\otimes q\) by erasing the turn T (see [5, Section 4.3]). By definition of the erasing operation, \(\eta _1\) and \(\theta _2''\) belong to the same block D in r with \(]\eta _1,\theta _2''[_{r}\cap D=\varnothing \).

figure m

Hence, from \(\delta _{r}(\eta _1,\theta _2'')\in K_{c_1,c_3}(\mathcal C)=\kappa _{c_1,c_3}\) and from

$$\begin{aligned} \delta _{r}(\eta _1,\theta _2'')&=\delta _{p\otimes q}(\eta _1,\theta _2)-\sigma _{p\otimes q}(T)\\&=\delta _{p\otimes q}(\eta _1,\theta _2)\\&=\delta _{p\otimes q}(\eta _1,\eta _2)+\delta _{p\otimes q}(\eta _2,\theta _1')+\delta _{p\otimes q}(\theta _1',\theta _2')\\&=\delta _{p\otimes q}(\eta _1,\eta _2)+\delta _{p\otimes q}(\theta _1',\theta _2')\\&=\delta _p(\eta _1,\eta _2)+\delta _q(\theta _1,\theta _2) \end{aligned}$$

it follows \(\delta _p(\eta _1,\eta _2)+\delta _q(\theta _1,\theta _2)\in \kappa _{c_1,c_3}\). And that is what we needed to show. \(\square \)

Lemma 7.22

For every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), the sets \(\sigma {:}{=}\Sigma (\mathcal C)\) and \(\kappa _{c_1,c_2}{:}{=}K_{c_1,c_2}(\mathcal C)\) and \(\xi _{c_1,c_2}{:}{=}X_{c_1,c_2}(\mathcal C)\) for \(c_1,c_2\in \{\circ ,\bullet \}\) satisfy Axiom (viii) of 7.1: For all \(c_1,c_2,c_3\in \{\circ ,\bullet \}\),

$$\begin{aligned} \kappa _{c_1,c_2}+\xi _{\overline{c_2},c_3}\subseteq \xi _{c_1,c_3}. \end{aligned}$$

Proof

We adapt the proof of Lemma 7.21. Let \(c_1,c_2\in \{\circ ,\bullet \}\) be arbitrary. Let \(p,q\in \mathcal C\), let B be a block in p, and let C and D be two crossing blocks in q. Let \(\gamma _1\) and \(\gamma _2\) be two distinct points of B of normalized colors \(c_1\) respectively \(c_2\) in p with \(]\gamma _1,\gamma _2[_p\cap B=\varnothing \). In q, let \(\eta _1\in C\) have normalized color \(\overline{c_2}\) and \(\theta _1\in D\) normalized color \(c_3\). Then, \(\delta _p(\gamma _1,\gamma _2)\) is a generic element of \(K_{c_1,c_2}(\mathcal C)=\kappa _{c_1,c_2}\) and \(\delta _q(\eta _1,\theta _1)\) one of \(X_{\overline{c_2},c_3}(\mathcal C)=\xi _{\overline{c_2},c_3}\). No generality is lost assuming that \(\gamma _2\) is the rightmost lower point of p and \(\eta _1\) the leftmost lower point of q. We find \(\eta _2\in C\) and \(\theta _2\in D\) such that \(\eta _1\ne \eta _2\) and \(\theta _1\ne \theta _2\) and such that \((\eta _1,\theta _1,\eta _2,\theta _2)\) or \((\eta _1,\theta _2,\eta _2,\theta _1)\) is ordered in q.

figure n

Let \(\eta _1'\), \(\eta _2'\), \(\theta _1'\) and \(\theta _2'\) denote the images of, respectively, \(\eta _1\), \(\eta _2\), \(\theta _1\) and \(\theta _2\) in \(p\otimes q\in \mathcal C\). By nature of the tensor product, B is a block of \(p\otimes q\). Likewise, \(\eta _1'\) and \(\eta _2'\) belong to the same block in \(p\otimes q\) and so do \(\theta _1'\) and \(\theta _2'\). And each involved point has the same normalized color in \(p\otimes q\) as the corresponding preimage in p or q. The set \(T{:}{=}\{\gamma _2,\eta _1'\}\) is a turn in \(p\otimes q\).

figure o

If we denote by \(\eta _2''\), \(\theta _1''\) and \(\theta _2''\) the images of \(\eta _1'\), \(\theta _1'\) and \(\theta _2'\) in \(r{:}{=}E(p\otimes q,T)\in \mathcal C\), then \(\gamma _1\) and \(\eta _2''\) belong to the same block in r and so do \(\theta _1'\) and \(\theta _2'\). Because \((\gamma _1,\gamma _2,\eta _1',\theta _i',\eta _2',\theta _{\lnot i}')\) is ordered in \(p\otimes q\) for some \(i,\lnot i\in \{1,2\}\) with \(\{i,\lnot i\}=\{1,2\}\), the tuple \((\gamma _1,\theta _i'',\eta _2'',\theta _{\lnot i}'')\) is then ordered in r. Thus, the blocks of \(\gamma _1\) and \(\eta _2''\) and of \(\theta _1''\) and \(\theta _2''\) cross in r.

figure p

Consequently, from \(\delta _{r}(\gamma _1,\theta _1'')\in X_{c_1,c_3}(\mathcal C)\) and from

$$\begin{aligned} \delta _{r}(\gamma _1,\theta _1'')&=\delta _{p\otimes q}(\gamma _1,\theta _1')-\sigma _{p\otimes q}(T)\\&=\delta _{p\otimes q}(\gamma _1,\theta _1')\\&=\delta _{p\otimes q}(\gamma _1,\gamma _2)+\delta _{p\otimes q}(\gamma _2,\eta _1')+\delta _{p\otimes q}(\eta _1',\theta _1')\\&=\delta _{p\otimes q}(\gamma _1,\gamma _2)+\delta _{p\otimes q}(\eta _1',\theta _1')\\&=\delta _p(\gamma _1,\gamma _2)+\delta _q(\eta _1,\theta _1) \end{aligned}$$

it follows \(\delta _p(\gamma _1,\gamma _2)+\delta _q(\eta _1,\theta _1)\in X_{c_1,c_3}(\mathcal C)= \xi _{c_1,c_3}\). And that is what we needed to see. \(\square \)

Finally, we can give the final result of this section.

Proposition 7.23

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a non-hyperoctahedral category. Then,

$$\begin{aligned} L(\mathcal C)=K_{\circ \circ }(\mathcal C)=K_{\bullet \bullet }(\mathcal C),\qquad K(\mathcal C)=K_{\circ \bullet }(\mathcal C)=K_{\bullet \circ }(\mathcal C) \end{aligned}$$

and

$$\begin{aligned} X(\mathcal C)=X_{\circ \circ }(\mathcal C)=X_{\bullet \bullet }(\mathcal C)=X_{\circ \bullet }(\mathcal C)=X_{\bullet \circ }(\mathcal C) \end{aligned}$$

and there exist \(u\in \{0\}\cup \mathbb {N}\), \(m\in \mathbb {N}\), and \(E\subseteq \{0\}\cup \mathbb {N}\) such that the tuple \((\Sigma ,L,K,X)(\mathcal C)\) is one of the following:

Proof

Follows from Lemmata 7.167.22 and the Arithmetic Lemma 7.13. \(\square \)

8 Step 5: Special Relations between \(\Sigma \), L, K and X depending on F and V

Our objective remains proving \(Z(\mathcal C)\in \mathsf{Q}\) for any non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\). After studying components F (Section 4) and \(\Sigma \) (Section 6) in isolation and after investigating the images of the mappings (FVL) (Section 5) and \((\Sigma ,L,K,X)\) (Section 7), we have arrived at the point where we must take all six components of \(Z=(F,V,\Sigma ,L,K,X)\) into account simultaneously. Fortunately, we can capitalize on the results of Sections 47 in this endeavor. In consequence, it largely suffices to understand better the behavior of \((\Sigma ,L,K,X)\) as dependent on (FV) or, roughly, on F.

Recall from [5, Definition 4.1] that a category is non-hyperoctahedral if and only if it is case \(\mathcal O\), \(\mathcal B\) or \(\mathcal S\) and that these cases are mutually exclusive.

8.1 Special Relations in Case \(\mathcal S\)

For case \(\mathcal S\) categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), i.e., by Proposition 4.3 assuming \(F(\mathcal C)=\mathbb {N}\), there is just a single fact about \((\Sigma ,L,K, X)(\mathcal C)\) we have to note, one about \(L(\mathcal C)\).

Proposition 8.1

\(0\in L(\mathcal C)\) for every case \(\mathcal S\) category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\).

Proof

As , we can, by Lemma 4.1 (c), disconnect the black points in and obtain . It follows . \(\square \)

8.2 Special Relations in Case \(\mathcal O\)

For case \(\mathcal O\) categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), i.e., assuming \(F(\mathcal C)=\{2\}\), more than what Proposition 7.23 is able to discern can be said about \(\Sigma (\mathcal C)\) and \(X(\mathcal C)\).

8.2.1 Relation of \(\Sigma \) to L and K in Case \(\mathcal O\)

First, we treat the total color sums of case \(\mathcal O\) categories.

Proposition 8.2

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a case \(\mathcal O\) category and let \(m\in \mathbb {N}\).

  1. (a)

    If \((L,K)(\mathcal C)=(\varnothing ,m\mathbb {Z})\), then \(\Sigma (\mathcal C)=\{0\}\).

  2. (b)

    If \((L,K)(\mathcal C)=(m\mathbb {Z},m\mathbb {Z})\) or \((L,K)(\mathcal C)=(m+2m\mathbb {Z},2m\mathbb {Z})\), then

    $$\begin{aligned} \Sigma (\mathcal C)=2um\mathbb {Z}\end{aligned}$$

    for some \(u\in \{0\}\cup \mathbb {N}\).

Proof

  1. (a)

    By Proposition 7.23 there exists \(\tilde{u}\in \{0\}\cup \mathbb {N}\) such that \(\Sigma (\mathcal C)=\tilde{u}m\mathbb {Z}\). We suppose \(\tilde{u}\ne 0\) and derive a contradiction. As \(\mathcal C\) is closed under erasing turns and as erasing turns does not affect total color sum, we find \(p\in \mathcal C\) with no turns such that \(\Sigma (p)=\tilde{u}m\). Because \(\tilde{u}m>0\), the partition p has at least one block. As all blocks of p are pairs by Proposition 4.3, there is a block B of p with (necessarily subsequent) legs \(\alpha ,\beta \in B\) and \(\alpha \ne \beta \). Since p has no turns, all points of p have normalized color \(\circ \). In particular, \(\alpha \) and \(\beta \) do. That proves \(L(\mathcal C)\ne \varnothing \), contradicting the assumption.

  2. (b)

    Proposition 7.23 guarantees that \(\Sigma (\mathcal C)=\tilde{u}m\mathbb {Z}\) for some \(\tilde{u}\in \{0\}\cup \mathbb {N}\) and that \(\tilde{u}\) is even if \((L,K)(\mathcal C)=(m+2m\mathbb {Z},2m\mathbb {Z})\). We want to show that \(\tilde{u}\) is even also if \((L,K)(\mathcal C)=(m\mathbb {Z},m\mathbb {Z})\). If \(\tilde{u}=0\), this claim is true. Hence, suppose \(\tilde{u}>0\). As in Part (a), we utilize \(p\in \mathcal C\) with no turns such that \(\Sigma (p)=\tilde{u}m>0\) and, this time, also with no upper points.

    For every \(i\in \mathbb {N}\) with \(i\le m\) consider the set

    comprising the i-th lower point and all its m-th neighbors to the right. Then, \(\bigcup _{i=1}^m S_i\) comprises all points of p and \(|S_i|=\tilde{u}\) for every \(i\in \mathbb {N}\) with \(i\le m\).

    The sets \(S_1,\ldots ,S_{m}\) must all be subpartitions of p: Otherwise, we find \(j,j'\in \mathbb {N}\) with \(j<j'\le \tilde{u} m\) and \(j'-j\notin m\mathbb {Z}\) such that and belong to the same block. As all of has normalized color \(\circ \),

    That contradicts the assumption \(L(\mathcal C)= m\mathbb {Z}\).

    Because all blocks of p are pairs by Proposition 4.3, subpartitions of p have even cardinality. We conclude \(\tilde{u}=|S_1|\in 2\mathbb {Z}\), which then proves the claim. \(\square \)

8.2.2 Relation of X to L and K in Case \(\mathcal O\)

When studying \(X(\mathcal C)\) further for case \(\mathcal O\) categories \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\), it is best to distinguish whether \((L\cup K)(\mathcal C)\) contains non-zero elements or not.

Proposition 8.3

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a case \(\mathcal O\) category and let \(m\in \mathbb {N}\).

  1. (a)

    If \((L,K)(\mathcal C)=(m+2m\mathbb {Z},2m\mathbb {Z})\), then \(X(\mathcal C)=\mathbb {Z}\) or \(X(\mathcal C)=\mathbb {Z}\backslash m\mathbb {Z}\).

  2. (b)

    If \((L,K)(\mathcal C)=(m\mathbb {Z},m\mathbb {Z})\) or \((L,K)(\mathcal C)=(\varnothing ,m\mathbb {Z})\), then \(X(\mathcal C)=\mathbb {Z}\).

Proof

No matter which of the three values \((L,K)(\mathcal C)\) takes, by Proposition 7.23 the set \(X(\mathcal C)\) is m-periodic. Therefore, showing already implies \(X(\mathcal C)=\mathbb {Z}\). Likewise, provided \(m\ge 2\), establishing forces the conclusion that \(X(\mathcal C)=\mathbb {Z}\backslash m\mathbb {Z}\) or \(X(\mathcal C)=\mathbb {Z}\).

  1. (a)

    First, let \((L,K)(\mathcal C)=(m+2m\mathbb {Z},2m\mathbb {Z})\). If \(m=1\), the 1-periodicity of \(X(\mathcal C)\) immediately implies \(X(\mathcal C)=\varnothing \) or \(X(\mathcal C)=\mathbb {Z}\). Hence, we can suppose \(m\ge 2\) and only need to prove by the initial remark.

    Proposition 7.23 lets us infer \(K_{\circ \circ }(\mathcal C)=m+2m\mathbb {Z}\). Hence, we find a partition \(p\in \mathcal C\subseteq \mathcal {P}^{\circ \bullet }_{2}\), therein a block \(\{\alpha ,\beta \}\) with \(\alpha \) and \(\beta \) both of normalized color \(\circ \), with \(\alpha \ne \beta \) and with \(\delta _p(\alpha ,\beta )=m\). Without infringing on any of these assumptions we can additionally suppose that there are no turns T in p such that \(T\subseteq ]\alpha ,\beta [_p\) (otherwise we erase them). Then, all of \(]\alpha ,\beta [_p\) has the same normalized color \(c\in \{\circ ,\bullet \}\).

    figure q

    Because \(\alpha \) and \(\beta \) also identically have normalized color \(\circ \),

    $$\begin{aligned} m=\delta _p(\alpha ,\beta )=\sigma _p(]\alpha ,\beta ]_p)= {\left\{ \begin{array}{ll} |]\alpha ,\beta ]_p| &{} \text {if }c=\circ ,\\ -|]\alpha ,\beta ]_p| &{}\text {otherwise}. \end{array}\right. } \end{aligned}$$

    As \(m>0\), the only option is \(c=\circ \). That means \([\alpha ,\beta ]_p\) consists of \(m+1\) points of normalized color \(\circ \).

    By definition of the projection operation and by Lemma 3.3, it is possible to further add the premise \(p=P(p,[\alpha ,\beta ]_p)\) without impacting any of the previous assumptions. Now, p is also projective and is its lower row.

    For every \(j\in \mathbb {N}\) with \(1<j<m+1\) the point belongs to a through block: Assuming otherwise, forces us to accept the existence of \(j,j'\in \mathbb {N}\) with \(1<j<j'<m+1\) such that and belong to the same block. But then, the uniform color \(\circ \) of \([\alpha ,\beta ]_p\) implies

    and thus \(L(\mathcal C)\cap \{1,\ldots ,m-1\}\ne \varnothing \), contradicting \(L(\mathcal C)\subseteq m\mathbb {Z}\).

    Thus we have shown that and belong to crossing blocks for every \(j\in \mathbb {N}\) with \(1<j<m+1\). Because for every such j, this proves . And that is what we needed to show.

  2. (b)

    Let \((L,K)(\mathcal C)\) be given by \((m\mathbb {Z},m\mathbb {Z})\) or \((\varnothing ,m\mathbb {Z})\). We adapt the proof of Part (a). However, this time, we do not yet impose any restriction on m.

    Proposition 7.23 assures us that \(K_{\circ \bullet }(\mathcal C)=K(\mathcal C)=m\mathbb {Z}\). Hence, we again find \(p\in \mathcal C\), a block B of p and legs \(\alpha ,\beta \in B\) with \(\alpha \ne \beta \), with \(]\alpha ,\beta [_p\cap B=\varnothing \) and with \(\delta _p(\alpha ,\beta )=m\), but this time, such that \(\alpha \) is of normalized color \(\circ \) and \(\beta \) of normalized color \(\bullet \). By the same argument as before we can assume that all points of \(]\alpha ,\beta [_p\) share the same normalized color. Then, the deviating assumption on the colors of \(\alpha \) and \(\beta \) implies \(m=\delta _p(\alpha ,\beta )=\sigma _p(]\alpha ,\beta [_p)=|]\alpha ,\beta [_p|\), which forces \([\alpha ,\beta ]_p\) to consist of exactly \(m+2\) points (rather than \(m+1\) as in Part (a)), the first \(m+1\) of which have normalized color \(\circ \). Once more, we can assume \(p=P(p,[\alpha ,\beta ]_p)\).

    figure r

    If \(m=1\), then \(F(\{p\})=\{2\}\) requires the unique point to belong to a through block, proving \(1\in X(\mathcal C)\) and thus \(X(\mathcal C)=\mathbb {Z}\) as claimed. Hence, suppose \(m\ge 2\) in the following.

    We prove that only through blocks intersect : Supposing that and , where \(j,j'\in \mathbb {N}\) and \(1<j<j'<m+2\), belong to the same block requires us to believe, as both and are \(\circ \)-colored, that

    and thus \(L(\mathcal C)\cap \{1,\ldots ,m-1\}\ne \varnothing \). As this would contradict the assumption \(L(\mathcal C)\subseteq m\mathbb {Z}\), this cannot be the case.

    Now, the conclusion that the blocks of and of cross for every \(j\in \mathbb {N}\) with \(1<j<m+2\) and the fact let us deduce , which is what needed to see. \(\square \)

Proposition 8.4

Let \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\) be a case \(\mathcal O\) category.

  1. (a)

    If \((L,K)(\mathcal C)=(\{0\},\{0\})\), then \(X(\mathcal C)=\mathbb {Z}\backslash N_0\) for a subsemigroup N of \((\mathbb {N},+)\).

  2. (b)

    If \((L,K)(\mathcal C)=(\varnothing ,\{0\})\), then there exists a subsemigroup N of \((\mathbb {N},+)\) such that \(X(\mathcal C)=\mathbb {Z}\backslash N_0\) or \(X(\mathcal C)=\mathbb {Z}\backslash N_0'\).

Proof

Let \((L,K)(\mathcal C)\) be given by \((\{0\},\{0\})\) or \((\varnothing ,\{0\})\). We show the two claims jointly in two steps:

Step 1: First, we prove that there exists a subsemigroup N of \((\mathbb {N},+)\) such that \(X(\mathcal C)=\mathbb {Z}\backslash N_0\) or \(X(\mathcal C)=\mathbb {Z}\backslash N_0'\). That in itself requires two steps as well.

Step 1.1: Recall from [3, Definition 4.1] that by \(\mathcal S_0\) we denote the set of all \(p\in \mathcal {P}^{\circ \bullet }_{2}\) with \(\sigma _p(B)=0\) and \(\delta _p(\alpha ,\beta )=0\) for all blocks B of p and all \(\alpha ,\beta \in B\). We justify that it suffices to prove

figure s

in order to verify the assertion of Step 1.

Indeed, in [4, Theorem 8.3, Lemmata 8.1 (b) and 7.16 (c)] it was shown that for every category \(\mathcal I\subseteq \mathcal S_0\) there exists a subsemigroup N of \((\mathbb {N},+)\) such that

$$\begin{aligned} \{|z|\mid z\in X(\mathcal I)\}\backslash \{0\}=\mathbb {N}\backslash N. \end{aligned}$$

The set \(\mathcal S_0\) is a category by [3, Proposition 5.3], which means that so is \(\mathcal C\cap \mathcal S_0\). Thus, we find a corresponding subsemigroup N for the special case \(\mathcal I= \mathcal C\cap \mathcal S_0\). If we now suppose (\(*\)), which can immediately be sharpened to

$$\begin{aligned} \{|z|\mid z\in X(\mathcal C)\}\backslash \{0\}=\{|z|\mid z\in X(\mathcal C\cap \mathcal S_0)\}\backslash \{0\}, \end{aligned}$$

that implies

$$\begin{aligned} \{|z|\mid z\in X(\mathcal C)\}\backslash \{0\}=\mathbb {N}\backslash N. \end{aligned}$$

As we know \(X(\mathcal C)=-X(\mathcal C)\) by Proposition 7.23, this is equivalent to

$$\begin{aligned} X(\mathcal C)\backslash \{0\}=\mathbb {Z}\backslash N_0' \end{aligned}$$

and thus the claim of Step 1. Hence, it is indeed sufficient to show (\(*\)).

Step 1.2: We prove (\(*\)). As \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }_{2}\) by Proposition 4.3, we are assured by Lemma 7.15 and Proposition 7.23 that \(X(\mathcal C)=X_{c_1,c_2}(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{2})\) for all \(c_1,c_2\in \{\circ ,\bullet \}\). Now, let \(z\in X(\mathcal C)\backslash \{0\}\) be arbitrary. By definition we find \(p\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{2}\) and therein crossing blocks \(B_1\) and \(B_2\) as well as points \(\alpha _1\in B_1\) and \(\alpha _2\in B_2\) such that \(\delta _p(\alpha _1,\alpha _2)=z\). Then, there exist points \(\beta _1\in B_1\) and \(\beta _2\in B_2\) such that \(\alpha _1\ne \beta _1\) and \(\alpha _2\ne \beta _2\) and such that either \((\alpha _1,\alpha _2,\beta _1,\beta _2)\) or \((\alpha _2,\alpha _1,\beta _2,\beta _1)\) is ordered in p. As \(\Sigma (\mathcal C)= \{0\}\) by Proposition 7.23 and thus \(\Sigma (p)=0\), we know \(\delta _p(\alpha _2,\alpha _1)=-\delta _p(\alpha _1,\alpha _2)\) by [5, Lemma 2.1]. Hence, by renaming \(B_1\) and \(B_2\) if necessary we can, at the cost of weakening \(\delta _p(\alpha _1,\alpha _2)=z\) to \(|\delta _p(\alpha _1,\alpha _2)|=|z|\), assume that \((\alpha _1,\alpha _2,\beta _1,\beta _2)\) is ordered. As \(\mathcal C\cap \mathcal {P}^{\circ \bullet }_{2}\) is closed under erasing turns and as \((B_1\cup B_2)\cap ]\alpha _1,\alpha _2[_p=\varnothing \) we can further suppose that no turns T exist in p with \(T\subseteq ]\alpha _1,\alpha _2[_p\). In other words, there is \(c\in \{\circ ,\bullet \}\) such that every point in \(]\alpha _1,\alpha _2[_p\) has normalized color c.

figure t

Even further, by Lemma 3.3 none of the previous assumptions are violated by assuming that \(p=P(p,[\alpha _1,\beta _1]_p)\). Then, \(\beta _2\) is the counterpart of \(\alpha _2\) on the upper row, \(\alpha _1\in [\beta _2,\alpha _2]_p\) and \(\beta _1\notin [\beta _2,\alpha _2]_p\). If we let \(\epsilon \) be the predecessor of \(\alpha _1\), i.e., if \(\epsilon \) is the leftmost upper point of p, then \((\beta _2,\epsilon ,\alpha _1,\alpha _2,\beta _1)\) is ordered.

figure u

Recall that there are no turns T in p with \(T\subseteq ]\alpha _1,\alpha _2[_p\). As \(p=p^*\), there are none with \(T\subseteq ]\beta _2,\epsilon [_p\) either. That means every point in \(]\alpha _1,\alpha _2[_p\) has normalized color c and every point in \(]\beta _2,\epsilon [_p\) normalized color \(\overline{c}\). We can also say a lot about the blocks of p which intersect \([\beta _2,\alpha _2]_p\): If a point \(\theta _1\in ]\alpha _1,\alpha _2[_p\) belongs to a through block it must be connected to its counterpart on the upper row because \(p\in \mathcal {P}^{\circ \bullet }_{2}\) is projective. If \(\theta _1\) belongs to a non-through block instead, then the partner \(\theta _2\) of \(\theta _1\) must lie outside \([\beta _2,\alpha _2]_p\): Supposing otherwise, i.e., \(\theta _2\in ]\alpha _1,\alpha _2[_p\), produces a contradiction: If \((\alpha _1,\theta _i,\theta _{\lnot i},\beta _2)\) with \(i,\lnot i\in \{1,2\}\) and \(\{i,\lnot i\}=\{1,2\}\) is ordered, then, as all points in \([\theta _i,\theta _{\lnot i}]_p\) are c-colored, the consequence \(|\delta _p(\theta _i,\theta _{\lnot i})|=|]\theta _i,\theta _{\lnot i}]_p|>0\) violates \(L(\mathcal C)\subseteq \{0\}\), which follows from \(K(\mathcal C)=\{0\}\) by Proposition 7.23.

Define \(p'{:}{=}P(p,[\beta _2,\alpha _2]_p)\in \mathcal C\cap \mathcal {P}^{\circ \bullet }_{2}\) and denote by \(\beta _2'\), \(\epsilon '\), \(\alpha _1'\) and \(\alpha _2'\) the images in \(p'\) of \(\beta _2\), \(\epsilon \), \(\alpha _1\) and \(\alpha _2\), respectively. In \(p'\) the leftmost lower point \(\beta _2'\) and the rightmost lower point \(\alpha _2'\) form a block. The points \(\epsilon ',\alpha _1'\in [\beta _2',\alpha _2']\) are each paired with their respective counterpart on the upper row. In particular the blocks of \(\alpha _1'\) and \(\alpha _2'\) cross in \(p'\).

figure v

Our knowledge about the blocks of p intersecting \([\beta _2,\alpha _2]_p\) lets us draw the following conclusions about the blocks of \(p'\): A point in \(]\alpha _1',\alpha _2'[_p\) is either partnered with its reflection at the center \([\epsilon ',\alpha _1']_{p'}\) of the lower row of \(p'\) in \(]\beta _2',\epsilon '[_{p'}\) or, as \(p'\) is projective, it is partnered with its counterpart on the opposite row. As \(]\beta _2',\epsilon '[_{p'}\) is uniformly \(\overline{c}\)-colored and \(]\alpha _1',\alpha _2'[_{p'}\) uniformly c-colored, that means that all blocks emanating from \(]\beta _2',\epsilon '[_{p'}\cup ]\alpha _1',\alpha _2'[_p\) are neutral. But then, all blocks of \(p'\) are neutral. Due to \(L(\mathcal C)\subseteq \{0\}\) and \(K(\mathcal C)=\{0\}\), this is already enough to know \(p'\in \mathcal S_0\). Because \(\delta _{p'}(\alpha _1',\alpha _2')=\delta _p(\alpha _1,\alpha _2)\), that proves \(|z|=|\delta _p(\alpha _1,\alpha _2)|=|\delta _{p'}(\alpha _1',\alpha _2)|\in \{|z|\mid z\in X(\mathcal C\cap \mathcal S_0)\}\). As z was arbitrary, (\(*\)) holds true and Part (b) has been proven.

Step 2: In order to prove Part (a) it remains to show \(0\in X(\mathcal C)\) provided \(L(\mathcal C)=\{0\}\). Under this latter assumption, by Proposition 7.23 we infer \(K_{\circ \circ }(\mathcal C)=\{0\}\). Hence, we find \(p\in \mathcal C\), therein a block B and legs \(\alpha ,\beta \in B\) of normalized color \(\circ \) with \(\alpha \ne \beta \), with \(]\alpha ,\beta [_p\cap B=\varnothing \) and with \(\delta _p(\alpha ,\beta )=0\). As in the proof of Proposition 8.3 we can assume that there are no turns T in p such that \(T\subseteq ]\alpha ,\beta [_p\), i.e. that all points in \(]\alpha ,\beta [_p\) have the same normalized color \(c\in \{\circ ,\bullet \}\). From

$$\begin{aligned} 0=\delta _p(\alpha ,\beta )=\sigma _p(]\alpha ,\beta ]_p)=\sigma _p(]\alpha ,\beta [_p)+\sigma _p(\{\beta \})= {\left\{ \begin{array}{ll} |]\alpha ,\beta [_p|+1&{}\text {if }c=\circ ,\\ -|]\alpha ,\beta [_p|+1&{}\text {otherwise} \end{array}\right. } \end{aligned}$$

and from \(|]\alpha ,\beta [_p|\ge 0\) it follows that \(c=\bullet \) and that \(]\alpha ,\beta [_p\) is a singleton set. Emulating the proof of Proposition 8.3 further, we can assume \(p=P(p,[\alpha ,\beta ]_p)\).

figure w

Then, the lower row of p has coloration \(\circ \bullet \circ \). As \(p\in \mathcal {P}^{\circ \bullet }_{2}\) and as p is projective, the block of is the pair . That means the blocks of and cross, implying . That concludes the proof. \(\square \)

9 Step 6: Synthesis

Combining the results from Sects. 48, we are able to show the main theorem.

Theorem 9.1

\(Z(\mathcal C)\in \mathsf{Q}\) for every non-hyperoctahedral category \(\mathcal C\subseteq \mathcal {P}^{\circ \bullet }\).

Proof

By Lemma 7.23 there exist \(u\in \{0\}\cup \mathbb {N}\), \(m\in \mathbb {N}\), and \(E\subseteq \{0\}\cup \mathbb {N}\) such that the tuple \((\Sigma ,L,K,X)(\mathcal C)\) is given by one of the following:

figure x

We treat the three cases \(\mathcal O\), \(\mathcal B\) and \(\mathcal S\) individually. The formulaic presentation will mirror that of Definition 2.5 exactly, to facilitate cross-checking.

Case \(\mathcal B\): First, let \(\mathcal C\) be case \(\mathcal B\). Proposition 4.3 (c) implies \(F(\mathcal C)=\{1,2\}\). So, we can immediately add the column for \(F(\mathcal C)\) to table (\(*\)). Further, Proposition 5.1 (c) shows \(V(\mathcal C)=\pm \{0,1,2\}\) if and only if \(L(\mathcal C)\ne \varnothing \) and \(V(\mathcal C)=\pm \{0,1\}\) otherwise. That allows us to fill in the column for \(V(\mathcal C)\) as well. The result is that \(Z(\mathcal C)\) concurs with a row of the table

for some \(u\in \{0\}\cup \mathbb {N}\), \(m\in \mathbb {N}\), and \(E\subseteq \{0\}\cup \mathbb {N}\). Hence, by Definition 2.5, we have shown \(Z(\mathcal C)\in \mathsf{Q}\) if \(\mathcal C\) is case \(\mathcal B\).

Case \(\mathcal S\): Next, let \(\mathcal C\) be case \(\mathcal S\). Propositions 4.3 (d) and 5.1 (d) guarantee \(F(\mathcal C)=\mathbb {N}\) and \(V(\mathcal C)=\mathbb {Z}\). Hence, we can fill in the columns for F and V in (\(*\)) once more. Moreover, \(0\in L(\mathcal C)\) by Proposition 8.1. Thus, we can exclude that \((\Sigma ,L,K,X)(\mathcal C)\) is given by the second, third or fifth rows of (\(*\)). In other words, there are \(u\in \{0\}\cup \mathbb {N}\), \(m\in \mathbb {N}\), and \(E\subseteq \{0\}\cup \mathbb {N}\) such that \(Z(\mathcal C)\) is given by one of the rows of the following table:

And, by Definition 2.5, this means \(Z(\mathcal C)\in \mathsf{Q}\) for \(\mathcal C\) in case \(\mathcal S\).

Case \(\mathcal O\): Lastly, let \(\mathcal C\) be case \(\mathcal O\). Once more, Propositions 4.3 (b) and 5.1 (b) give, on the one hand, \(F(\mathcal C)=\{2\}\) and, on the other hand, \(V(\mathcal C)=\pm \{0,2\}\) if \(L(\mathcal C)\ne \varnothing \) and \(V(\mathcal C)=\{0\}\) otherwise. That enables us to fill in the columns for \(F(\mathcal C)\) and \(V(\mathcal C)\) in (\(*\)):

figure y

This is not yet what we claim as this range is not contained in \(\mathsf{Q}\). We need to exclude certain values for u, D and E by taking into account the results of Section 8.2. This we shall do on a row-by-row basis.

Case \(\mathcal O\).1: First, suppose \((L,K)(\mathcal C)=(m\mathbb {Z},m\mathbb {Z})\) for some \(m\in \mathbb {N}\), as in the first row of Table (\(**\)). Then \(\Sigma (\mathcal C)\subseteq 2m\mathbb {Z}\) (corresponding to parameters \(u\in 2\mathbb {Z}\)) according to Proposition 8.2 (b). Moreover, \(X(\mathcal C)=\mathbb {Z}\) (corresponding to \(D=\varnothing \)) as seen in Proposition 8.3 (b). Hence, we can replace the first row of Table (\(**\)) by

still for parameters \(u\in \{0\}\cup \mathbb {N}\) and \(m\in \mathbb {N}\) exactly as before.

Case \(\mathcal O\).2: Now, proceeding to the second row of Table (\(**\)), let \((L,K)(\mathcal C)=(m+2m\mathbb {Z},2m\mathbb {Z})\) for some \(m\in \mathbb {N}\). By Proposition 8.3 (a) the only two values \(X(\mathcal C)\) can possibly take are \(\mathbb {Z}\) and \(\mathbb {Z}\backslash m\mathbb {Z}\) (corresponding to \(D=\varnothing \) and \(D=\{0\}\), respectively). Thus, we can delete the second row of Table (\(**\)) and insert the two new rows

in its stead, still for parameters \(m\in \mathbb {N}\) and \(u\in \{0\}\cup \mathbb {N}\).

Case \(\mathcal O\).3: Next, assume \((L,K)(\mathcal C)=(\varnothing ,m\mathbb {Z})\) for some \(m\in \mathbb {N}\) as in row three of Table (\(**\)). Then, in fact, \(\Sigma (\mathcal C)=\{0\}\) as seen in Proposition 8.2 (a). Furthermore, \(X(\mathcal C)=\mathbb {Z}\) by Proposition 8.3 (b). Hence, we rewrite the third row of (\(**\)) as

depending only on the parameter \(m\in \mathbb {N}\).

Case \(\mathcal O\).4: Let \((L,K)(\mathcal C)=(\{0\},\{0\})\), i.e., consider the fourth row of Table (\(**\)). Then, \(X(\mathcal C)=\mathbb {Z}\backslash N_0\) for some subsemigroup of \((\mathbb {N},+)\) by Proposition 8.4 (a) (corresponding to \(E=N\) being a subsemigroup). Accordingly, we can replace the fourth row of Table (\(**\)) by

for a new table parameter N, running through all subsemigroups of \((\mathbb {N},+)\).

Case \(\mathcal O\).5: Lastly, suppose \((L,K)(\mathcal C)=(\varnothing ,\{0\})\) as in the fifth row of Table (\(**\)). In Proposition 8.4 (a) we showed \(X(\mathcal C)\) is of the form \(\mathbb {Z}\backslash N_0\) or \(\mathbb {Z}\backslash N_0'\) for some subsemigroup N of \((\mathbb {N},+)\) (corresponding to \(E=N\) and \(E=\{0\}\cup N\), respectively). Thus, strike the last row of Table (\(**\)) and append the two rows

to the table, with N being a subsemigroup of \((\mathbb {N},+)\).

Synthesis in case \(\mathcal O\): If we combine the results of Cases 1–5, then we can say that there exist \(m\in \mathbb {N}\), \(u\in \{0\}\cup \mathbb {N}\) and a subsemigroup N of \((\mathbb {N},+)\) such that \(Z(\mathcal C)\) is given by one of the rows of the following table:

Definition 2.5 thus yields \(Z(\mathcal C)\in \mathsf{Q}\) if \(\mathcal C\) is case \(\mathcal O\). Hence, the overall claim is true. \(\square \)