A Universal Randomized Packet Scheduling Algorithm
 1.3k Downloads
 1 Citations
Abstract
We give a memoryless scaleinvariant randomized algorithm ReMix for Packet Scheduling that is e/(e−1)competitive against an adaptive adversary. ReMix unifies most of previously known randomized algorithms, and its general analysis yields improved performance guarantees for several restricted variants, including the sbounded instances. In particular, ReMix attains the optimum competitive ratio of 4/3 on 2bounded instances.
Our results are applicable to a more general problem, called Item Collection, in which only the relative order between packets’ deadlines is known. ReMix is the optimal memoryless randomized algorithm against adaptive adversary for that problem.
Keywords
Online algorithms Competitive analysis Adaptive adversary Packet scheduling Buffer management with bounded delay1 Introduction
In this paper, we consider the problem of Packet Scheduling, introduced by Kesselman et al. [14] (under the name Buffer Management with Bounded Delay). This problem models the behavior of a single network switch responsible for scheduling packet transmissions along an outgoing link as follows. We assume that time is divided into unitlength steps. At the beginning of a time step, any number of packets may arrive at a switch and be stored in its buffer. Each packet has a positive weight, corresponding to the packet’s priority, and a deadline, which specifies the latest time when the packet can be transmitted. Only one packet from the buffer can be transmitted in a single step. A packet is removed from the buffer upon transmission or expiration, i.e., reaching its deadline. The goal is to maximize the gain, defined as the total weight of the packets transmitted.
As many others, we prefer to call the problem Packet Scheduling since it is equivalent to a single machine scheduling of unitlength jobs, with given weights, release times and deadlines; the last two restricted to integer values. In this setting, the goal is to maximize the total weight of jobs completed before their respective deadlines.
As the process of managing a packet queue is inherently a realtime task, we model it as an online problem. This means that the algorithm, when deciding which packets to transmit, has to base its decision solely on the packets which have already arrived at a switch, without the knowledge of the future.
1.1 Competitive Analysis
To measure the performance of an online algorithm, we use the standard notion of competitive analysis [5], which, roughly speaking, compares the gain of the algorithm to the gain of the optimal solution on the same instance. For any algorithm Alg, we denote its gain on instance I by \(\mathcal{G}_{\scriptsize\textsc{Alg}}(I)\). The optimal offline algorithm is denoted by Opt. We say that a deterministic algorithm Alg is \(\mathcal{R}\)competitive if on any instance I it holds that \(\mathcal{G}_{\scriptsize\textsc{Alg}}(I) \geq\frac{1}{ \mathcal{R}}\cdot\mathcal{G}_{\scriptsize\textsc{Opt}}(I)\).
When analyzing the performance of an online algorithm Alg, we view the process as a game between Alg and an adversary. The adversary creates the instance on the one hand, i.e., controls what packets are injected into the buffer, and solves the instance optimally on the other, i.e., chooses its packets for transmission. The goal is then to show that the adversary’s gain is at most \(\mathcal{R}\) times Alg’s gain.
If the algorithm is randomized, we consider its expected gain, \(\mathbb{E} [\mathcal{G}_{\scriptsize\textsc{Alg}}(I)]\), where the expectation is taken over all possible random choices made by Alg. However, in the randomized case, the power of the adversary has to be further specified. Following BenDavid et al. [2], we distinguish between an oblivious and an adaptiveonline adversary, called adaptive for shortness from now on. An oblivious adversary has to construct the whole instance in advance. This instance may depend on Alg but not on the random bits used by Alg during the computation. The expected gain of Alg is compared to the gain of the optimal offline solution on I. In contrast, in case of an adaptive adversary, the choice of packets to be injected into the buffer may depend on the algorithm’s behavior up to the given time step. This adversary must also provide an answering entity Adv, which creates a solution in parallel to Alg. This solution may not be changed afterwards. We say that Alg is \(\mathcal{R}\)competitive against an adaptive adversary if for any adaptively created instance I and any answering algorithm Adv, it holds that \(\mathbb{E}[\mathcal {G}_{\scriptsize\textsc{Alg}}(I)] \geq\frac{1}{\mathcal{R}} \cdot \mathbb{E}[\mathcal{G}_{\scriptsize\textsc{Adv}}(I)]\). We note that Adv is (wlog) deterministic, but as Alg is randomized, so is the instance I.
In the literature on online algorithms [5], the definition of the competitive ratio sometimes allows an additive constant, i.e., a deterministic algorithm is then called \(\mathcal {R}\)competitive if there exists a constant α ≥0 such that for any instance I it holds that \(\mathcal{G}_{\scriptsize\textsc{Alg}}(I) \geq\frac{1}{ \mathcal {R}}\cdot\mathcal{G}_{\scriptsize\textsc{Opt}}(I)  \alpha\). An analogous definition applies to the randomized case. For our algorithm ReMix the bound holds for α=0, which is the best possible.
1.2 Basic Definitions
For a packet j, we denote its: weight by w _{ j }, relative deadline by d _{ j }, absolute deadline by D _{ j }, and release time by r _{ j }. The absolute deadline is the exact point in time at which the packet expires, whereas the relative deadline is, at any time, the number of further steps after which the packet expires. To avoid nested subscripts we will use slightly different notation for sequences of packets: when considering a sequence of packets j _{1},j _{2},…,j _{ n }, instead of \(x_{j_{i}}\) (where x∈{d,D,r,w}), we simply write x _{ i }. We also denote a packet of weight w and relative deadline d by (w,d). A packet that is in the buffer, i.e., has already been released and has neither expired nor been transmitted by an algorithm, is called pending for the algorithm. The lifespan of a packet is its relative deadline value upon injection, or in other words the difference between its absolute deadline and release time.
The goal is to maximize the weighted throughput, i.e., the total weight of transmitted packets. We assume that time is slotted in the following way. We distinguish between points in time and time intervals, called steps. In step t, corresponding to the interval (t,t+1), Adv and the algorithm choose, independently, a packet from their buffers and transmit it. The packet transmitted by the algorithm (Adv) is immediately removed from its buffer and no longer pending. Afterwards, at time t+1, the relative deadlines of all remaining packets are decremented by 1, and the packets whose relative deadlines reach 0 expire and are removed from both Adv’s and the algorithm’s buffers. Next, the adversary injects any set of packets. At this point, we proceed to step t+1.
All known algorithms are scaleinvariant, which means that they make the same decisions if all the weights of packets in an instance are scaled by a positive constant. A class of further restricted algorithms is of special interest for their simplicity: an algorithm is memoryless if in every step its decision depends only on the set of packets pending at that step.
1.3 Previous and Related Work, Restricted Variants
The currently best, 1.828competitive, deterministic algorithm for general instances was given by Englert and Westermann [9]. Their algorithm is scaleinvariant, but it is not memoryless. However, the same article provides a 1.893competitive variant that is memoryless scaleinvariant. The best known randomized algorithm is the 1.582competitive memoryless scaleinvariant RMix, proposed by Chin et al. [6]. For reasons explained in Sect. 2.1 the original analysis by Chin et al. is only applicable to the oblivious adversary model. However, a refined analysis shows that RMix remains 1.582competitive in the adaptive adversary model [4].
Comparison of known and new results. All the upper bounds in the middle column (randomized algorithms for adaptive adversary model) follow from this article, as does (cf. Sect. 3) the one for similarly ordered instances in oblivious adversary model; a reference next to one of these entries means that this particular bound was already known. The results without citations are implied by other entries of the table. An asterisk denotes that the algorithm attaining the bound is memoryless scaleinvariant
deterministic  (rand.) adaptive  (rand.) oblivious  

general  upper  1.582^{∗} [4]  1.582^{∗} [6]  
lower  1.618  1.333  1.25  
similarly ordered  upper  1.618^{∗} [16]  1.582^{∗}  1.333^{∗} [13] 
lower  1.618  1.333  1.25  
sbounded  upper  \(2\frac{2}{s}+o(\frac{1}{s})^{*}\) [6]  \(1/ (1(1\frac{1}{s})^{s} )^{*}\)  \(1/ (1(1\frac {1}{s})^{s} )^{*}\) 
lower  1.618  1.333  1.25  
2bounded  upper  1.618^{∗} [14]  1.333^{∗} [4]  1.25^{∗} [6] 
lower  1.333 [4]  1.25 [7] 
For a general overview of techniques and results on buffer management, see the surveys by Azar [1], Epstein and Van Stee [10] and Goldwasser [11].
Uniform Sequences
An instance is suniform if the lifespan of each packet is exactly s. Such instances have been considered for two reasons. Firstly, there is a connection between them and the FIFO model of buffer management, also considered by Kesselmann et al. [14] (the connection itself stated in Corollary 5.5 therein). Secondly, the 2uniform instances are among the most elementary restrictions that do not render the problem trivial. However, analyzing these sequences is not easy: while a simple deterministic \(\sqrt{2}\)competitive algorithm for 2uniform instances [18] is optimal among memoryless scaleinvariant algorithms [6], for unrestricted algorithms, a sophisticated analysis shows the optimum competitive ratio is 1.377 [8].
Bounded Sequences
An instance is sbounded if the lifespan of each packet is at most s; therefore every suniform instances is also sbounded. The 2bounded instances give rise to the strongest currently known lower bounds. These are ϕ≈1.618 for deterministic algorithms [7, 12, 18], 1.25 for randomized algorithms in the oblivious adversary model [7], and 4/3 in the adaptive adversary model [4]. For 2bounded instances, algorithms matching these bounds are known [4, 6, 14]. A family of deterministic algorithms EDF _{ β } is \(2\frac{2}{s}+o(\frac{1}{s})\)competitive for sbounded instances [6]; β is a parameter suitably chosen as a function of s. Detailed analysis reveals that the ϕcompetitive deterministic algorithm for 2bounded instances, itself a member of the EDF _{ β } family, remains 3competitive also on 3bounded instances [6]. However, these algorithms’ competitive ratio guarantees present an improvement over Englert and Westermann’s algorithm only for small values of s.
Similarly Ordered Sequences
An instance is similarly ordered or has agreeable deadlines if for every two packets i and j their spanning intervals are not properly contained in one another, i.e., if r _{ i }<r _{ j } implies D _{ i }≤D _{ j }. Note that every 2bounded instance is similarly ordered, as is every suniform instance, for any s. An optimal deterministic ϕcompetitive algorithm [16] and a randomized 4/3competitive algorithm for the oblivious adversary model (as well as an alternative optimal deterministic algorithm) [13] are known for similarly ordered instances.
Other Restrictions
There are many other meaningful restricted variants of the problem, for which better algorithms are known. Interestingly, one of the optimal deterministic algorithms for similarly ordered instances [16] performs well in several restricted instance classes [15] (the performance of the other algorithm [13] was not studied). Let us mention one class of instances, studied by Kesselmann et al. in their seminal paper [14], for which our algorithm provides additional bounds: as various transmission protocols usually specify only several priorities for packets, it is sensible to bound the number of different packet weights.
Generalization: Collecting Weighted Items from a Dynamic Queue
The following generalization of Packet Scheduling has been studied [3], and called Item Collection by its authors. In Item Collection the algorithm is to collect weighted items, one per step, from a dynamic queue S, which is in fact an ordered list. The content of S varies over time, as it is updated between any two consecutive time steps. Such an update is performed by an external agent (the adversary), and consists of deleting any number of items at the front of S (a prefix of S) and inserting new items into arbitrary locations in S. Note that the collection is the algorithm’s action, not a queue update. However, the algorithm is allowed to collect an item only once, and only while it is in the queue. The objective is to maximize the total weight of the collected items.
Item Collection is easily seen to generalize Packet Scheduling: let the items in the queue correspond to packets, their locations in S determined by nondecreasing order of their deadlines, with ties broken arbitrarily. These items have the same weights as their corresponding packets, are inserted upon their release, and deleted upon expiration—ordering by deadlines ensures that a prefix of S is deleted.
Note that in Item Collection the algorithm does not know how many steps will lapse between deletions of two successive items in its queue—this is why ties between packets’ deadlines are broken arbitrarily in the reduction.
Some of the algorithms for Packet Scheduling extend to Item Collection, for example the greedy algorithm, which ignores the deadlines altogether. In general, any algorithm for Packet Scheduling that only compares packets’ deadlines, without resorting to their exact values, and can thus be presented with a list of packets ordered by their deadlines, extends to Item Collection. Among such algorithms are the EDF _{ β } algorithms, RMix, and our algorithm ReMix—reader is advised to keep this in mind, because we present it for the more popular setting of Packet Scheduling.
While the paper of Bienkowski’s et al. [3] focuses on deterministic algorithms for Item Collection, it does provide a lower bound for memoryless randomized algorithms, matched by ReMix, cf. Sect. 5.3.
1.4 Our Contribution
We consider randomized algorithms against an adaptive adversary, motivated by the following observation. In reality, traffic through a switch is not at all independent of the packet scheduling algorithm. For example, lost packets are typically resent, and throughput through a node affects the choice of routes for data streams in a network. These phenomena can be captured by the adaptive adversary model but not by the oblivious one. The adaptive adversary model is also of its own theoretical interest and has been studied in other settings [5].
The main contribution of this paper is a simple memoryless scaleinvariant algorithm ReMix, which unifies most of previously known randomized algorithms for Packet Scheduling. It also applies to the generalized Item Collection problem, for which it is optimal among memoryless randomized algorithms, cf. Sect. 5.3. As its name reflects, ReMix is very similar to RMix, proposed by Chin et al. [6]. The only, yet crucial difference between these two algorithms is the transmission’s probability distribution over pending packets. While RMix is essentially the EDF _{ β } algorithm with β chosen in each step according to a fixed (same in every step) probability distribution, it is no longer so in ReMix.
This subtle change allows a refined analysis of ReMix, which yields an upper bound on the algorithm’s competitive ratio that depends on the maximum number of packets, over all steps, that have positive probability of transmission in the step. Specifically, if we denote that number by N, our upper bound on the competitive ratio of ReMix is \(f(n)=1/ (1(1\frac {1}{N})^{N} )\). Note that f(N) tends to e/(e−1) from below. The number N can be bounded a priori in certain restricted variants of Packet Scheduling, thus giving better bounds for them. Specifically, it is easily observed that N≤s in instances with at most s different packet weights as well as in sbounded instances. The particular upper bound of 4/3 we obtain for 2bounded instances (known before) is optimal in the adaptive adversary model [4]; the bounds for sbounded instances and s>2 (in both oblivious and adaptive adversary model) are new. Certain structural properties of optimum schedules for similarly ordered instances imply that N≤2 for that class of instances as well, at least in the oblivious adversary model, yielding an upper bound of 4/3 (also known before [13]). While details are given in Sect. 3, most of the implications are summarized in Table 1.
2 General Upper Bound
2.1 Analysis Technique
In our analysis, we follow the paradigm of modifying Adv’s buffer, introduced by Li et al. [16] (the development of this technique is covered in Sect. 4). Namely, we assume that in each step ReMix and Adv have precisely the same packets in their buffers. Once they both transmit a packet, we modify Adv’s buffer judiciously to make it identical with that of ReMix. This leads to a streamlined and intuitive proof.
When modifying the buffer, we may have to let Adv transmit another packet, inject an extra packet to his buffer, or upgrade one of the packets in its buffer by increasing its weight or deadline. We ensure that these changes are advantageous to the adversary in the following sense: for any adversary strategy Adv, starting with the current step and buffer content, there is an adversary strategy \(\overline{\textsc{Adv}}\) that continues computation with the modified buffer, such that the total gain of \(\overline{\textsc {Adv}}\) in this and the following steps, on any instance, is at least as large as that of Adv.
To prove Rcompetitiveness, we show that in each step the expected amortized gain of Adv is at most R times the expected gain of ReMix, where the former is the total weight of the packets that Adv eventually transmitted in this step. Both expected values are taken over random choices of ReMix.
We are going to assume that Adv never transmits a packet a if there is another pending packet b such that Adv is always better off by transmitting b. Formally, we introduce a dominance relation among the pending packets and assume that Adv never transmits a dominated packet.
We say that a packet a=(w _{ a },d _{ a }) is dominated by a packet b=(w _{ b },d _{ b }) at time t if at time t both a and b are pending, w _{ a }≤w _{ b } and d _{ a }≥d _{ b }. If one of these inequalities is strict, we say that a is strictly dominated by b. We also say that packet a is (strictly) dominated at time t if at that time there is a pending packet b that (strictly) dominates it. When a packet a is not strictly dominated, we call it a nondominated packet (observe that a dominates itself). In Item Collection setting, a is dominated by b if b precedes a in the queue and w _{ b }≥w _{ a }; there is no distinction between dominance and strict dominance in Item Collection, since there are no ties between deadlines there.
Fact 1
 (i)
the gain of \(\overline{\textsc{Adv}}\) on every sequence is at least the gain of Adv,
 (ii)
\(\overline{\textsc{Adv}}\) transmits a nondominated packet in every step.
Proof
Adv can be transformed into \(\overline{\textsc{Adv}}\) by applying an exchange argument iteratively: take the minimum t _{0} such that Adv first violates (ii) in step t _{0}, and transform Adv into an algorithm Adv′ with gain no smaller than that of Adv, which satisfies (ii) up to step t _{0}, possibly violating it in further steps.
Let t _{0} be the first step in which (ii) is violated. Let y=(w,d) be the packet transmitted by Adv and x=(w′,d′) be a packet that strictly dominates y; then w′≥w and d′≤d. Let Adv′ transmit the same packets as Adv up to step t _{0}−1, but in step t _{0} let it transmit x, and in the remaining steps let it try to transmit the same packets as Adv. It is impossible in one case only: when Adv transmits x in some step t. But then d≥d′>t, so let Adv′ transmit y, still pending at t. Clearly, (i) is preserved. □
The proof trivially extends to Item Collection.
We stress that Fact 1 holds for both oblivious and adaptive adversary model. Now we give an example of another simplifying assumption, common in the oblivious adversary model, which seems to break down in the adaptive adversary model.
In the oblivious adversary model the instance is fixed in advance by the adversary, so Adv may precompute the optimum schedule to the instance and follow it. Moreover, by standard exchange argument for the fixed set of packets to be transmitted, Adv may always send the packet with the smallest deadline from that set—this is usually called the earliest deadline first (EDF) property or order. This assumption not only simplifies analyses of algorithms but is often crucial for them to yield desired bounds [6, 8, 13, 16].
In the adaptive adversary model, however, the following phenomenon occurs: as the instance I is randomized, Adv does not know for sure which packets it will transmit in the future. Consequently, deprived of that knowledge, it cannot ensure any specific order of packet transmissions. For example, it might be the case that in one step Adv decides to transmit a packet x, and, depending on the outcome of the algorithm’s random choice, in the next step Adv might transmit either y or z, both pending for Adv already in the previous step, such that the deadlines of the three packets satisfy D _{ y }<D _{ x }<D _{ z }. This example is elusive: while we are unable to preclude adversarial strategies of this kind, we are equally unable to come up with a specific instance where they would not be dominated by other adversarial strategies.
2.2 Algorithm and Its Analysis
We introduce the packet h _{0} to shorten ReMix’s pseudocode. The packet itself is chosen in such a way that p _{0}=0, to make it clear that it is not considered for transmission (unless h _{0}=h _{1}). The while loop itself could be terminated as soon as r=0, because afterwards ReMix does not assign positive probability to any packet. However, letting it construct the whole sequence h _{1},h _{2},…h _{ m } such that H _{ m }=∅ streamlines our analysis. Before proceeding, we note that these easily follow from the algorithm.
Fact 2
Fact 3
With these, we can prove our main result.
Theorem 1
ReMix is \(1/ (1(1\frac{1}{N})^{N} )\)competitive against an adaptive adversary, where N is the maximum number of packets, over all steps, that are assigned positive probability in a step.
Proof
 Case 1:

d _{ f }≤d _{ z }. Note that in this case w _{ f }≤w _{ z }, since h _{ z } is nondominated. After both Adv and ReMix transmit their packets, we replace h _{ f } in the buffer of Adv by a copy of h _{ z }. This way their buffers remain the same afterwards, and the change is advantageous to Adv: this is essentially an upgrade of the packet h _{ f } in its buffer, as both d _{ f }≤d _{ z } and w _{ f }≤w _{ z } hold.
 Case 2:

d _{ f }>d _{ z }. After both Adv and ReMix transmit their packets, we let Adv additionally transmit h _{ f }, and we inject a copy of h _{ z } into its buffer, both of which are clearly advantageous to Adv. This makes the buffers of Adv and ReMix identical afterwards.
3 Application to Similarly Ordered and Other Restricted Instances
We have already mentioned that for sbounded instances or those with at most s different packet weights, N≤m≤s in Theorem 1, which trivially follows from Fact 2. Thus for either kind of instances ReMix is \(1/ (1(1\frac {1}{s})^{s} )\)competitive. In particular, on 2bounded instances ReMix coincides with the previously known optimal 4/3competitive algorithm Rand [4] for the adaptive adversary model.
While in a similarly ordered instance the number of nondominated pending packets in any step can be arbitrarily large, surprisingly enough, in every step an oblivious adversary (wlog) transmits a packet from a set \(\mathcal{H}\) of at most two packets that can be identified by the algorithm, assuming (as we did throughout the analysis) that the same packets are pending for the algorithm and the adversary. Hence, on such instances ReMix is 4/3competitive against oblivious adversary, provided that H _{0} is initialized to \(\mathcal{H}\) in every step.
This surprising fact follows from Lemma 2, which we state and prove at the end of this section. As that lemma describes a property of optimum (offline) schedules, it applies to an oblivious adversary’s schedule only. The end result, i.e., a 4/3competitive algorithm was known before [13], as was in fact Lemma 2 itself. The lemma’s and the analysis technique’s origins and development are surveyed in Sect. 4.
Before we proceed, we need to inspect some basic properties of schedules. Formally, a schedule is an injective function that assigns packets to time steps within their lifespans. It can thus be thought of as a matching in a bipartite graph whose partitions are the packets and the steps respectively, and edges connect packets to the steps in their lifespans. The edges incident to a packet are assigned the packet’s weight, in a sense making the graph vertex rather than edgeweighted. Naturally, an optimal schedule for a set of packets corresponds to a maximum weight matching in the corresponding graph; for a set of packets X we denote that graph by G _{ X }. Structural properties of optimum schedules and algorithms to find them thus follow from those of and for matchings.
Firstly, we note a relation between optimum schedules for sets of packets Q and Q′ such that Q⊆Q′. While the lemma seems obvious and its proof is a simple reasoning about matchings, we prove it for completeness.
Lemma 1
Let Q and Q′ be two sets of packets such that Q⊆Q′. Then for every optimum schedule S for Q there exists an optimum schedule S′ for Q′ such that the set inclusion S′∩Q⊆S holds
Proof
Let S and S″ be any given optimum schedules for Q and Q′ respectively. We demonstrate how to obtain an optimum schedule S′ for Q′ that satisfies S′∩Q⊆S. To this end view both S and S″ as matchings in G _{ Q′} and consider their symmetric difference S⊕S″, which is a disjoint sum of alternating paths and cycles. Unless there is some packet j∈S″∩Q∖S, we are done by letting S′=S″. Note that such j∈S″∩Q∖S is an endpoint of some alternating path P in S⊕S″. In the following we will consider augmenting either S or S″ along P—such operation results in a matching representing some schedule. Note that all packets in P come from Q, as they are scheduled in S.
Hence P has even length and thus ends with a vertex corresponding to a packet j′∈S∖S″. Both S and S″ can be augmented using P, and in terms of packets scheduled this operation simply swaps j and j′. Thus w _{ j }=w _{ j′} follows from optimality of both S and S″. Hence S″⊕P is a matching in G _{ Q′} of the same weight as S″, i.e., it is also an optimum schedule for Q′. See Fig. 1(b) for an illustration.
Applying such changes iteratively transforms S″ to S′ such that S′∩Q⊆S. To observe that a finite number of iterations suffices, define Δ(X):=X∩Q∖S for any schedule X. It follows that Δ(S″⊕P)=Δ(S″)−1. Since Δ is nonnegative and its value drops by one with each iteration, S′ is obtained in a finite number of steps. □
In our case, Q will be the set of packets pending for ReMix (or Adv, since these sets are the same in our analysis) at a certain step, with the lifespans of the packets restricted to that and future steps. A schedule for Q is typically called a provisional schedule. The set Q′, on the other hand, will be the union of Q with the set of all packets to be released in the future steps of the instance. Then Lemma 1 implies that (wlog) Adv is going to transmit one of the packets from the optimum provisional schedule. Obviously, there can be arbitrarily many packets in that schedule but in similarly ordered instances the sets Q and Q′ have additional properties, and Lemma 1 can be accordingly strengthened.
Lemma 2
Let t be a step, and let Q and Q′ be two sets of packets such that r _{ j }=t for all j∈Q, Q⊆Q′, t<min{r _{ j }∣j∈Q′∖Q}, and max{D _{ j }∣j∈Q}≤min{D _{ j }∣j∈Q′∖Q}. Also, let S be an EDFordered optimal schedule over Q. Then, if S is nonempty, there exists an optimal schedule S′ over Q′ such that in step t either e or h is transmitted in S′, where e and h are any earliestdeadline and any maximumweight packet from S respectively.
Proof
We assume (wlog) that S is EDFordered in such a way that S(t)=e. Let X be an optimal schedule over Q′ that starts in time step t such that X∩Q⊆S—its existence is guaranteed by Lemma 1. Moreover, we assume (wlog) that X is EDFordered in such a way that the packets from S∩X appear in X in exactly the same order as in S, and that they are all assigned before those from Q′∩X. If e∈X, then we let S′=X, and we are done.
Otherwise, observe that since X is optimal, it assigns some packet z∈Q to time step t. If h∉X, then we let S′ be X with h substituted for z—such S′ is optimal, as w _{ h }≥w _{ z }. Otherwise, we claim that S′ can be obtained by reordering X so that h is assigned to time step t. To prove it, let us enumerate the packets from S in the order they are assigned: j _{1},j _{2},…,j _{ s }. Observe that e=j _{1}, z=j _{ k }, and h=j _{ l } for some 1<k<l≤s, by our assumptions (k<l, because z is assigned before h in both X and S). Let d _{ i } denote the relative deadline of j _{ i } at time t, 1≤i≤s. Then d _{ i }≥i for i=1,…,s.
4 Origins and Development of Analysis Technique
As mentioned before, our analysis technique can be traced back to the article that introduced the first optimal deterministic algorithm for similarly ordered instances [16]. The principle of modifying Adv ’s buffer and Lemma 2 both appear there, though densely interwoven. Furthermore, the core analysis therein relied on obliviousness of the adversary (i.e., it following an optimal schedule) more than it was necessary: in what corresponds to Case 2 (d _{ f }>d _{ z }) in our Proof of Theorem 1, Li et al. [16] first noted that in Adv’s (optimal) schedule f is transmitted later anyway, only then concluding that Adv may thus be allowed to transmit both z and f.
A later article about similarly ordered instances [13] separated the principle of the analysis and Lemma 2, though not completely. While the algorithm therein coincides with ReMix with H _{0} initialized to \({\mathcal{H}}=\{e,h\}\) (as defined in Lemma 2), in the analysis the lemma was used only to handle some of the cases (specifically, that of the algorithm transmitting h≠e and Adv transmitting j≠e), rather than to notice beforehand that (wlog) Adv transmits either e or h, just like the algorithm.
Subsequently, the technique was applied to analyze two algorithms for the adaptive adversary model: Rand, the optimum algorithm for 2bounded instances, and RMix [4]. Comparing the preliminary conference version of [4] to the final one is illustrative: the original analysis of Rand used a potential function argument, which resulted in a longer proof with larger number of cases; also, it did not give any analysis of RMix, claiming that the original one [6] extends to the adaptive adversary model.
5 Probability Distribution and Tightness
In this section we prove tightness of our analysis, for all values of the parameter N. We begin with explaining how the probability distribution used by the algorithm was chosen; while it does not prove anything on its own, hopefully it is illuminating. Then we give Packet Scheduling instances that actually prove tightness, and finally we note that the algorithm is optimal (in the class of memoryless algorithms) for the generalized problem of Item Collection. All these have some implications, as we explain in Sect. 6.
5.1 Probability Distribution Rationale
The particular probability distribution used in ReMix is chosen to (heuristically) minimize the above ratio by maximizing \(\mathbb {E} [\mathcal{G}_{\scriptsize\textsc{ReMix}} ]\), while keeping (9) satisfied, which, together with (8), implies \(\mathbb{E} [\mathcal {G}_{\scriptsize\textsc{Adv}} ]\leq \mathcal{G}_{\scriptsize\textsc{Adv}}^{({1})}=w_{1}\).
The first goal can be trivially achieved by setting p _{1}←1 but that would make \(\mathbb{E} [\mathcal{G}_{\scriptsize\textsc {Adv}}^{({z})} ] > w_{1}\) for all z>1. Therefore, some of the probability mass is transferred to p _{2},p _{3},… in the following way. To keep \(\mathbb{E} [\mathcal{G}_{\scriptsize\textsc {ReMix}} ]\) as large as possible, p _{2} is greedily set to its maximum, if there is any unassigned probability left, p _{3} is set to its maximum, and so on. As \(\mathbb{E} [\mathcal{G}_{\scriptsize \textsc{Adv}}^{({z})} ]\) does not depend on p _{ i } for i≥z, the values \(\mathbb{E} [\mathcal{G}_{\scriptsize \textsc{Adv}}^{({z})} ]\) can be equalized with w _{1} sequentially, with z increasing, until there is no unassigned probability left. Equalizing \(\mathbb{E} [\mathcal{G}_{\scriptsize\textsc {Adv}}^{({j})} ]\) with \(\mathbb{E} [\mathcal {G}_{\scriptsize\textsc{Adv}}^{({j1})} ]\) consists in setting \(p_{j1} \gets1 \frac{w_{j}}{w_{j1}}\), as shown in (10). The same inequality shows what is intuitively clear: once there is no probability left and further values \(\mathbb{E} [\mathcal{G}_{\scriptsize\textsc{Adv}}^{({z})} ]\) cannot be equalized, they are only smaller than w _{1}.
5.2 Tightness of Analysis
We present a simple Packet Scheduling instance that proves tightness of our analysis even in the oblivious adversary model; in fact, all the packets in this instance are released at once.
Let N be any positive integer and let T≫N be another integer. Let h _{1},h _{2},…,h _{ N } be a sequence of packets such that h _{ i } has weight w _{ i }=(1−1/N)^{ i } and absolute deadline D _{ i }=T−i. The instance starts at time 0, when T copies of each of h _{1},h _{2},…,h _{ N } are released. Note that in each step up to T−N−1 inclusively, ReMix will find a chain of N packets: copies of h _{1},h _{2},…,h _{ N }—this is because it ignores the abundance of copies, whose number is enough so that the algorithm does not run out of h _{ i }’s copies (1≤i≤N) before they expire. It is easy to observe that ReMix will assign probability 1/N to a copy of h _{ i } for each i in each of these steps, and that its expected gain in each of these will be \((1(1\frac{1}{N})^{N} ) \cdot w_{1}\) because the sequence of weights w _{1},w _{2},…,w _{ N } (and the resulting sequence of probabilities p _{1},p _{2},…,p _{ N }) makes the inequalities (10) and (16) tight. In each of those steps, Adv transmits a copy of h _{1}, gaining w _{1} per step. The last N−1 steps have negligible impact on both players’ gains, since N≪T. Hence, ReMix’s competitive ratio on these instances is arbitrarily close to \(1/ (1(1\frac {1}{N})^{N} )\).
As one readily observes, these instances are rather artificial: should the algorithm consider only the packets from the optimum provisional schedule in each step, it would gain just as much as Adv; such modification of ReMix is justified by Lemma 1. The same is true for all the variations of this instance we could think of crafted for the oblivious adversary model, i.e., with packet releases specified upfront. We don’t know any instance showing the tightness of our analysis of such a variation of ReMix in the oblivious adversary model. Therefore it is possible that such a variation of the algorithm attains better competitive ratio, if only in the oblivious adversary model.
In fact, in the adaptive adversary model our simple instance is easily modified in such a way that determining the optimum provisional schedule does not affect ReMix’s behavior. Let us sketch the modification: initially, only a single copy of each of h _{1},h _{2},…,h _{ N } is released, together with a tight (i.e., expiring at the beginning of the very next step) packet of weight w _{ N+1}:=w _{ N }⋅(1−1/N)=(1−1/N)^{ N+1}. Note that introduction of this packet does not affect ReMix’s probability distribution. In this step Adv transmits the packet ignored by ReMix. Then, for a number of steps much larger than N, say T/2, the adversary does the following: it releases a copy of the packet that ReMix last transmitted, and a single tight packet of weight w _{ N+1}. In each such step Adv transmits the latter packet, whereas ReMix transmits a copy of one of h _{1},h _{2},…,h _{ N }, chosen uniformly at random. The expected gain of ReMix in each step is the same as in the previous instance, i.e., \((1(1\frac{1}{N})^{N} ) \cdot w_{1}\). Afterwards, no further packets are released, and both players can transmit whatever packets are still pending for them. Again, ReMix’s gain for that is insignificant, since N≪T but in the remaining T/2 steps Adv will transmit all the packets that ReMix transmitted in previous steps. Hence, one might think that in each of the first T/2 steps Adv gains w _{ N+1} for transmitting its packet plus the packet that ReMix transmits, as it were in our amortized analysis. Then Adv’s expected amortized gain in each of those steps is almost 1: precisely, it is \(w_{1} \cdot (1(1\frac{1}{N})^{N} ) + w_{N+1} = w_{1} \cdot (1(1\frac{1}{N})^{N}/N )\), which tends to 1 as N grows. Hence, the competitive ratio of ReMix on this instance also tends to e/(e−1) as N tends to infinity.
5.3 Optimality for Item Collection
As we mentioned before, ReMix is optimal among randomized memoryless algorithms for Item Collection [3, Theorem 7]. In fact, as noted therein, the lower bound proof gives an infinite sequence of adversary’s strategies parametrized by N such that the Nth one forces ratio \(1/ (1(1\frac{1}{N})^{N} )\), while ensuring that the number of packets pending for the algorithm never exceeds N. In such case ReMix is guaranteed to match that ratio, hence being the optimal randomized memoryless algorithm for Item Collection in a strong sense. We note though that, unlike the sbounded instances of Packet Scheduling, any class of instances (parametrized by N) that would contain the ones defined in the lower bound construction would make little sense on their own: while at all times the algorithm has at most N packets pending, the lifespans of the packets are not restricted at all; in fact, the adversary successively “gathers copies” of the packets pending for the algorithm, only to transmit them all once no further packets are issued; while the proof is technically more involved, the basic idea in this lower bound is similar to the one behind the second instance discussed in Sect. 5.2. Note that this lower bound gives independent evidence that (17) is indeed minimized by the heuristic described in Sect. 5.1.
6 Conclusion
Our algorithm ReMix is very simple to analyze, yet it unifies almost all previous randomized algorithms for packet scheduling (the optimum algorithm against oblivious adversary for 2bounded instances [6] is the only exception), all the while providing new bounds for some restricted variants of the problem, thanks to its universal analysis. However unlikely it seems, it may potentially yield further nontrivial upper bounds, should one be able to confine the adversary’s choice of packets for transmission for some class of instances in a similar manner to the one described in Sect. 3 for similarly ordered instances.
As explained in Sect. 5.3, ReMix is an optimal randomized memoryless algorithm for Item Collection. Therefore, to beat either the general bound of e/(e−1), or any of the \(1/ (1(1\frac{1}{s})^{s} )\) bounds for sbounded instances for Packet Scheduling, one either needs to consider algorithms that are not memoryless scaleinvariant, or better utilize the knowledge of exact deadlines—in the analysis at least, if not in algorithm itself.
This might be achieved with the very same algorithm if H _{0} is always initialized to (the set of packets included in) the optimum provisional schedule as discussed in Sect. 5.2. Note that resorting to an optimal provisional schedule takes the deadline values into account, so the lower bound for Item Collection no longer applies. It is conceivable that randomized algorithms might benefit from consulting the optimal provisional schedule, as there are already several algorithms that do so [9, 13, 16, 17]. However, among those the only randomized algorithm is the one for similarly ordered instances.
Bridging the gaps in any unresolved variant remains an obvious open problem. Let us point out that settling the question whether one may assume that an adaptive adversary obeys an EDF rule makes for another interesting question. Should the answer be affirmative, the 4/3 upper bound for similarly ordered instances would apply not only to the oblivious but also adaptive adversary model, and would be optimal for the latter.
Notes
Acknowledgements
This work was supported under the Polish Ministry’s of Science and Higher Education grant N N206 368839, 2010–2013, Approximation algorithms under uncertainty, and Grant Agency’s of the Academy of Sciences of the Czech Republic project IAA100190902, 2009–2013, Mathematical logic, complexity, and algorithms.
References
 1.Azar, Y.: Online packet switching. In: Proc. of the 2nd Workshop on Approx. and Online Algorithms (WAOA), pp. 1–5 (2004) Google Scholar
 2.BenDavid, S., Borodin, A., Karp, R.M., Tardos, G., Wigderson, A.: On the power of randomization in online algorithms. Algorithmica 11(1), 2–14 (1994). Also appeared in Proc. of the 22nd ACM Symp. on Theory of Comput. (STOC), pp. 379–386 (1990) MathSciNetCrossRefMATHGoogle Scholar
 3.Bienkowski, M., Chrobak, M., Dürr, C., Hurand, M., Jeż, A., Jeż, Ł., Stachowiak, G.: Collecting weighted items from a dynamic queue. Algorithmica (2011). doi: 10.1007/s0045301195746. Also appeared in Proc. of the 20th ACMSIAM Symp. on Discrete Algorithms (SODA), pp. 1126–1135 (2009) MATHGoogle Scholar
 4.Bienkowski, M., Chrobak, M., Jeż, Ł.: Randomized competitive algorithms for online buffer management in the adaptive adversary model. Theor. Comput. Sci. 412(39), 5121–5131 (2011). Also appeared in Proc. of the 6th Workshop on Approx. and Online Algorithms (WAOA), pp. 92–104 (2008) CrossRefMATHGoogle Scholar
 5.Borodin, A., ElYaniv, R.: Online Computation and Competitive Analysis. Cambridge University Press, Cambridge (1998) MATHGoogle Scholar
 6.Chin, F.Y.L., Chrobak, M., Fung, S.P.Y., Jawor, W., Sgall, J., Tichý, T.: Online competitive algorithms for maximizing weighted throughput of unit jobs. J. Discrete Algorithms 4, 255–276 (2006) MathSciNetCrossRefMATHGoogle Scholar
 7.Chin, F.Y.L., Fung, S.P.Y.: Online scheduling for partial job values: does timesharing or randomization help? Algorithmica 37, 149–164 (2003) MathSciNetCrossRefMATHGoogle Scholar
 8.Chrobak, M., Jawor, W., Sgall, J., Tichý, T.: Improved online algorithms for buffer management in QoS switches. ACM Trans. Algorithms 3(4), 50 (2007). doi: 10.1145/1290672.1290687, 19 pp. Also appeared in Proc. of the 12th European Symp. on Algorithms (ESA), pp. 204–215 (2004) MathSciNetCrossRefGoogle Scholar
 9.Englert, M., Westermann, M.: Considering suppressed packets improves buffer management in QoS switches. In: Proc. of the 18th ACMSIAM Symp. on Discrete Algorithms (SODA), pp. 209–218 (2007) Google Scholar
 10.Epstein, L., van Stee, R.: Buffer management problems. SIGACT News 35, 58–66 (2004) Google Scholar
 11.Goldwasser, M.: A survey of buffer management policies for packet switches. SIGACT News 41(1), 100–128 (2010) CrossRefGoogle Scholar
 12.Hajek, B.: On the competitiveness of online scheduling of unitlength packets with hard deadlines in slotted time. In: Conf. in Information Sciences and Systems, pp. 434–438 (2001) Google Scholar
 13.Jeż, Ł.: Randomized algorithm for agreeable deadlines packet scheduling. In: Proc. of the 27th Symp. on Theor. Aspects of Comput. Sci. (STACS), pp. 489–500 (2010) Google Scholar
 14.Kesselman, A., Lotker, Z., Mansour, Y., PattShamir, B., Schieber, B., Sviridenko, M.: Buffer overflow management in QoS switches. SIAM J. Comput. 33(3), 563–583 (2004). Also appeared in Proc. of the 33rd ACM Symp. on Theory of Comput. (STOC), pp. 520–529 (2001) MathSciNetCrossRefMATHGoogle Scholar
 15.Li, F.: A comprehensive study of an online packet scheduling algorithm. In: Proc. of the 5th Int. Conf. on Comb. Optim. and Appl. (COCOA), pp. 52–63 (2011) Google Scholar
 16.Li, F., Sethuraman, J., Stein, C.: An optimal online algorithm for packet scheduling with agreeable deadlines. In: Proc. of the 16th ACMSIAM Symp. on Discrete Algorithms (SODA), pp. 801–802 (2005) Google Scholar
 17.Li, F., Sethuraman, J., Stein, C.: Better online buffer management. In: Proc. of the 18th ACMSIAM Symp. on Discrete Algorithms (SODA), pp. 199–208 (2007) Google Scholar
 18.Zhu, A.: Analysis of queuing policies in QoS switches. J. Algorithms 53(2), 137–168 (2004). Also appeared in Proc. of the 14th ACMSIAM Symp. on Discrete Algorithms (SODA), pp. 761–770 (2003) MathSciNetCrossRefMATHGoogle Scholar
Copyright information
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.