Abstract
Ondemand mobility systems in which passengers use the same vehicle simultaneously are a promising transport mode, yet difficult to control. One of the most relevant challenges relates to the spatial imbalances of the demand, which induce a mismatch between the position of the vehicles and the origins of the emerging requests. Most ridepooling models face this problem through rebalancing methods only, i.e., moving idle vehicles towards areas with high rejections rate, which is done independently from routing and vehicletoorders assignments, so that vehicles serving passengers (a large portion of the total fleet) remain unaffected. This paper introduces two types of techniques for anticipatory routing that affect how vehicles are assigned to users and how to route vehicles to serve such users, so that the whole operation of the system is modified to reach more efficient states for future requests. Both techniques do not require any assumption or exogenous knowledge about the future demand, as they depend only on current and recent requests. Firstly, we introduce rewards that reduce the cost of an assignment between a vehicle and a group of passengers if the vehicle gets routed towards a highdemand zone. Secondly, we include a small set of artificial requests, whose request times are in the near future and whose origins are sampled from a probability distribution that mimics observed generation rates. These artificial requests are to be assigned together with the real requests. We propose, formally discuss and experimentally evaluate several formulations for both approaches. We test these techniques in combination with a stateoftheart tripvehicle assignment method, using a set of real rides from Manhattan. Introducing rewards can diminish the rejection rate to about ninetenths of its original value. On the other hand, including future requests can reduce usersâ€™ traveling times by about onefifth, but increasing rejections. Both methods increase the vehicleshourtraveled by about 10%. Spatial analysis reveals that vehicles are indeed moved towards the most demanded areas, such that the reduction in rejections rate is achieved mostly there.
Introduction
Centrally controlled ondemand ridepooling systems, in which different users can ride the same vehicle at the same time if their paths are compatible, are a promising mobility system for the future of cities, because they can exhibit many of the advantages of popular (nonshared) ondemand systems more sustainably without increasing congestion.
Massive ondemand systems (apps) have become popular due to a number of virtues: short waiting times, doortodoor service, ease of payment, an increase of comfort, and no need for parking nor driving (Rayle etÂ al. 2016; Tirachini and del RĂo 2019; Tang et al. 2019). All these positive features can be kept when rides are shared (pooled) as well.
Moreover, sharing can effectively fight congestion and emissions if an adequate fleet is selected (Tirachini etÂ al. 2019; Li etÂ al. 2021). Empirical studies have shown that carsharing systems in which rides are not shared have increased congestion, as they attract many users from public transport (Henao and Marshall 2019; Tirachini and GomezLobo 2020; Agarwal et al. 2019; Roy et al. 2020; Diao et al. 2021; Wu and MacKenzie 2021). When rides are shared, vehicles make more efficient use of the scarce vial space.
However, such mobility systems are quite hard to operate, as they combine the principles of two classic NPHard problems: the DynamicVehicleRoutingProblem (as they are ondemand) and the DialARideProblem (due to the sharing aspect). Despite this complexity, some algorithms have been able to effectively decide how to match groups of users and how to assign them to vehicles (Ota etÂ al. 2016; AlonsoMora etÂ al. 2017a; Tsao et al. 2019; Simonetto etÂ al. 2019; Kucharski and Cats 2020), and their simulations have confirmed the potential of ridepooling.
One of the main difficulties of massive ondemand systems is related to their dynamics. The system needs to decide the assignments as the requests appear. Even if these assignments are decided optimally according to the current conditions, they might leave the system in a state that is inefficient to serve the demand that will emerge afterward. Let us consider an extreme and simplified example that helps to visualize the situation: a circular city, in which the users are located at the border and are all traveling to the center. FigureÂ 1 shows such a scenario, simulating an exaggerated version of a morning peak situation. This unbalanced demand pattern will make all the cars converge rapidly at the center; if there are bounds on the maximum waiting time (a usual assumption in these models) and the time required to go back to the border exceeds this bound, then vehicles will not be assigned to any new request, and the system would collapse.
To prevent such situations, most of the algorithms include a rebalancing step, in which cars that are not being used are sent to some zone in which they are expected to be required. Note that underlying this idea, there has to be some way to determine which zones of a city will require vehicles in the future, i.e., there are some anticipatory decisions. The corresponding scheme of decisions can be synthesized in the following steps:

1.
One or more trips are requested to the system.

2.
The system decides how to assign the request(s) to the set of vehicles, i.e., which new users will travel together, in which vehicle(s) and following which route. This process is performed according to some optimization rules and constraints that deal with the quality of service. Sometimes it is not possible to serve all the requests, and some get rejected.

3.
After assigning or after some predefined lapse of time, the system determines which vehicles are not being used and decides how to rebalance them.
Two relevant aspects underlie the recent description: rebalancing does not interact directly with assignments, and it only deals with idle vehicles. These aspects can have substantial drawbacks. A relevant limit to rebalancing strategies is given by the number of vehicles that can be controlled, which might be much lower than the total number of vehicles in the system when only idle vehicles are considered. Such a situation is particularly relevant when the system is serving close to its maximum capacity, in which case most vehicles are being used constantly and thus are not available for rebalancing. This is quite problematic as these heavily loaded scenarios are the ones in which the system needs to work as efficiently as possible.
Furthermore, sometimes the assignment process may produce some inefficient matches, which cannot be corrected through rebalancing. In particular, some vehicles might be directed towards lowdemand areas to give a better quality of service at a specific time, but being barely shared. Such situations worsen future service, as vehicles move to zones in which they are not likely to be required or used to their full potential (if the remain being lowdemand).
These phenomena can be observed in Fig.Â 2 (from Fielbaum etÂ al. (2021)), which shows the quality of service when modeling a ridepooling system (based on the model by AlonsoMora etÂ al. (2017a)) during one hour in Manhattan. It reveals that the level of rejected requests, the average waiting time, and the average delay are all higher at the center of the network, precisely the most demanded zone. Similarly, AlonsoMora etÂ al. (2017a) provides a video^{Footnote 1} that shows the daily performance of the system. In this video, two facts are noteworthy: there are almost no rebalancing vehicles, and the number of passengers per vehicle is much higher in the most demanded zone than in the rest of the network.
These problems are inherent to the systemâ€™s combination between sharing and having flexible routes. When cars are shared but rides are not (i.e., ondemand taxis), finding a single passenger is as good as possible, so there is no need to go to the most demanded zones if there is some demand in the rest of the network. In public transport, lines are designed a priori to serve better the most demanded zones through higher frequencies, shorter distances to bus stops, and more direct services (Mohring 1972; Chang and Schonfeld 1991; Daganzo 2010; Fielbaum etÂ al. 2020), i.e., the mismatch between supply and demand is prevented thanks to having fixed routes.
To prevent such situations, techniques that are beyond rebalancing are needed. In this paper, we study methods that introduce anticipatory decisions at an earlier stage, namely when deciding the assignments (i.e., which vehicle is carrying which passengers) and the routes (i.e., in which order are they served), in order to have the whole system better prepared for future service. The techniques we propose do not require any exogenous assumptions about future requests. They take as input only the endogenous information that is generated while operating the system, namely the origins of current and recent requests (we also study the use of historical data as a benchmark, and we show it performs worse). As revealed by our simulations based on reallife data, current and recent requests can be used as an efficient proxy for what will happen in the near future when applying our techniques. Moreover, by these means, our techniques adapt endogenously to the different situations in which they might be applied.
We study two types of techniques: First, by modifying the cost of each possible assignment between vehicles and set of requests, favoring those assignments that conduct the vehicle towards the most demanded zones; second, we introduce artificial future requests to the pool of requests that have to be assigned at each time, with origins in those same highdemanded zones so some vehicles might be sent towards them. Several specific implementations for each technique are analyzed and compared.
The paper is structured as follows: â€śRelated worksâ€ť sectionÂ synthesizes previous research on the topic and highlights the contributions of this paper over the state of the art. â€śTwo anticipatory methodsâ€ť sectionÂ explains the two main techniques that we propose in this paper, which depend on some â€śgenerationâ€ť and â€śrejectionâ€ť rates, that are explained in â€śDifferent definitions for generation and rejection ratesâ€ť section. In â€śNumerical simulationâ€ť section we run simulations to analyze the impact of the methods over a reallife case (in Manhattan), together with a deep analysis of how the spatial mismatch between vehicles, requests, and rejections is modified. Finally, in â€śConclusions and future researchâ€ť sectionÂ we conclude and propose several directions for future research.
Related works
Ondemand ridepooling systems
The research over ondemand ridepooling systems has rapidly expanded during the last years, boosted by the success of ondemand mobility apps (both shared and nonshared) and the need for more sustainable systems in which vehicles are used for more than one passenger. A review of the different methods available in the literature to control such systems is offered by Zardini et al. (2021).
Many studies deal with the problem of how to assign passengers and vehicles, either through agentbased models (like (Merlin 2017; Fagnant and Kockelman 2018; Lokhandwala and Cai 2018; Vosooghi etÂ al. 2019) among others) or through centralized algorithms (like (dOrey et al. 2012; Pelzer etÂ al. 2015; AlonsoMora etÂ al. 2017a; Gao et al. 2017; Qian etÂ al. 2017; Wang etÂ al. 2018; Tsao et al. 2019; Simonetto etÂ al. 2019; Fielbaum etÂ al. 2021; Levin etÂ al. 2017; Lin et al. 2018) among others). Some of these assignment methods have rebalancing or anticipatory techniques, which are described in the following subsection.
Algorithmicbased assignment methods are specially important for this paper, as our techniques are based on affecting specific steps in the execution of such algorithms. Out of those, the method by AlonsoMora etÂ al. (2017a) has been quite impactful because it is able to find, within a receding horizon approach, optimal solutions thanks to a smart search of all the feasible combinations between users and vehicles. Such a method has been modified by Simonetto etÂ al. (2019), who assign no more than one passenger to each vehicle during each time window to reduce the computational burden, and by Fielbaum etÂ al. (2021), who use some heuristics to optimize the pickup and dropoff points of each passenger. A different approach is followed by Tsao et al. (2019), who models the problem as a flow network, which is more efficient from a computational standpoint and is able to decide how to assign and rebalance in a single step, but is limited to vehicles of capacity two. Most other papers depend on heuristics that are designed specifically to this type of problems (Levin etÂ al. 2017; Ota etÂ al. 2016)). Finally, some learning techniques have been proposed to improve the decisions of how to assign users to vehicles (Lin et al. 2018; Haliem et al. 2020).
These systems have been further analyzed in a number of other directions. A relevant issue related to this paper is that ondemand ridepooling can be more unreliable (i.e., it is harder for users to predict which quality of service they will experience) than other mobility systems. This happens due to the same dynamics that call for anticipatory techniques, i.e., flexible routes that respond to the emerging demand. These unreliability sources are described in detail by Fielbaum and AlonsoMora (2020), which focus on those sources related to vehiclesâ€™ assignments. On a related note, Kucharski et al. (Forthcoming), Hyland and Mahmassani (2020) study the impact of late passengers, while (Liu etÂ al. 2019) analyzes the impact of traffic congestion, all of which affect the future performance of the system.
Rebalancing and predictive methods
Many of the ridepooling^{Footnote 2} systems proposed in the literature include some rebalancing method that decides how to move idle vehicles. The general idea underlying all of them is the following: if a vehicle is idle right now, the place in which it is currently located has an oversupply of vehicles, so it should move to a different location where it is more likely to be required. The decisions of which vehicles to move and towards which zones may also try to prevent the rebalancing vehicles to drive for too long distances.
The methods present in the literature differ mostly on how to measure the need for vehicles in each region. Some papers consider the current demand (Vosooghi etÂ al. 2019; Lioris et al. 2016; Sayarshad and Chow 2017); Spieser et al. (2014) seeks for an even distribution of the vehicles; AlonsoMora etÂ al. (2017a) (the model we use here for the simulations, and whose rebalancer we also include) takes the origin of the rejected requests as the mark that defines that a vehicle is needed there, an approach that is adapted by Liu and Samaranayake (2020), who excludes from the rebalancing process vehicles that were already being rebalanced, and by Tsao et al. (2019), who keeps some predefined number of vehicles idle to be able to serve unexpected demand; van Engelen etÂ al. (2018) assumes that the probabilities of having new trips in a zone are known, based on historical data, and compares it with the current number of vehicles that are currently in such zone; and Wallar et al. (2018) estimates the future demand using a particle filter method that considers the temporal evolution of the demand within each zone. Finally, Wen et al. (2017) uses an approach that is different from the ones explained so far, as they use reinforcement learning techniques for rebalancing, which they show to outperform a rebalancer similar to the ones previously described, and a simpler rebalancer that randomly moves a vehicle to its neighboring areas, with probabilities proportional to their demand rates. As discussed in the introduction, all these rebalancing methods affect idle vehicles only.
Few papers deal with anticipatory routing or assignments, as we do here. In a simplified context, in which users travel between specific stations among the area covered by the system, Barth etÂ al. (2004) propose a method that could be used in more general schemes: splitting groups of passengers into many vehicles if their destinations are located in a zone that is expected to require more vehicles in the near future, thus routing more vehicles into those areas. van Engelen etÂ al. (2018) works with an eventbased model, in which each time a new request emerges, it is assigned to a vehicle that is chosen using demand forecast, trying to match the number of empty seats of that vehicle with the number of users that it might pick up when transporting the original request; similar ideas are proposed by Wang etÂ al. (2020), but assigning several requests at a time.
Two papers propose predictive routing and assignment ideas building upon the same model that we use for simulations (AlonsoMora etÂ al. 2017a), and using related techniques: AlonsoMora etÂ al. (2017b)) estimates historical demand for each zone, and includes some artificial requests according to this estimated demand in order to push the whole system towards a better preparation for the future, an approach that we extend here considering alternative ways of defining the artificial requests, other than based on historical data; Huang and Peng (2018) modifies the cost function with an additive term that depends on the spatial distribution of the vehicles and its distance to the optimal one. These papers have some drawbacks: the former requires historical data that is not always available, it increases the computational time heavily, and it does not have a meaningful impact on reducing the number of rejected requests of the system (it does reduce average waiting times and delay); while the latter requires a perfect knowledge of the demand distribution, and it does not affect the routes of the vehicles for a given set of pickups and dropoffs.
On a related note, some authors have proposed pricing mechanisms to reduce the mismatch between the position of the vehicles and the origins of the users: Zakharenko (2020) studies a system in which users rent a vehicle but do not leave it where they picked it up, and Haliem et al. (2020) analyze ridepooling as currently provided by Transportation Network Companies, where drivers have a say regarding which users to serve. Those scenarios do not coincide exactly to the systems we study here, but they both propose that trips ending in highdemand areas should face lower fares. By this means, such trips become prioritized when deciding which ones should be served, and the system gets more balanced. It is noteworthy that these techniques affect which requests to serve, but not necessarily which routes to follow when doing so. In the context of ondemand delivery of goods, other anticipatory techniques have been proposed that look longer into the future, such as dynamic programming (Ulmer etÂ al. 2018) and scenariobased analyses (Voccia etÂ al. 2019). However, such techniques have been applied only in cases with small fleets.
In all, there is a vast literature showing that rebalancing techniques for idle vehicles can have significant impacts on the efficiency of ridepooling systems, but just a few papers that deal with the assignments and routes for vehicles that are actually being utilized, which might be the majority within the fleet. Such papers work over specific assignment methods, and usually require some knowledge either about historical data or future demand, instead of leveraging the information generated endogenously by the system when operated.
Contribution
The contributions of this paper are threefold:

1.
We propose two new methods to modify the decision scheme of a ridepooling system, aiming to face future requests with a better quality of service. Unlike previous works, these methods affect the systemâ€™s decision process at every stage and are compatible with different assignment procedures. The theoretical virtues and drawbacks of both methods are discussed in detail.

2.
We propose several ways to define generation and rejection rates per zone in the city, which are required by the anticipatory methods but can be used for other purposes as well. Such rates are computed using data that is endogenously generated when operating the system, so that no exogenous information or assumptions are required.

3.
We run detailed experiments to analyze under which conditions the methods improve the systemâ€™s performance, and propose various ways and metrics to analyze how vehiclesâ€™ routes are modified, allowing us to measure whether the methods push the system in the expected direction. Results show that the methods are able to improve the system, and that they do so by reducing the mismatch between the positions of vehicles and requests, i.e., the methods effectively allocate more vehicles in zones where they are needed to serve their large demand.
Two anticipatory methods
This paper proposes two anticipatory methods to modify already existing algorithms that decide how to assign requests and vehicles in an ondemand ridepooling system. The first one (â€śintroducing rewardsâ€ť) modifies how to value each possible route for a vehicle, impacting which route to select and how to assign vehicles to requests. The second method (â€śinsertion of artificial requestsâ€ť) includes future trips to the list of requests to be served, which imposes a heavier computational burden, but with the virtue of acting through a global evaluation of the system, moving some vehicles towards the origins of such future requests.
To explain both methods in detail, we first introduce some terminology and the formal statement of the assignment problem.
Problem statement
We aim to match requests together and assign them to vehicles efficiently, during some predefined period of operation that lasts PO. However, the requests that are going to be served are not known beforehand but emerge throughout the operation. Therefore, this problem belongs to the wellstudied family of stochastic optimization, as surveyed by Powell (2019), although we shall not assume any probability distribution for the unknown future events.
Terminology
Let us first introduce relevant terminology and notation^{Footnote 3}:

The problem takes place over a directed graph \(G=(V,E)\) representing the road network used by the vehicles.

A request r is a single call from a user (or a number of them traveling together) that emerges at time \(tr_r\), and needs to be transported from an origin \(o_r\) to a destination \(d_r\), both located on the nodes of the graph. The set of all requests that emerge during the period of operation is denoted \({\mathcal {R}}_{all}\). Requests that have emerged up to time t (i.e., such that \(tr_r \le t\)) can be divided into four sets: \({\mathcal {R}}_s(t), {\mathcal {R}}_e(t),{\mathcal {R}}_c(t)\) and \({\mathcal {R}}_r(t)\) representing, respectively, those that are being served by the system (either waiting for an assigned vehicle or enroute), those that have recently emerged and are waiting to be assigned, those that are completed and those that were rejected by the system. Note that, at the end of the operation (\(t=PO\)), it must hold that \({\mathcal {R}}_{all}= {\mathcal {R}}_s(t) \cup {\mathcal {R}}_e(t) \cup {\mathcal {R}}_c(t) \cup {\mathcal {R}}_r(t)\).

A vehicle v is characterized at each time t by its capacity \(\mu _v\), its current position \(Pos_v(t)\), a set of requests that it is currently serving \(Req_v(t)\), and its planned route \(\pi _v(t)\) (i.e., a path over the graph). The set of vehicles at time t is denoted \({\mathcal {V}}(t)\).

A trip \(T=(r_1,...,r_k)\) is a set of requests in \({\mathcal {R}}_e(t)\). Such a trip is feasible to be transported by a vehicle v at time t, if there exists a route \(\pi\) that serves the requests in T and in \(Req_v(t)\), fulfilling a set of constraints denoted by \({\mathcal {C}}\). Usual constraints include maximum waiting times and delay for each request, the vehiclesâ€™ capacities, and can consider some additional rules like FIFO (firstinfirstout).

Consider a feasible matching between a vehicle v and a trip T at time t, that instructs v to follow a new route \(\pi\). We define the cost \(c(v,T,\pi ,t)\) induced to the system, that might include the costs for requests in T, extra costs for requests in \(Req_v(t)\) (because the updated route might induce longer traveling times for such requests), and operatorâ€™s costs \(c_O\). Usersâ€™ costs \(c_U\) usually depend on the time they spend waiting to be picked up by a vehicle and the time spent enroute, and might also take into account other features such as the number of cotravelers or the discomfort induced by new changes on the vehicleâ€™s route (Fielbaum and AlonsoMora 2020).
A problem that is decided over time with partial information
As this is a dynamic problem, there will be a set of time instants \(\Psi =\{\tau _1,...,\tau _N\}\), such that at each instant \(\tau _i\) the system decides an assignment between \({\mathcal {V}}(\tau _i)\) and \({\mathcal {R}}_e(\tau _i)\), i.e., the system allocates the requests in \({\mathcal {R}}_e(\tau _i)\) (the ones waiting to be assigned) to the fleet of vehicles. How to define \(\Psi\) is a decision of the operator of the system. If the decisions are taken too often, the system will not collect much information each time, which might yield inefficient decisions; on the other hand, if there is a long lapse of time between two consecutive decisions, some requests will have to wait too long before getting assigned to a vehicle, yielding a bad quality of service.
Two usual approaches for defining \(\Psi\) are i) eventbased ones, in which each time a request emerges it is immediately assigned to a vehicle (like van Engelen etÂ al. 2018), i.e., \(\Psi =\{tr_r: r \in {\mathcal {R}}_{all} \}\) and ii) to perform an assignment process each fixed \(\delta\) (like AlonsoMora etÂ al. 2017a), i.e., \(\Psi =\{k \cdot \delta : k = 1,...,\lceil PO/\delta \rceil \}\). The first approach could be easily extended to assign each time a fixed number of b requests have emerged. According to the terminology discussed by Powell (2019), the first approach corresponds to an online algorithm, while the second one is a receding horizon (or model predictive control, or rolling horizon). Both ideas share that no knowledge about the future is assumed, a characteristic that we assume for the rest of the paper. Instead, we will exploit the fact that there is some correlation between recent and upcoming demand.
Consider a time \(\tau _i \in \Psi\). Formally, an assignment A decided at that time is a set of vehicletriproute tuples \((v,T,\pi )\), so that v is told to serve T following the route \(\pi\), with \(T \subseteq {\mathcal {R}}_e(\tau _i)\). An assignment is feasible if every matching between a vehicle and a trip fulfills the constraints \({\mathcal {C}}\), every vehicle is assigned to no more than one trip, and every request is assigned to no more than one vehicle. Note that some requests might not be assigned to any vehicle, forming the set of rejected requests \(Q(\tau _i,A)\). An assignment might include reassignments, i.e., updating some decisions taken before; for instance, it could modify the vehicle assigned to a request that has not been picked up yet, which is formally done by keeping those requests in \({\mathcal {R}}_e(\tau _i)\).
The set of all possible feasible assignments at time \(\tau _i\) is denoted by \({\mathcal {A}}({\mathcal {R}}_e(\tau _i),{\mathcal {V}} (\tau _i),{\mathcal {C}})\). Each assignment A has a total cost that depends on the specific costs \(c(v,T,\pi ,\tau _i)\) for each tuple \((v,T,\pi ) \in A\), and a penalty for the rejections \(c_R(Q(\tau _i,A))\) (for instance, proportional to the size of \(Q(\tau _i,A)\)). Once an assignment has been decided, each vehicleâ€™s information is updated, as well as the status of each request (i.e., to which \({\mathcal {R}}_{\bullet }(\tau _{i+1})\) they belong).
The assignment problem over the period of operation
Putting everything together, we can now formally define the assignment problem. With no future information^{Footnote 4}, the assignment problem consists in solving Eq. (1) iteratively at each \(\tau _i\):
Intuitively, Eq. (1) selects an assignment between the requests to be assigned and the vehicles, minimizing the total costs of the system, which is determined by the costs faced by each tripvehicle assignment and the penalty due to the rejected requests.
The whole process is synthesized in FigureÂ 3. At each stage (i.e., at each \(\tau _i \in \Psi\)), the requests in \({\mathcal {R}}_e\) have to be assigned to the current status of the vehicles. The anticipatory techniques we propose in this paper alter how to choose the optimal assignment, represented by the thick red arrow in FigureÂ 3. This new assignment (with or without anticipatory techniques) updates the vehiclesâ€™ routes, which defines the new status of the system until a new set of requests is inputted into the system, and a new stage begins.
Determining the feasible assignments \({\mathcal {A}}({\mathcal {R}}_e(\tau _i),{\mathcal {V}} (\tau _i),{\mathcal {C}})\), as well as solving Eq. (1), can be challenging from a combinatorial point of view, so some heuristics might be applied throughout the process, yielding to approximate solutions.
For synthesis, to decide how to form the groups and how to assign the vehicles, a method needs to define: \(\Psi\), the cost functions, the constraints, and the techniques to compute \({\mathcal {A}}({\mathcal {R}}_{e}(\tau _i),{\mathcal {V}} (\tau _i),{\mathcal {C}})\) and to solve Eq. (1). We encompass all of this with the concept of assignment procedure \({\mathcal {P}}\). This concept is useful, because the anticipatory techniques will work on top of a predefined assignment procedure (for instance, when we run numerical simulations we will use the assignment procedure by AlonsoMora etÂ al. (2017a)).
In â€śAssignment introducing rewardsâ€ť and â€śAssignment inserting future artificial requestsâ€ť sectionsÂ we propose techniques that affect how to solve one stage of the system, i.e., how to compute the assignments for a fixed \(\tau _i\). The idea is to obtain a feasible assignment in \({\mathcal {A}}({\mathcal {R}}_e (\tau _i),{\mathcal {V}}(\tau _i),{\mathcal {C}})\), whose cost might be higher than the optimal, but that yields better results in subsequent stages. The purpose is to reduce total costs at the end of the operation, i.e., to minimize the aposterioricostfunction given by Eq. (2). There, \({\mathcal {R}}_{ok}\) is the set of all the requests that were served at the end of the operation, \({\mathcal {R}}_{ko}\) are those that were rejected, and \(\Pi _{v}\) is the plan followed by v through the operation; \(c_U,c_R\) and \(c_O\) represent the costs of the served users, the rejected users and the operator, respectively. It is worth noting that Eq. (2) cannot be computed by adding up the value reached by Eq. (1) at every \(\tau _i\), because some of the requests that are assigned at \(\tau _i\) might be reassigned to a different vehicle (or even rejected) at future assignments, which is why we need to compute everything a posteriori.
As the demand is not known beforehand, this function cannot be optimized a priori, but it is the underlying objective of the whole process, so it provides the benchmark to determine if the anticipatory techniques do improve the systemâ€™s performance.
In Assignment introducing rewardsâ€ť and â€śAssignment inserting future artificial requestsâ€ť sections, we assume that we have an assignment procedure. That is to say, we propose anticipatory techniques for generic definitions of the set \(\Psi\), constraints \({\mathcal {C}}\) and cost functions \(c(T,v,\pi ,\tau _i)\), and we explicitly explain when we require some extra assumptions on any of them. To simplify the notation, we omit the reference to \(\tau _i\), because it is fixed. Numerical simulations in â€śNumerical simulationsâ€ť sectionÂ utilize a particular assignment procedure (by AlonsoMora etÂ al. (2017a)) that is explained in that same section.
Assignment introducing rewards
The first assignment method we propose consists in modifying the cost functions of feasible assignments to favor those that move the vehicles towards highdemand zones. Without any anticipatory technique, the system does not account for where the vehicle will be situated when new requests emerge, so we aim to face this issue by affecting the optimization procedure (Eq.Â 1) by reducing the costs of those routes and assignments that instruct the vehicles to move toward more convenient locations for the future.
Recall that \(c(v,T,\pi )\) is the original cost (without anticipatory methods) of inserting trip T into vehicle v if the updated route including T is \(\pi\) (that is required to serve all requests in T and all the previous requests being served by v). The route before inserting the new trip is \(\pi _v\). The anticipatory routing and assignment are achieved by modifying this cost function, adding a reward R, which is a (negative) additive term:
The impact of Eq. (3) on the system can be twofold: on the one hand, if v is assigned to serve T, there might be more than one feasible route that fulfills all the constraints \({\mathcal {C}}\), so usually (and we assume this is the case for the analyses that follow) the route is chosen minimizing the cost function; thus, different routes might be selected when using \(c_A\) instead of c. On the other hand, the decision of which vehicles assign to which trips is taken minimizing the sum of the costs of the selected assignments (Eq.Â 1), a procedure that yields different results when \(c_A\) is used instead of c.
Parameter \(\Theta\) in Eq. (3) is a tuning parameter that controls how much weight is given to the reward. The same \(\Theta\) is used everywhere in the network, meaning that the differences across zones depend solely on the reward R. Low values of \(\Theta\) would have almost no impact. When \(\Theta\) increases, some vehicles will take routes that are not the shortest ones and induce higher waiting times and detours for current users, so VHT (vehiclehourstraveled) should increase, as well as usersâ€™ total travel times^{Footnote 5}. However, if the method effectively locates the vehicles into better positions concerning future demand, the number of rejections will decrease. Waiting times for current passengers will increase (again, because the selection of the optimal route is modified by Eq.Â 3), but might decrease for future ones, making the global effect uncertain. If \(\Theta\) is too high, the system might get degraded in all its indicators, as the primary purpose of the system will be getting better prepared for the future, without looking at current users and inducing very long detours.
We provide the pseudocode description of the method in Algorithm 1. Recall that we are solving a single stage of the overall assignment problem (a specific \(\tau _i\)), meaning that the set \({\mathcal {R}}_e\) contains those requests that are to be assigned at that specific time. We assume some assignment procedure \({\mathcal {P}}\) is going to be modified by the rewards, and we highlight in bold the steps affected by the rewards (steps 3 and 5). Introducing rewards first affects how to determine the routes, where we admit that \({\mathcal {P}}\) might consider some rules (e.g., FIFO) that must be respected when optimizing (step 3), and then affects the decision of which vehicles are serving which requests (step 5). Note that even if \({\mathcal {P}}\) is eventbased, i.e., if it assigns requests individually as soon as they appear, these modifications are still valid.
The crucial question is how to define the reward R. We propose several specifications (explained in detail in â€śDifferent definitions for generation and rejection ratesâ€ť section); for the sake of simplicity, all of them depend on some characteristics of a particular node of the induced route \(\pi\). Two questions naturally arise: which node to look at, and what to observe from that node? We study two possible answers for both questions. Let us begin with the first one:

The rewards will be a function of one specific node in \(\pi\):

The last node of \(\pi\), denoted as \(LN(\pi )\), or

The first node u in \(\pi\) verifying the following condition: the vehicle has idle capacity after visiting u, and it does not get full in any node afterward. This node is called â€śidle nodeâ€ť and is denoted \(IN(v,T,\pi )\).

An example of these definitions is provided in FigureÂ 4, in which a vehicle has idle capacity before its last node, so IN and LN do not coincide. Note that \(LN(\pi )\) depends only on the route, whereas \(IN(v,T,\pi )\) also depends on the vehicle and the trip. We now turn to analyze what to look at in the selected node.

Given the node u (either \(u=LN(\pi )\) or \(u=IN(v,T,\pi )\)), the reward at time t will be a function of:
There might be several ways to define the generation and rejection rate of a particular node. We propose three methods, explained in â€śDifferent definitions for generation and rejection ratesâ€ť sectionÂ . As discussed inÂ â€śProblem statementâ€ť, none of these definitions shall require any knowledge about the future. We do consider a fourth method as a benchmark that is based on historical requests, which does not imply assumptions regarding the future but require exogenous data.
Analysis and discussion: Some characteristics, virtues, and drawbacks of this method can be identified, regardless of the assignment method and of the specific scenario in which it is applied.
Parameter \(\Theta\) controls the impact of the method. Note that as routes and assignments are discrete decisions, there are specific values of \(\Theta\) in which the system is modified. That is, there exists \(\Theta _1, \Theta _2, ..., \Theta _Q\) such that when \(\Theta\) reaches each of them, some decision changes: either a vehicle changes the order in which to serve its assigned requests, or some assignment between vehicles and users is modified. Therefore, selecting \(\Theta\) means deciding how many of these changes are introduced.
Let us analyze the advantages of this method. One of the main difficulties of optimizing ridepooling systems is related to the computational time required to decide the assignments: The number of feasible trips can be huge, and each tripvehicle combination requires some computation as different routes can be followed. The rewards work over exactly the same set of feasible solutions (in other words, the set \({\mathcal {A}}\) from Eq.Â 1 remains the same, but the cost of each \(A \in {\mathcal {A}}\) is adapted), so if an assignment procedure has been shown to work properly in regard to the computational burden, this will continue to be true when this anticipatory method is included.
Another virtue of this method is its predictability. It affects the system in a clearcut way, pushing some vehicles to move more often towards the most demanded zones (or with the highest rejection rates) instead of going elsewhere. Therefore, we can know in which scenarios we should expect this technique to perform well: when vehicles can choose whether to go to a highdemand zone or to a lowdemand one. Note that in the extremely unbalanced scenario depicted in FigureÂ 1, vehicles have no choice but going to the unique destination, so that rewards would play no role there. However, if requests are emerging from different places within a city (which is the usual reallife case), vehicles do have a choice.
This technique does not increase at all the computational time because it affects the system only at an â€śindividual levelâ€ť, i.e., at each combination of vehicle and trip. This is also a disadvantage, as no global analysis of the system performance is included. In other words, we modify the cost of each feasible assignment, which enters as an input to the overall decision that remains otherwise unaffected. In particular, all the rewards point towards the same directions, and there is no explicit control of how many vehicles are indeed directed towards each zone, so that a new imbalance might be induced. The value of \(\Theta\) plays a key role here: as the rewards are included in the cost function, they will affect the behavior of the vehicles only if the reward is large enough to compensate the difference in the original costs between the routes or assignments being compared. Therefore, the larger the \(\Theta\), the more number of vehicles affected. We require tuning this parameter to find intermediate values that affect the system, but not all the vehicles.
Assignment inserting future artificial requests
The method explained above has the virtue of affecting the systemâ€™s decisions at every level (routing and assignments). However, it lacks a global insight into the systemâ€™s performance: all the rewards are evaluated equally if evaluated in the same nodes, so all the vehicles are pointed towards the same zones. There is no mechanism to achieve a balance at a wholenetwork level. With this in mind, we implement a method based on AlonsoMora etÂ al. (2017b) but able to work with different generation rates (other than requiring historical data) and assignment procedures (other than the one from AlonsoMora etÂ al. (2017a)).
As the introducing rewards method, this method can also be used with different assignment procedures, as long as they can handle requests with future request times, and that the reject penalty from Eq. (1) is a fixed value per rejected request, i.e., that the cost of rejecting a set Q of requests is defined as some rejection penalty \(p_{KO}\) times the size of Q.
Recall that we are deciding how to assign the vehicles to a set of requests during a single stage of the whole operation. At a highlevel description, this anticipatory method consists in adding to that set of requests some future artificial ones, whose origins are located in highdemand zones, so that some vehicles might get assigned to them and move towards their origins:

First, define a generation rate per node. The same generation rates used to define the rewards will be considered, which are explained in â€śDifferent definitions for generation and rejection ratesâ€ť section.

Second, generate m artificial random requests whose:

Origins are selected randomly, following a distribution given by the generation rates.

Destinations are selected such that the length of the artificial requests is similar to the average length of the real ones. This is done to yield operatorâ€™s costs that are close to the ones of the real requests. By this means, the operatorâ€™s costs do not play a too determinant role when deciding whether to serve the artificial requests.

Times at which they emerge are \(\tau _i+k\cdot \phi\) with \(k=1 ,...,m\), where \(\tau _i\) is the current time and \(\phi\) is some parameter (that has time units). Artificial requests are equidistant in time to prevent them from being too close, which could make them either impossible to group (if they are close in space), or feasibly to be matched with any vehicle (in the opposite case). Therefore, \(\phi\) should be large enough so that the artificial requests are not too close to each other, but not too large so that some future requests could be matched with the current ones.

The assignments are decided following the same original assignment procedure, considering both the real and the artificial requests. Artificial requests, however, present a lower rejection penalty \(p_{KO}'=\Gamma \cdot p_{KO}\), where \(p_{KO}\) is the rejection penalty for a real request and \(\Gamma \in (0,1)\).

The artificial requests are erased after deciding the assignment and updating vehicles positions. That is, they are not kept in vehiclesâ€™ lists. Therefore, they are never served, and they do not affect subsequent assignments. They only impact the immediate routes followed by the vehicles.

We provide a pseudocode description of the method in Algorithm 2. The artificial requests are created in step 2 and participate in all the following steps of the assignment procedure.
Analysis and discussion: First, let us understand how the system compares the costs of future requests with those of real requests. Usersâ€™ costs of a future request are usually low because vehicles can arrive before the future request yielding zero waiting times. On the other hand, the destinations of futures requests are defined so that the operatorâ€™s costs are similar for real and future requests. Therefore, parameter \(\Gamma\) plays a key role. If \(\Gamma\) is close to 1, i.e., if the rejection penalty is almost the same for future and real requests, then artificial requests are less costly (due to the usersâ€™ costs) than the real ones, and the system will always prioritize them. In the opposite case, if \(\Gamma \approx 0\) then future requests will never be selected because rejecting them is almost costless. Therefore, it is crucial to select a balanced value for this parameter, so that the system selects only those artificial requests that could be served very efficiently, i.e., when moving the vehicles towards their origins is not too costly.
A virtue of this method is that it considers the set of vehicles as a whole. Indeed, future requests are assigned to the vehicles together with the current ones, so no more than one vehicle will be directed to each artificial request. Moreover, an artificial request might be rejected if serving it is too costly, i.e., if the system needs to make a considerable effort to move some vehicle towards its origin. Therefore, this mechanism is balanced at a wholenetwork level.
Although the method directly affects the algorithm only when deciding the assignments, routes are altered as well, and differently than when introducing rewards. To see this, consider the following example: a vehicle is on its way to pick up a passenger p, but the new assignment sends it to pickup a future request r first. Although the vehicle is not necessarily arriving at the origin of r, its route is modified until the system updates its assignments. Therefore, when this method is applied, the vehicle does not always follow the shortest paths between consecutive stops. Although this induced detour might be seen as a drawback, it is actually something pursued by the anticipatory method, as the new route will likely cross some highdemand areas that increase the chance of receiving a new passenger while driving there.
However, there are also drawbacks. This technique increases the computational load, as new requests imply new feasible trips. Moreover, as the emerging time of the artificial requests is in the future, a large portion of the vehicles can get to their origins before the respective request times; therefore, most feasible trips containing only real requests can be combined with many subsets of future requests, leading to an increment in the number of trips that might be exponential. In many ridepooling algorithms (like the one proposed by AlonsoMora etÂ al. (2017a), which we use here in the simulations), computing the feasible vehicletrips matching is the heaviest burden, which might become much slower with future requests.
Moreover, the impact of the artificial requests on the system is hard to predict. Three types of effects can be identified: first, some vehicles that could have become idle without this method will move towards the artificial origins, which is similar to the rebalancing steps that are usually present in these models (see â€śRebalancing and predictive methodsâ€ť section); second, some vehicles will add future requests to their nonempty lists of requests they are serving, which will modify the route in which these real requests are visited; and third, some vehicles might have to decide if serving a future request or a real one. The first effect is not too relevant, as a rebalancer could replace it; the second effect is the one we pursue; the third effect might be troublesome because if a vehicle prioritizes serving the future request, the technique will induce some rejections that could be saved. Again, selecting a \(\Gamma\) that allows for the second effect and not for the third one is ideal, but it might not be possible. Such a parameter is again constant throughout the network, so that all the differences between nodes get captured by the origins of the artificial requests.
Different definitions for generation and rejection rates
There can be several ways to define the generation and rejection rates for a specific node. Here we focus on definitions that can be computed utilizing only the information that is generated by the system while operating, so that we do not require any exogenous information. To be precise, at time \(\tau\) we will only look at the origins of the requests that have emerged throughout the period of operation until \(\tau\): while the generation rates can use all this information, the rejection rates consider solely the origins of those requests that have been rejected by the system.
To be concrete, we consider three definitions: a basic one (\(Gen_B, Rej_B\)), a smoothed one (\(Gen_S, Rej_S\)), and one based on particle filters (\(Gen_{PF}, Rej_{PF}\)). Moreover, we also consider an additional way to compute the generation rates that is based on historical data (\(Gen_H\)), so that we can evaluate whether using recent information is more appropriate; we cannot use historical data to compute a rejection rate, as rejections depend not only on the exogenous requests but also on the operation of the system. The first two methods are calculated for each node, whereas the other two need to first cluster the nodes in the graph into zones. The temporal evolution of the system plays a role in the definitions that follow, so it is worth including the explicit reference to the decision times \(\tau _i\). We now explain each rate in detail:
Basic rates
The simplest way to define the generation (rejection) rate of a node u is to look at the number of requests that have just been generated (rejected) at u. Note that the generation rate depends only on the set of requests, and the rejection rate also depends on how they are assigned. Denoting \(Rej(\tau _i,u)\) as the number of requests emerging from u that were rejected by the system at the corresponding assignment, the basic rates are defined by:
For \(i=1\), the rejection rates are defined as zero everywhere.
Eq.Â 4 considers, for each node u, the number of requests that emerged since the last assignment, and the number of requests rejected in the last assignment, respectively. The intuition is straightforward: a node having a large generation rate means that many users currently require a vehicle there, so it is worth directing part of the fleet in that direction. On the other hand, a large rejection rate represents a lack of vehicles in the last assignment.
Despite being an intuitive method, it might be somewhat unstable: as the \(\tau _i\) cannot be too widely spaced in time, the chance that a node has no requests is high, and the randomness might play a too relevant role.
Smooth rates
The aim of anticipatory routing is that vehicles remain closer to where demand is expected. From that point of view, the rates of a node could also consider the information of its neighboring nodes: for instance, it might be better for a vehicle to be in a node that does not generate requests if all its neighbors do. With this in mind, the \(Gen_S\) and \(Rej_S\) rates are defined considering also the requests that depart from close nodes:
Where \(t_V(x,y)\) is the timelength of the fastest path between x and y, and \(\psi\) is a tuning parameter (the higher this parameter, the more uniform the resulting rates). This method is called â€śsmooth ratesâ€ť because rates become more stable in space. Note that all nodes are included in Eq. (5), but distant nodes do not affect much.
Particle filters
This method applies the ideas from Wallar et al. (2018) (based on the particle filter methods proposed by Arulampalam etÂ al. (2002)) to calculate the generation/rejection rates of a zone, although (Wallar et al. 2018) used it for rebalancing purpose. It requires first dividing the nodes into clusters \(C_1,...,C_M\), which are obtained by minimizing the number of required â€ścentersâ€ť, such that each node in the network can be reached from at least one center in a time lower than a parameter \(t_M\). This problem is solved through an ILP that is fully described in Wallar et al. (2018), and each node is then assigned to its closest center. All the nodes assign to the same center comprise a zone. Note that by this method all the zones have a similar area. This is crucial to have rates that are comparable (otherwise, larger zones could present higher absolute rates but having a lower density of requests, so that it would be unclear whether to prioritize them).
Once the M centers and zones have been obtained, auxiliary variables (that represent a proxy for the rates) \(\lambda _{z\ell }\) are defined for each zone z and for \(\ell =1,...,\eta\), where \(\eta\) is a large number of Montecarlo simulations. Each \(\lambda _{z\ell }\) has a weight \(w_{z\ell }\). These values will be updated at each \(\tau _i\), and the idea is that the rates at each zone are calculated as the weighted averages of the \(\lambda _{z\ell }\). To simplify the notation, we omit the reference to \(\tau _i\) when referring to variables z and w. Parameters \(\lambda _{z\ell }\) are initialized randomly, with \(w_{z\ell }=\frac{1}{\eta }\). Denoting \(G(z,\tau _i)=\sum _{u \in z} Gen_B(u,\tau _i)\) the generation rate of each zone, let us explain how rates are updated (the procedure is analogous for the rejection rates):

1.
For each zone z, \(\eta\) samples are selected (with replacement) from \(\lambda _{z\ell }\), with probabilities given by the weights \(w_{z\ell }\). These samples are denoted \(\overline{\lambda _{z\ell }}\).

2.
Variables \(\overline{\lambda _{z\ell }}\) are perturbed^{Footnote 6}: \(\lambda _{z\ell }=\overline{\lambda _{z\ell }} +{\eta }(0,\sigma ^2)\), with \(\sigma ^2\) a â€śvolatility parameterâ€ť.

3.
Weights are updated according to the observed generation rate of the zone, as the probability that a Poisson process of parameter \(\lambda _{z\ell }\) reaches the generation rate of the zone: \(\overline{w_{z\ell }}=e^{\lambda _{z\ell }} \frac{\lambda _{z\ell }^{G(z,\tau _i)}}{G(z,\tau _i)!}\). By these means, those \(\lambda _{z\ell }\) that are closer to the observed rates get a higher weight, which affects the calculated generation rate (step 5) and the next update (in \(\tau _{i+1}\)) for \(\lambda _{z\ell }\) (step 1).

4.
Weights are normalized: \(w_{z\ell }=\frac{\overline{w_{z\ell }}}{\sum _{j=1}^N \overline{w_{zj}}}\)

5.
Generation rates for each zone are calculated as the weighted averages: \(Gen_{PF}(z,\tau _i)=\sum _{\ell =1}^\eta w_{z\ell } \lambda _{z\ell }\). Each node \(u \in z\) has the same generation rate \(Gen_{PF}(u,\tau _i)=Gen_{PF}(z,\tau _i)\).
Using zones instead of single nodes might make the system more robust as it does not depend on events on single nodes, but changes in the boundaries of a zone might be troublesome. The particle filter method has the virtue of providing some temporal stability, as the parameters \(\lambda _{z\ell }\) are updated at each \(\tau _i\) from their previous values (see step 3 above). However, the stability might be a problem when big changes take place (for instance, when passing from the peak to the offpeak period).
An additional definition and comparison of the rates
As explained above, we only use information that is endogenously generated by the system when assigning. The only exception is the rates we explain now, which are based on exogenous historical data so that they might be used as a benchmark to analyze how useful current requests are to approximate what will happen in the near future. Note that using historical data does not violate the principle of not requiring any assumptions regarding future requests (e.g., in the form of a probability distribution).
This method adapts the ideas from AlonsoMora etÂ al. (2017b). They also divide the nodes into clusters, so we keep here the technique used for the particle filter method (previous subsection). Then, they estimate the number of requests emerging from a zone using a historical dataset. Which dataset to use is not a trivial issue, as transport demand can be heavily affected by weather, traffic events, recent transportrelated changes such as new transit/metro lines or new highways or urban projects, among others (BĂ¶cker etÂ al. 2013; Zhou et al. 2013; Xue et al. 2015; Pereira etÂ al. 2014; Liu etÂ al. 2021), which makes databased demand prediction a quite complex challenge, beyond the scope of this paper. Nevertheless, we do take this discussion into account: instead of considering a whole year of data (as AlonsoMora etÂ al. 2017b), we use only some weekdays in the past, which are expected to have more similar weather (same season) and fewer differences in the private and public transport networks. Denoting \({\mathcal {D}}\) the set of days in the dataset, and \(G(u,d,t_1,t_2)\) the number of requests emerging from node u during \((t_1 ,t_2)\) on day d:
With all the zones beginning with a nil generation rate. And
We only use this method for generation rates, as there is no such thing as â€śhistorical rejection ratesâ€ť. The advantages of this method relate to the potential predictive power that historical data might provide, which can be particularly relevant when the demand faces sudden changes that will not be anticipated by methods that rely on the current and past states of the system. Therefore, it can be used to compare the results obtained by the other methods. On the other hand, historical data is not always available, and using it effectively for predicting the demand is not an easy task.
The three methods that are based on endogenous information use it to approximate the shortrun demand. A positive longrun effect is expected thanks to the continuous updates applied to the rates when requests emerge, which has to be tested in the numerical simulations.
A graphical comparison of the four methods based on generation rates is offered in FigureÂ 5, in which each nodeâ€™s color represents its generation rate at a particular time (the brighter the color, the higher the rate). Although all the methods present higher rates at the center of the network, the differences among them are highlighted as follows: in the basic method, most nodes present nil generation rate (black nodes), with a few nodes concentrating all the positive rates; the smooth method builds a much more continuous pattern, which yields positive values even in the extreme sectors of the network; the last two methods are based on zones, with the particle filter achieving a higher concentration at the center (brighter colors). The rejection rates cannot be shown at this point, as they depend on the specific conditions of the ridepooling system and not only on the demand itself.
The apparent differences among the resulting rates suggest that the effectiveness of the anticipatory techniques shall depend greatly on which rates are being used. Recall that we aim for balanced values for the parameters \(\Theta\) and \(\Gamma\) that control the weight of the anticipatory techniques. The larger the differences among the generation rates per node, the more significant the differences introduced by the anticipatory techniques when deciding the routes and assignments. In other words, while \(\Theta\) and \(\Gamma\) refer to the overall weight between current requests and anticipatory techniques, the intensity of a method refers to how distributed (more or less concentrated) this weights are in space. Therefore, having such varying rates provides yet another source of flexibility (together with the parameters \(\Theta\) and \(\Gamma\)) to control the anticipatory methods, which might enable better results.
Numerical simulations
In this section, we run simulations using over a reallife case using the assignment procedure by AlonsoMora etÂ al. (2017a). We first explain such a procedure (â€śThe assignment procedureâ€ť section), and then describe the reallife case (â€śThe reallife study caseâ€ť section) to present detailed results and sensibility analyses (â€śGlobal performance of the anticipatory methodsâ€ťâ€“â€śSensibility analysisâ€ť sections)).
The assignment procedure
The anticipatory ideas we propose in this paper are tested on top of the assignment procedure studied by AlonsoMora etÂ al. (2017a), which assigns passengers to vehicles. This procedure is based on deciding each \(\delta\) (here we use \(\delta = 1\ \hbox {minute}\)) how to assign the requests that have emerged during that lapse of time: how to group them, which vehicle (that might be serving some previous passengers) assign to each group, and in which order, i.e., \(\Psi =\{k \cdot \delta : k=1,...,\lceil PO/\delta \rceil \}\). The set of constraints \({\mathcal {C}}\) requires that the capacity of the vehicles is never exceeded, and deals with the quality of service, imposing that no served requests can face a waiting time large than some upper bound \(\Omega _w\), nor a total delay larger than \(\Omega _d\). We now explain how the assignments are decided in each iteration at time \(\tau _i\).

1.
First, for each request \(r \in {\mathcal {R}}_{e,\tau _i}\) and vehicle v it is analyzed if it is feasible that v serves r without violating the constraints \({\mathcal {C}}\). A heuristic might be implemented after this step to reduce the number of feasible requests (and thus, the computational time): for each request r, consider the set of all feasible to serve r, and discard the most costly ones.

2.
Assuming that the feasible assignments between vehicles and trips of size j are known (the previous bullet point explains the case \(j=1\)), study the feasible matches between vehicles and trips of size \(j+1\) based on the following fact: if an assignment between a trip and a vehicle is feasible, then the assignment between the same vehicle and all the subsets of that trip must be feasible as well. When a feasible link between a vehicle and a trip is found, it includes how to update the vehicleâ€™s route, which is done by minimizing the total additional costs (see Eq.Â 8 below for details), which can be done using an exhaustive search or some insertion heuristic.

3.
Build an ILP that decides which of the feasible tripvehicle assignments are taking place, ensuring that each request is either assigned to a single vehicle or rejected, and that each vehicle is assigned to no more than one trip. The objective function includes the costs of the chosen assignments, plus a penalty \(p_{KO}\) for each rejected request.

4.
A rebalancing step moves the idle vehicles, i.e., those that had no passengers before deciding the assignment and received none in step 3. They are moved towards the origins of the rejected requests through another ILP, minimizing the total distance driven by these vehicles and without sharing (i.e., no more than one rejected request can be assigned to each idle vehicle). Note that these vehicles are not actually meant to serve those rejected requests, so the feasibility constraints regarding waiting times, delay, and capacity of the vehicles are not included in this ILP.
Some comments are noteworthy:

In AlonsoMora etÂ al. (2017a), when the assignment is decided, those requests that are not picked up before \(\delta\) are kept for the next iteration, which allows the system to reassign. That is to say, these requests might be served by a different vehicle or can even become rejected, if doing so increases the total efficiency of the system. We introduce a slight modification in this paper: the first request that will be picked up (i.e., the next pickup in the vehicleâ€™s list) is not reassigned in the next iteration. This change is needed because when routing is modified through the anticipatory techniques, the time required to arrive at the first pickup might increase because the vehicle does not necessarily follow shortest paths; therefore, the number of accumulated requests for reassigning might increases, which has an exponential impact on the computational burden. Moreover, experiments show that this change reduces the number of rejections in the system.

If a reassignment of an individual request takes place, AlonsoMora etÂ al. (2017a) forbids an increase in the achieved waiting time (compared to the one of the previous assignment), while in Fielbaum etÂ al. (2021) they forbid rejections for a subset of the requests (those that are required to walk, an option that is not considered here). In this paper, requests that are being reassigned face the same constraints as the new requests and can be rejected.

Once a request becomes rejected, it is removed from the system, instead of kept for reassigning as done in AlonsoMora etÂ al. (2017a).
We use the following cost function when assigning trip T to vehicle v, if the route of the vehicle is updated from \(\pi _{v,\tau _i}\) to \(\pi\) (prior to introducing rewards):
Where the first line in Eq. (8) represents usersâ€™ costs: the first term refers to the waiting time \(t_w\) and the detour D faced by the requests r in the new trip, and the second term to the extra waiting time \(\Delta t_w\) and extra detour \(\Delta D\) imposed to the requests \(r_0\) that were already being served by the vehicle v, due to the changes induced to its route. Parameters \(p_w\) and \(p_v\) are the costs of one timeunit waiting and over the vehicle, respectively. The second line in Eq. (8) deals with the operatorâ€™s costs, which are proportional to the increase in the length of the route.
A detailed explanation of the assignment method per iteration, already affected by the anticipatory techniques, is shown in the pseudocode of Algorithm 3 that introduces rewards, where we say that \(c(v,T,\pi )=\infty\) if the assignment is unfeasible. The algorithm including future requests is the same, but considering c instead of \(c_A\), and adding the future requests to R at the beginning of the algorithm.
It is worth recalling that the anticipatory methods we propose here do not require this specific assignment procedure to work. Different assignment methods and different cost functions may also incorporate the anticipatory techniques explained above.
The reallife study case
The proposed methods are tested over a publicly available dataset of real trips performed by taxis in Manhattan, New York, that started between 12 p.m. on January 15th, 2013^{Footnote 7}. The total number of requests is 7,748, while 4,091 nodes and 9,452 edges form the city network. The numeric value of the chosen parameters is shown in the Appendix. Some conditions are modified to analyze the robustness of the system in â€śSensibility analysisâ€ť section.
A fleet of 1,000 vehicles of capacity 3 was considered. This is a small fleet, unable to serve all the demand. Having a significant rejection rate enables us to analyze the impact of the methods over rejections in a crisp way, as well as how anticipatory techniques affect the tradeoff between the number of served requests and the quality of service for those who are served. In â€śâ€ť section, we show that the main analyses and conclusions we obtain for this fleet remain vSensibility analysisalid when a larger fleet is used.
Let us first analyze the results obtained when only the methods that provide rewards at the routing stage are included (â€śAssignment introducing rewards: final node or first idle nodeâ€ť and Assignment introducing rewards: comparison of the different rates sections). We then study the effects of the artificial requests (â€śAssignment inserting future artificial requests: comparison of the different ratesâ€ť section), we compare the methods (â€śCoupling and comparison of the methodsâ€ť section), we study in detail the operational effects of the anticipatory techniques (â€śDetailed analysis of the impact over the systemâ€ť section), and we finally provide a sensibility analysis (â€śSensibility analysisâ€ť section).
Global performance of the anticipatory methods
Assignment introducing rewards: final node or first idle node
Recall that, as explained in â€śAssignment introducing rewards â€ť section, rewards depend on the generation rate of one of the nodes in the route that is being analyzed. FigureÂ 6 compares the results obtained when using the final node of the route (â€śLast nodeâ€ť in the images) versus using the first detention of the route from which there is always idle capacity (â€śIdle nodeâ€ť in FigureÂ 6), when using the basic rates, and considering three indicators of the quality of the system: Average usersâ€™ costs an adimensional value calculated as the weighted average of waiting times, total delays and number of rejections, according to the same parameters used in the optimization, including the rejection penalty, percentage of requests being rejected and VHT.
Results in FigureÂ 6 are questionless. When the reward depends on the idle node of the route, the impact is mild, but when it depends on the last node, it can be quite meaningful: compared to the case with no rewards (\(\Theta =0\)), the number of rejections can be reduced by a bit more than 10%, at the cost of increasing VHT in about 10%. Usersâ€™ costs also drop, but less significantly than rejections, meaning that delay and waiting times might increase. These changes will be studied in more detail in the following subsections that compare the different rates and methods. From now on, all the results are calculated with the rewards depending on the final node.
Assignment introducing rewards: comparison of the different rates
In â€śDifferent definitions for generation and rejection ratesâ€ť section, four definitions for the rates were provided: basic (B), smooth (S), calculated through particle filters (PF), and through historical data (H). The first three ones can be applied to generation or rejection rates of each node (that, as just explained, is the final node of the route), whereas historical data only gives generation rates. All this together makes seven methods to define the different rates.
The results obtained with each of these seven rates are shown in FigureÂ 7. The following conclusions emerge:

Some of the rates are much more effective in reducing the number of rejections and usersâ€™ costs than others. Two rates highlight as the best ones: \(Rej_{PF}\) and \(Gen_B\). While the former achieves the minimum values for the rejection rates and the usersâ€™ costs, the latter achieves slightly worse results in those measures, requiring a lower increase in VHT. It is worth saying that if \(\Theta\) is further increased, \(Gen_B\) does not longer improve its results.

The results of the best methods show that these rewards can be very fruitful. For instance, the number of rejected requests with \(Rej_{PF}\) drops from 3,025 to 2,631. Of course, whether this is good news depends on how opposing objectives are evaluated, as increasing VHT is unavoidable.

The tuning parameter \(\Theta\) emerges as a crucial issue for these models. Which is the best \(\Theta\) depends on what rate is being used. The good news is that for all of them, the range of values of \(\Theta\) that yields good results is wide, meaning that these methods are robust even if the optimal \(\Theta\) is not known.

Rates that are based on rejections have, in general, better results concerning both lower usersâ€™ costs and VHT. The only exception is \(Gen_B\), which increases VHT much less than \(Rej_B\), with similar (although worse) results regarding usersâ€™ costs.

Regarding smoothing rates, they can improve the system if based on rejections.

The rates based on historical data perform worse than the ones based on recent information. That is to say, our results highlight the potential of utilizing the information that is directly generated by the system.
To understand the tradeoff between the different userrelated quality measures better, FigureÂ 8 shows the average waiting time and average detour (i.e., the difference between each userâ€™s invehicle time and the timelength of the shortest path he/she could have followed), considering only the two rates that achieved the best results \(Gen_B\) and \(Rej_{PF}\). Indeed, both quality measures get worse when rewards are applied. However, recalling that \(Gen_B\) achieves its minimum reject rate at \(\Theta =6\) and \(Rej_{PF}\) at \(\Theta =2\), we can also conclude that there is some synergy between these objectives, as waiting times and detour do not increase that much for these optimal values of \(\Theta\).
As a synthesis, the introduction of rewards reduces the percentage of rejections of the system if the right generation or rejection rates are selected, at the cost of providing worse service for the users that are transported.
Assignment inserting future artificial requests: comparison of the different rates
The same four generation rates \(Gen_B, Gen_S, Gen_{PF}\) and \(Gen_H\) were used to determine the origin of m artificial requests. We take \(\phi =\delta\) (1 minute). Inserting future requests makes the algorithm much slower, as they can be combined with most of the current requests without violating the constraints regarding maximum waiting times and delay, which increases the number of feasible groups. To overcome this issue, we tighten the heuristic explained in step 2 of the assignment model (â€śThe assignment procedureâ€ť section), i.e., we discard a larger amount of feasiblebutcostly vehicles when analyzing trips of size one.
FiguresÂ 9 and 10 show the results when inserting the artificial trips with each of the generation rates. The baseline (in black) corresponds to the results shown in the previous subsection for \(\Theta =0\) (i.e., without tightening the heuristic that discards vehicles), whereas the results for \(\Gamma =0\) include the change on the heuristic and are equivalent to having no artificial requests. The comparison of the results against \(\Gamma =0\) shows the direct effect of introducing these artificial requests. However, the most relevant comparison is against the baseline because it is achieved if no artificial requests are added. Note that \(\Gamma =0\) (i.e., when the heuristic is tightened) includes more rejections than the baseline, but better results in the other indices (much lower waiting times and detours just a bit larger), which is a natural consequence of removing the most costly vehicles for each request: each request has fewer options to be served, but the options that remain are less costly, i.e., provide a better quality of service (recall that the cost is defined as the sum of usersâ€™ costs and operatorâ€™s costs).
In general, all the rates are able to reduce waiting times and detours significantly. The percentage of rejections, on the other hand, is always higher than in the baseline: when compared with \(\Gamma =0\), rejections are sometimes larger and sometimes fewer, but changes are always minor (these results are similar to the ones obtained by AlonsoMora etÂ al. (2017b)).
These results can be synthesized by stating that inserting artificial requests by itself improves the quality of service for those users that are transported, but the induced increase to the computational time requires using heuristics that might increase the number of rejections. The interpretation is as follows: Artificial requests effectively push the vehicles towards the origins of future requests. However, when they are inserted, they compete with current requests for the same vehicles so that sometimes the system will prioritize serving the artificial ones despite their lower rejection penalty. VHT always increases.
The method that achieves the best results is^{Footnote 8}\(Gen_B\): it presents the largest reduction in the rejection rate with \(\Gamma =\frac{1}{80}\), and in detours for \(\Gamma =\frac{1}{60}\). Reductions in waiting times are similar for all the generation rates, except for \(Gen_H\) when \(\Gamma =\frac{1}{40}\). Results obtained by \(Gen_S\) and \(Gen_{PF}\) are almost identical. The fact that \(Gen_H\) might yield the worst results if \(\Gamma\) is not properly selected (i.e., it is a less robust method) reinforces the conclusion that the direct use of past information can be an unfruitful idea for these transportation systems.
In all, the insertion of future requests achieves reductions precisely where rewards fail: waiting times and detours. This happens because both methods move the vehicles towards highdemand zones, but inserting future requests might yield to rejecting some real current ones, so that the gains in efficiency translate into waiting and delay for the requests that will emerge afterward.
Coupling and comparison of the methods
The different results obtained by the two methods proposed in this paper, introducing rewards and inserting artificial requests, might suggest that using both simultaneously is promising, as they achieve good performance in complementary indices. However, our simulations show the opposite. As they both push the system towards the same direction, the results are much worse when used together, as rejection rates jump from less than 40% in the baseline scenario to more than 50%. This bad news can be explained: rewards move the vehicles towards the same zones in which the future requests are inserted. If a vehicle has to choose between waiting for a future artificial request or serving a current real one, it might prioritize the future one despite its lower rejection rate, as being in a close position makes the cost of serving it very low.
Therefore, an operator should decide between using only one of the two methods. A detailed comparison among them is offered in FiguresÂ 1112, in which we show the results when running the methods for the real requests from ten consecutive weekdays, always between 12 p.m. We compare the baseline (no anticipatory techniques), and the best versions of each of the two methods: \(Gen_B\) with \(\Theta =6\) when introducing rewards, and \(Gen_B\) with \(\Gamma =\frac{1}{80}\) when inserting future artificial requests.
FiguresÂ 1112 synthesize the most relevant conclusions of the simulations. Both methods effectively impact the performance of the system, achieving different goals: whereas introducing rewards decreases the rejection rate of the system, including artificial future requests improves the quality of service for those requests that get served, and both methods require an increase in VHT. Moreover, these conclusions are robust, as they are shown to be valid for each of the ten days.
In general, introducing rewards is better for most situations, as serving more passengers is usually the most relevant purpose, even more recalling that waiting times and delay are always bounded. This method also has the virtue of not increasing the computational times at all. However, if the operator is most interested in improving the service for those passengers that are being served, inserting artificial requests is the best option.
Detailed analysis of the impact over the system
So far, we have analyzed the methods in terms of the most relevant indices of the system. However, when we introduced the need for this type of method, we justified it by analyzing the spatial heterogeneity of the results, and the influence of deciding without knowing the demand beforehand. Therefore, we now turn to analyze how the operation of the system is being modified. We focus on the method that introduces rewards, as it yields the best results, considering the rates \(Gen_B\) and \(Rej_{PF}\) that proved stronger.
Impact over the temporal evolution of the system
We first study how the number of rejections evolves in time, compared to the case with no anticipatory methods (\(\Theta =0\)). We know that \(Gen_B\) and \(Rej_{PF}\) have less rejection in total, but when does this happen? FigureÂ 13 shows how many rejections are being saved thanks to introducing rewards. This is done by depicting the difference between the accumulated rejections with no rewards, and the accumulated rejections with rewards for both rates: as before, the solid blue curve represents \(Gen_B\), and the dotted green curve represents \(Rej_{PF}\).
Both curves begin quite flat and even take negative values, meaning that in the first iterations, rewards worsen the systemâ€™s quality. The \(Rej_{PF}\)â€™s curve rapidly starts to increase (i.e., to have fewer rejections than the method with no anticipation), whereas \(Gen_B\) requires almost half an hour to do so, which verifies that the central motivation of these methods is achieved: modifying its current decisions to be better prepared for future requests. Note that, after about 40 minutes of operation, both methods reach an almostlinear increase, i.e., they keep saving rejections at a rate that keeps somewhat constant.
Impact over the spatial mismatch between vehicles and requests
We now analyze how the operation changes in space. We have noticed before that the most demanded zones were receiving a worse quality of service, so that more vehicles seemed to be required there. To analyze the changes, FigureÂ 14 shows, at the end of the hour that was modeled, the differences in the vehiclesâ€™ positions between having no anticipatory methods and \(Gen_B\) (left) or \(Rej_{PF}\) (right). We partition the whole map into the same zones used for the methods with particle filters and historical data, and each vehicle is assigned to the zone corresponding to its closest node. A red sector means that there were more vehicles assigned with rewards, whereas blue means the opposite: the more intense the color, the higher the difference.
Both Figures have almost only blue zones at the north of the network. In the center, intense red zones clearly dominate for \(Rej_{PF}\), and not so clearly for \(Gen_B\). That is to say, rewards are indeed moving some vehicles from the north of the network (a low demand area) to the center. It is worth saying that \(Gen_B\) makes no noticeable difference in the southwest (at the bottom of the network), while \(Rej_{PF}\) increases the number of vehicles there.
A similar analysis can be done to see where the rejects are concentrated. In FigureÂ 15, each zone is an origin, that is blue if the percentage of rejected requests emerging there was higher with no rewards than with \(Gen_B\) (left) or \(Rej_{PF}\) (right), and red in the opposite case. Again, the more intense color, the higher the difference. The reduction of the rejections rates in the central zones is apparent. Notably, we see that the overall reduction is achieved by increasing the number of rejections in some zones, mostly at the south and north of the network.
When describing methods that insert rewards, a possible drawback was identified: as there is no global control of the effects introduced by the rewards, many vehicles could be sent towards the same places, which could yield a worse mismatch between vehicles and requests than with no anticipatory methods. To analyze if this is the case, we create the following indices per zone z, also evaluated after 60 minutes. For each zone z, define \(v_z\) as the proportion of the vehicles inside z, and \(r_z\) as the proportion of current requests departing from z. A perfectly balanced system would require that \(v_z \approx r_z \forall z\). Therefore, a measure for the level of mismatch at z is:
We choose these absolute values rather than normalized so that highdemand zones weigh more when calculating average values of \(M_z\).
We now study how these values \(M_z\) change when anticipatory methods are used. We use \(Rej_{PF}\) for the comparison because it presents the largest impact on the system. A first analysis can be done by looking at the mean and median values of \(M_z\), which is shown in TableÂ 1. As apparent, the level of mismatch is reduced when using the anticipatory scheme. Note that the absolute numbers of \(M_z\) depend on many different structural aspects of the problem (such as fleet size, number of shareable requests, distances), so the relevant insight we obtain from TableÂ 2 is how the numbers change when the anticipatory method is included. It is also noteworthy that \(M_z\) might not take other relevant features into account (for instance, how shareable are the requests emerging from each zone), so the analysis is meaningful at a global scale rather than for specific conclusions.
Conclusions from TableÂ 1 are reinforced by looking at FigureÂ 16, in which we show the level of mismatch at each zone, without anticipatory methods (left), and using the rewards technique with \(Rej_{PF}\) (center). Introducing the rewards builds a figure with more dark zones, i.e., more zones with a low level of mismatch. The difference is mostly achieved at the north of the network. Recalling that the rewards remove vehicles from that area, we conclude that an oversupply is now prevented there.
In all, this subsection allows us to synthesize the impact of the rewards over the ridepooling system: using anticipatory rewards improves the system only after some initial lapse of time; the improvement is achieved by moving vehicles towards the highdemand zones, which decreases the quality of service in the lowdemand zones but achieves better overall results. Moving these cars decreases the mismatch between vehicles and requests.
Sensibility analysis
So far, we have shown results for a particular network, for a fixed demand and a given fleet. We now show that the proposed techniques are robust, i.e., that they also work properly under different conditions, although results are not exactly equal. In particular, the optimal values for \(\Theta\) and \(\Gamma\) are highly sensitive to the specific conditions.
Two alternative scenarios will be used for the sensibility analysis. In the first one, we serve the same demand and the same network, but using a fleet of 2000 vehicles of capacity 4, to study whether the methods are effective when the number of rejections is lower.
The second scenario uses data from Didi Udian, a real ridepooling company in Shenzhen, China. As ondemand ridepooling is an emerging mobility system, the scale is much smaller: 311 requests during 12 hours. The simulation considers a fleet of 10 vehicles of capacity 5. The network is formed by 5,502 arcs and 2,201 nodes, clustered into 96 zones. A heatmap exhibiting the location of the origins is shown in FigureÂ 17, showing that this case is of smaller case and presents a different demand structure, with two separated highdemand zones.
Sensibility of the method that introduces rewards
Let us begin analyzing the method that introduces rewards. We focus on the two rates that presented the best results in the previous sections: \(Gen_B\) and \(Rej_{PF}\). FigureÂ 18 shows the results in the same Manhattan case with a larger fleet of vehicles with a greater capacity. The most relevant conclusions are:

Introducing rewards can reduce the number of rejections even when this number is already low. The relative decrease is similar (about 10% of the original rejections), which means that the absolute decrease is less significant.

The best value for the parameter \(\Theta\), however, changes a lot. In the original scenario \(Gen_B\) should select \(\Theta =6\) and \(Rej_{PF}\) should select \(\Theta =2\), and now these numbers turn to \(\Theta =2\) and \(\Theta =2/3\), respectively. Using a smaller \(\Theta\) means that the rewards are less weighted in the objective function, which is reasonable as more vehicles can provide better results at the current time. A relevant question for future research emerges: how to determine the optimal \(\Theta\) according to the external and internal conditions of the system. Note that an erroneous selection for \(\Theta\) can lead to awful results, as shown by the \(Rej_{PF}\) curve when \(\Theta \ge 2\).

\(Gen_B\) presents much better results than \(Rej_{PF}\) in this context, as it increases VHT just mildly.
Shenzhenâ€™s case presents several differences. The low amount of requests and vehicles allows us to analyze whether the introducingrewards methods depend on some scale effects to be effective. Moreover, as we are now simulating 12 hours of operation, the longrun effects of this technique can be studied.
The small scale permits describing the results in a very synthetic way and are identical for \(Gen_B\) and \(Rej_{PF}\): the rejection rate drops from 40.8% to 37.3% when \(\Theta\) reaches 6 (there is no effect for lower \(\Theta\)), with VHT increasing from 26.9 to 27.6. That is, the results show that the methodology is sound, reducing rejections also in this scenario.
Sensibility of the method that includes future artificial requests
To analyze the robustness of this method, we consider the same two scenarios. We use the basic generation rate because it has presented the best results so far. When applied over Manhattan with a greater fleet of larger vehicles, results are exhibited in FiguresÂ 19 and 20. Results are consistent with the base scenario: this method allows for a reduction in waiting times and detours at the cost of increasing the number of rejections and VHT. However, the relative losses regarding rejection rates are worse here than in the base scenario, and the gains are similar, i.e., this method is less effective when using a larger fleet.
However, when solving the Shenzhen case (FiguresÂ 21 and 22), results are inverted compared with the base scenario: the rejection rate drops from 40.8% to 27.7% in the most extreme case (\(\Gamma =\frac{1}{60}\)), while average waiting time increases from 3 [min] to 3.29 [min] average detours from 0.45 [min] to 0.8 [min], and VHT increases from 26.9 to 36.1.
This situation might look paradoxical but can be explained. Let us first say that in this case, we only insert one future request per iteration (\(m=1\)) to preserve a proportion between real and artificial requests that is somewhat similar to the one used in Manhattan (where total future requests represent between a third and a half of total real requests). Nevertheless, the low number of real requests in Shenzhen implies that several iterations have none, meaning that the artificial requests are not competing with the real ones on those occasions; recall that such a competition was identified as the explanation of why the rejection rate could increase with this anticipatory technique. Moreover, no heuristic is needed in this case, which was the other crucial factor in explaining the increase in the rejection rate for the basic scenario.
In conclusion, we can state that this method outperforms the one that introduces rewards when the scale of the problem is small. Moreover, in the small scale case, the computational time (that was said to be a relevant drawback of this method) is not an issue at all.
Conclusions and future research
In this paper, we propose techniques to reduce the mismatch between vehiclesâ€™ positions and usersâ€™ origins that tends to occur in ondemand ridepooling systems (when the assignment decisions do not take the future into account). Our techniques only require the information that is generated when operating the system, by looking at the zones where most requests are emerging and being rejected.
We propose two anticipatory techniques that affect how to assign vehicles to users, and which routes are chosen to serve those assignments. In the first one, we modify the objective cost function by introducing a reward (a negative additive term) to each feasible matching between a vehicle and a group of requests, such that the reward increases when the vehicleâ€™s route finishes in a highdemand area. This technique acts at an individual level, i.e., it does not include control of the systemâ€™s operation as a whole, which permits not to increase the computational burden. The second technique includes artificial future requests emerging from the highdemand zones, to be assigned together with the real current ones, so that if a vehicle is assigned to a future request, it will be moved towards its origin. This technique yields a systemwide decision, at the cost of increasing the computational time, that might require including other heuristics to compensate.
How â€śhighdemandâ€ť an area is, is defined as a function of the number of requests emerging there (generation rates), or of the number of rejected requests that departed from there (rejection rates). We propose three ways of calculating the rates of a node: i) the direct number of users departing from it, ii) a spatial smoothing of that direct number, and iii) a temporal stabilization of that direct number through a particle filter method. The last one requires aggregating the nodes into zones.
These approaches are applied over the assignment method proposed by AlonsoMora etÂ al. (2017a), using Manhattan as a study case. Results reveal that introducing rewards effectively reduces the number of rejections, at the cost of increasing total delay for the served users. In contrast, the inclusion of artificial future requests reduces total delay but increasing the number of rejections unless the number of requests is small enough to have zero real requests during some minutes. Both methods require vehicles to move more. Results depend on the rates being used, and applying both methods together does not yield good results.
A detailed analysis of the impact of the rewards method over the systemâ€™s operation reveals that the immediate effect can be negative, but after some minutes, the system begins to show an enhanced performance, which is expected as these are anticipatory techniques. Vehicles are shown to be moved from low to highdemand areas, which might degrade the quality of service for users departing from lowdemand nodes, but the improvement in the highdemand zones outperforms this worse quality of service.
The fact that both techniques are able to achieve good results reveals that current and accumulated demand can be used as an effective proxy for the upcoming requests. However, if the system is operated in a scenario with very high stochasticity, with no correlation between the origins of the emerging users, this idea would not work well. If that was the case, it is noteworthy that both techniques can also be applied with exogenous information, such as historical data (as shown in this paper) or some assumed probability distribution.
As ondemand ridepooling is an emerging mobility system, there is plenty of room for future research. A relevant direction identified through the paper is the optimal selection of the parameters \(\Theta\) and \(\Gamma\), i.e., the relative weight of the anticipatory components. Different methods and scenarios require adapting \(\Theta\) and \(\Gamma\), so using a nonconstant value would be ideal. How to tune this value according to the external and internal conditions is a challenging and relevant question that could be addressed using learning procedures.
Our results suggest that the technique that introduces rewards is the most effective one to prevent rejections. Therefore, a relevant avenue for future research is how to further sophisticate it. For instance, by including an overall control step when deciding how to assign vehicles to users, in order to prevent that too many vehicles are directed towards the highdemand areas: this could be done either by lowering the rewards when more trips that end in the same area are selected, or by some adhoc heuristics such as geofencing (Reclus and Drouard 2009). Additional research questions deal with the relationship between these techniques and rebalancing methods: is it possible to adapt the rebalancers to take better advantage of the anticipatory techniques, and viceversa?
Notes
A full version of the video is available at https://youtu.be/xHWrRci0H54. Accessed: 29/06/2020.
Many rebalancing methods have been proposed for nonshared systems: (Yu etÂ al. 2019; Braverman etÂ al. 2019; Zhang and Pavone 2016; Pavone etÂ al. 2012; Gao etÂ al. 2018), among others. We are not studying them in detail here because there are fundamental differences when sharing is admitted. In the nonshared case, finding a single request as fast as possible is the best that can be done, whereas here, we aim to maximize the number of requests that a vehicle can find soon. In this last case, it is much more relevant to send the rebalancing vehicles to highdemand areas instead of zones in which is likely to find at least one request.
A glossary with all the math symbols used throughout the paper is provided in the appendixÂ (Table 1).
Other papers assume some probability distribution regarding future requests, so their approach is optimizing the expected value of the corresponding objective function.
Some studies consider VKT (vehicleskilometerstraveled) as a measure of operators costs that takes congestion into account. As in our simulations we are not considering congestion, we prefer to use VHT because it captures better some other negative externalities such as the noise.
An almostzero lower bound is required because negative rates are senseless. In our experiments, this bound was never reached.
See https://data.cityofnewyork.us/Transportation/2013YellowTaxiTripData/7rnvm532, accessed on 05/July/2021.
A sensibility analysis with respect to the number of artificial requests and their temporal distance preserves the same conclusions. When compared to the results exhibited in this subsection, waiting times and detours remain almost equal, whereas the number of rejections increases when inserting fewer future requests.
References
Agarwal, S., Mani, D., Telang, R.: The impact of ridehailing services on congestion: Evidence from indian cities. Available at SSRN 3410623 (2019)
AlonsoMora, J., Samaranayake, S., Wallar, A., Frazzoli, E., Rus, D.: Ondemand highcapacity ridesharing via dynamic tripvehicle assignment. Proceedings of the National Academy of Sciences 114(3), 462â€“467 (2017a)
AlonsoMora, J., Wallar, A., Rus, D.: Predictive routing for autonomous mobilityondemand systems with ridesharing. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3583â€“3590. (2017b)
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/nongaussian bayesian tracking. IEEE Transactions on signal processing 50(2), 174â€“188 (2002)
Barth, M., Todd, M., Xue, L.: Userbased vehicle relocation techniques for multiplestation shareduse vehicle systems. Transportation Research Record 1887, 137â€“144 (2004)
BĂ¶cker, L., Dijst, M., Prillwitz, J.: Impact of everyday weather on individual daily travel behaviours in perspective: a literature review. Transport reviews 33(1), 71â€“91 (2013)
Braverman, A., Dai, J.G., Liu, X., Ying, L.: Emptycar routing in ridesharing systems. Operations Research 67(5), 1437â€“1452 (2019)
Chang, S.K., Schonfeld, P.M.: Multiple period optimization of bus transit systems. Transportation Research Part B: Methodological 25(6), 453â€“478 (1991)
Daganzo, C.F.: Structure of competitive transit networks. Transportation Research Part B: Methodological 44(4), 434â€“446 (2010)
Diao, M., Kong, H., Zhao, J.: Impacts of transportation network companies on urban mobility. Nature Sustainability 4(6), 494â€“500 (2021)
dOrey, P. M., Fernandes, R., Ferreira, M.: Empirical evaluation of a dynamic and distributed taxisharing system. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, pages 140â€“146. IEEE. (2012)
Fagnant, D.J., Kockelman, K.M.: Dynamic ridesharing and fleet sizing for a system of shared autonomous vehicles in Austin. Texas. Transportation 45(1), 143â€“158 (2018)
Fielbaum, A., AlonsoMora, J.: Unreliability in ridesharing systems: measuring changes in usersâ€™ times due to new requests. Transportation Research Part C: Emerging Technologies, Forthcoming. (2020)
Fielbaum, A., Bai, X., AlonsoMora, J.: Ondemand ridesharing with optimized pickup and dropoff walking locations. Transportation Research Part C: Emerging Technologies 126, 103061 (2021)
Fielbaum, A., JaraDiaz, S., Gschwender, A.: Beyond the Mohring effect: Scale economies induced by transit lines structures design. Economics of Transportation 22, 100163 (2020)
Gao, J., Wang, Y., Tang, H., Yin, Z., Ni, L., Shen, Y.: An efficient dynamic ridesharing algorithm. In: 2017 IEEE International Conference on Computer and Information Technology (CIT), pages 320â€“325. IEEE. (2017)
Gao, Y., Jiang, D., Xu, Y.: Optimize taxi driving strategies based on reinforcement learning. International Journal of Geographical Information Science 32(8), 1677â€“1696 (2018)
Haliem, M., Mani, G., Aggarwal, V., Bhargava, B.: A distributed modelfree ridesharing approach for joint matching, pricing, and dispatching using deep reinforcement learning. arXiv preprint arXiv:2010.01755. (2020)
Henao, A., Marshall, W.E.: The impact of ridehailing on vehicle miles traveled. Transportation 46(6), 2173â€“2194 (2019)
Huang, X., Peng, H.: Efficient mobilityondemand system with ridesharing. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pages 3633â€“3638. IEEE. (2018)
Hyland, M., Mahmassani, H.S.: Operational benefits and challenges of sharedride automated mobilityondemand services. Transportation Research Part A: Policy and Practice 134, 251â€“270 (2020)
Kucharski, R., Cats, O.: Exact matching of attractive shared rides (ExMAS) for systemwide strategic evaluations. Transportation Research Part B: Methodological 139, 285â€“310 (2020)
Kucharski, R., Fielbaum, A., AlonsoMora, J., Cats, O.: If you are late, everyone is late: Late passenger arrival and ridepooling systemsâ€™ performance. Transportmetrica A: Transport Science, Forthcoming
Levin, M.W., Kockelman, K.M., Boyles, S.D., Li, T.: A general framework for modeling shared autonomous vehicles with dynamic networkloading and dynamic ridesharing application. Computers, Environment and Urban Systems 64, 373â€“383 (2017)
Li, W., Pu, Z., Li, Y., Tu, M.: How does ridesplitting reduce emissions from ridesourcing? a spatiotemporal analysis in chengdu, china. Transportation Research Part D: Transport and Environment 95, 102885 (2021)
Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient largescale fleet management via multiagent deep reinforcement learning. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1774â€“1783. (2018)
Lioris, J., Cohen, G., Seidowsky, R., Salem, H.H.: Dynamic evolution and optimisation of an urban collective taxis systems by discreteevent simulation. In: ITS World Congress 2016, Melbourne, Australia. (2016)
Liu, S., Jiang, H., Chen, Z.: Quantifying the impact of weather on ridehailing ridership: Evidence from haikou, china. Travel Behaviour and Society 24, 257â€“269 (2021)
Liu, Y., Samaranayake, S.: Proactive rebalancing and speedup techniques for ondemand high capacity ridesourcing services. IEEE Transactions on Intelligent Transportation Systems (2020)
Liu, Z., Miwa, T., Zeng, W., Bell, M.G., Morikawa, T.: Dynamic shared autonomous taxi system considering ontime arrival reliability. Transportation Research Part C: Emerging Technologies 103, 281â€“297 (2019)
Lokhandwala, M., Cai, H.: Dynamic ride sharing using traditional taxis and shared autonomous taxis: A case study of nyc. Transportation Research Part C: Emerging Technologies 97, 45â€“60 (2018)
Merlin, L.A.: Comparing automated shared taxis and conventional bus transit for a small city. Journal of Public Transportation 20(2), 2 (2017)
Mohring, H.: Optimization and scale economies in urban bus transportation. The American Economic Review 62(4), 591â€“604 (1972)
Ota, M., Vo, H., Silva, C., Freire, J.: Stars: Simulating taxi ride sharing at scale. IEEE Transactions on Big Data 3(3), 349â€“361 (2016)
Pavone, M., Smith, S.L., Frazzoli, E., Rus, D.: Robotic load balancing for mobilityondemand systems. The International Journal of Robotics Research 31(7), 839â€“854 (2012)
Pelzer, D., Xiao, J., Zehe, D., Lees, M.H., Knoll, A.C., Aydt, H.: A partitionbased match making algorithm for dynamic ridesharing. IEEE Transactions on Intelligent Transportation Systems 16(5), 2587â€“2598 (2015)
Pereira, F.C., Bazzan, A.L., BenAkiva, M.: The role of context in transport prediction. IEEE Intelligent Systems 29(1), 76â€“80 (2014)
Powell, W.B.: A unified framework for stochastic optimization. European Journal of Operational Research 275(3), 795â€“821 (2019)
Qian, X., Zhang, W., Ukkusuri, S.V., Yang, C.: Optimal assignment and incentive design in the taxi group ride problem. Transportation Research Part B: Methodological 103, 208â€“226 (2017)
Rayle, L., Dai, D., Chan, N., Cervero, R., Shaheen, S.: Just a better taxi? a surveybased comparison of taxis, transit, and ridesourcing services in san francisco. Transport Policy 45, 168â€“178 (2016)
Reclus, F., Drouard, K.: Geofencing for fleet & freight management. In: 2009 9th International Conference on Intelligent Transport Systems Telecommunications, (ITST), pages 353â€“356. IEEE. (2009)
Roy, S., Cooper, D., Mucci, A., Sana, B., Chen, M., Castiglione, J., Erhardt, G.D.: Why is traffic congestion getting worse? a decomposition of the contributors to growing congestion in san francisco. Case Studies on Transport Policy. (2020)
Sayarshad, H.R., Chow, J.Y.: Nonmyopic relocation of idle mobilityondemand vehicles as a dynamic locationallocationqueueing problem. Transportation Research Part E: Logistics and Transportation Review 106, 60â€“77 (2017)
Simonetto, A., Monteil, J., Gambella, C.: Realtime cityscale ridesharing via linear assignment problems. Transportation Research Part C: Emerging Technologies 101, 208â€“232 (2019)
Spieser, K., Treleaven, K., Zhang, R., Frazzoli, E., Morton, D., Pavone, M.: Toward a Systematic Approach to the Design and Evaluation of Automated MobilityonDemand Systems: A Case Study in Singapore. Road Vehicle Automation (Lecture Notes in Mobility). (2014)
Tang, B.J., Li, X.Y., Yu, B., Wei, Y.M.: How appbased ridehailing services influence travel behavior: An empirical study from China. International Journal of Sustainable Transportation, pages 1â€“15. (2019)
Tirachini, A., Chaniotakis, E., Abouelela, M., Antoniou, C.: The sustainability of shared mobility: Can a platform for shared rides reduce motorized traffic in cities? Transportation Research Part C: Emerging Technologies 117, 102707 (2019)
Tirachini, A., del RĂo, M.: Ridehailing in Santiago de Chile: Users characterisation and effects on travel behaviour. Transport Policy 82, 46â€“57 (2019)
Tirachini, A., GomezLobo, A.: Does ridehailing increase or decrease vehicle kilometers traveled (VKT)? a simulation approach for Santiago de Chile. International Journal of Sustainable Transportation 14(3), 187â€“204 (2020)
Tsao, M., Milojevic, D., Ruch, C., Salazar, M., Frazzoli, E., Pavone, M.: Model predictive control of ridesharing autonomous mobility on demand systems. In: Proc. IEEE Conf. on Robotics and Automation. (2019)
Ulmer, M.W., Mattfeld, D.C., KĂ¶ster, F.: Budgeting time for dynamic vehicle routing with stochastic customer requests. Transportation Science 52(1), 20â€“37 (2018)
van Engelen, M., Cats, O., Post, H., Aardal, K.: Enhancing flexible transport services with demandanticipatory insertion heuristics. Transportation Research Part E: Logistics and Transportation Review 110, 110â€“121 (2018)
Voccia, S.A., Campbell, A.M., Thomas, B.W.: The sameday delivery problem for online purchases. Transportation Science 53(1), 167â€“184 (2019)
Vosooghi, R., Puchinger, J., Jankovic, M., Vouillon, A.: Shared autonomous vehicle simulation and service design. Transportation Research Part C: Emerging Technologies 107, 15â€“33 (2019)
Wallar, A., Van Der Zee, M., AlonsoMora, J., Rus, D.: Vehicle rebalancing for mobilityondemand systems with ridesharing. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4539â€“4546. IEEE. (2018)
Wang, J., Cheng, P., Zheng, L., Feng, C., Chen, L., Lin, X., Wang, Z.: Demandaware route planning for shared mobility services. Proceedings of the VLDB Endowment 13(7), 979â€“991 (2020)
Wang, X., Agatz, N., Erera, A.: Stable matching for dynamic ridesharing systems. Transportation Science 52(4), 850â€“867 (2018)
Wen, J., Zhao, J., Jaillet, P.: Rebalancing shared mobilityondemand systems: A reinforcement learning approach. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pages 220â€“225. IEEE. (2017)
Wu, X., MacKenzie, D.: Assessing the vmt effect of ridesourcing services in the us. Transportation Research Part D: Transport and Environment 94, 102816 (2021)
Xue, R., Sun, D.J., Chen, S.: Shortterm bus passenger demand prediction based on time series model and interactive multiple model approach. Discrete Dynamics in Nature and Society, 2015. (2015)
Yu, X., Gao, S., Hu, X., Park, H.: A Markov decision process approach to vacant taxi routing with ehailing. Transportation Research Part B: Methodological 121, 114â€“134 (2019)
Zakharenko, R.: Optimal pricing for shared vehicles. Conference of the International Transportation Economics Association, Online, 24â€“26 June, (2021)
Zardini, G., Lanzetti, N., Pavone, M., Frazzoli, E.: Analysis and control of autonomous mobilityondemand systems: A review. arXiv preprint arXiv:2106.14827. (2021)
Zhang, R., Pavone, M.: Control of robotic mobilityondemand systems: a queueingtheoretical perspective. The International Journal of Robotics Research 35(1â€“3), 186â€“203 (2016)
Zhou, C., Dai, P., Li, R.: The passenger demand prediction model on bus networks. In: 2013 IEEE 13th International Conference on Data Mining Workshops, pages 1069â€“1076. IEEE. (2013)
Acknowledgements
We thank the valuable comments by Dr. Xiaoshan Bai, from Shenzhen University. This research was partially funded by Didi Udian Technology (Shenzhen) Co. Ltd.
Funding
The funding was provided by Didi Udian Technology (Shenzhen) Co. Ltd.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Numerical experiments were run by Andres Fielbaum. The first draft of the manuscript was written by Andres Fielbaum and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Fielbaum, A., Kronmueller, M. & AlonsoMora, J. Anticipatory routing methods for an ondemand ridepooling mobility system. Transportation 49, 1921â€“1962 (2022). https://doi.org/10.1007/s11116021102321
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11116021102321
Keywords
 Ridepooling
 Ridesharing
 Ondemand mobility
 Anticipatory methods
 Predictive methods