House-selling problem with reward rate criteria and changing costs


The house-selling problem with reward rate criteria and changing costs is considered under the condition that the seller can put a price on a house at the beginning of each step. Applying the methods of dynamic programming, we derive recursive equations for finding optimal strategies and the corresponding rewards. A numerical algorithm is proposed. The approach with changing costs turns out to be more efficient than the one with constant costs.

This is a preview of subscription content, access via your institution.


  1. 1.

    E. B. Dynkin and A. A. Yushkevich, Theorems and Problems of Markovian Processes (Nauka, Moscow, 1967) [in Russian].

    Google Scholar 

  2. 2.

    A. N. Shiryaev, Statistical Sequential Analysis (Nauka, Moscow, 1976) [in Russian].

    MATH  Google Scholar 

  3. 3.

    A. Shiryaev and G. Peskir, Optimal Stopping and Free-Boundary Problems (Birkhauser, Boston, Basel, Berlin, 2006).

    MATH  Google Scholar 

  4. 4.

    I. Chow, H. Robbins, and D. Siegmund, The Theory of Optimal Stopping (Dover, 1971; Nauka, Moscow, 1977).

    Google Scholar 

  5. 5.

    B. A. Berezovskii and A. V. Gnedin, The Best Choice Problem (Nauka, Moscow, 1984) [in Russian].

    Google Scholar 

  6. 6.

    J. L. Fisher, “A Class of Stochastic Investment Problems,” Oper. Res. 9, 53–65 (1961).

    MATH  Article  Google Scholar 

  7. 7.

    S. Karlin, “Stochastic Models and Optimal Policy for Selling An Asset,” Studies in Applied Probability and Management Science (1962).

  8. 8.

    V. Saario, “Limiting Properties of the Discounted House-Selling Problem,” Europ. J. Oper. Res. 20, 206–210 (1985).

    MATH  Article  Google Scholar 

  9. 9.

    V. Saario, “Some Properties of the Sequential Markovian Allocation Problem,” Engineering Costs and Production Economics 17, 175–182 (1989).

    Article  Google Scholar 

  10. 10.

    V. Saario and M. Sakaguchi, “Some Generalized House-Selling Problems,” Math. Japonica 35((5)), 861–873 (1990).

    MATH  MathSciNet  Google Scholar 

  11. 11.

    F. Th. Bruss and Th. S. Ferguson, “Multiple Buying or Selling with Vector Offers,” J. Appl. Prob 34, 959–973 (1997).

    MATH  Article  MathSciNet  Google Scholar 

  12. 12.

    V. V. Mazalov and V. Saario, “House-Selling Problem with Reward Rate Criterion,” J. Appl. Prob. 39, 644–649 (2002).

    MATH  Article  MathSciNet  Google Scholar 

Download references

Author information



Corresponding author

Correspondence to V. V. Mazalov.

Additional information

Original Russian Text © V.V. Mazalov, I.A. Fal’ko, 2008, published in Izvestiya Akademii Nauk. Teoriya i Sistemy Upravleniya, 2008, No. 2, pp. 79–88.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Mazalov, V.V., Fal’ko, I.A. House-selling problem with reward rate criteria and changing costs. J. Comput. Syst. Sci. Int. 47, 235 (2008).

Download citation


  • Optimal Strategy
  • Recursive Relation
  • System Science International
  • Recursive Equation
  • Stochastic Dynamic Programming