Skip to main content
SpringerLink
Log in

A Historical Perspective of Entropy Applications in Water Resources

  • Chapter
Entropy and Energy Dissipation in Water Resources

Part of the book series: Water Science and Technology Library ((WSTL,volume 9))

Abstract

Entropy and the principle of maximum entropy are being increasingly applied to a wide range of problems in hydrology and water resources. This paper reviews some of the hydrologic applications of entropy, and comments on the entropy-based approaches. Entropy is a powerful model-building tool, and its potential in explaining the great many hydrologic processes remains largely untapped.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Aczel, J. and Daroczy, Z., 1975. On measures of information and their characterization. Academic Press, New York.

    Google Scholar 

  • Amorocho, J. and Espildora, B., 1973. Entropy in the assessment of uncertainty in hydrologic systems and models. Water Resources Research, Vol. 9, No. 6, pp. 1551–1522.

    Article  Google Scholar 

  • Arora, K. and Singh, V. P., 1989. A comparative evaluation of the estimates of log-Pearson type (LP) 3 distribution. Journal of Hydrology, Vol. 105, pp. 19–37.

    Article  Google Scholar 

  • Arora, K. and Singh, V. P., 1987a. On statistical intercomparison of EV1 estimators by Monte Carlo simulation. Advances in Water Resources, Vol. 10, No. 2, pp. 87–107.

    Article  Google Scholar 

  • Arora, K. and Singh, V. P., 1987b. An evaluation of seven methods for estimating parameters of the EV1 distribution, in Hydrologie Frequency Modeling, edited by V. P. Singh, pp. 383–394, D. Reidel Publishing Company, Boston.

    Chapter  Google Scholar 

  • Awumah, K. and Goulter, I., 1989. Redundancy and reliability of water distribution networks: an entropy based approach. Proceedings of the 1989 National Conference on Hydraulic Engineering, pp. 768–773.

    Google Scholar 

  • Awumah, K., Goulter, I. and Bhatt, S. K., 1989. Entropy based redundancy measures for water distribution networks. Water Resources Research Report, No. 0/2, Department of Civil Engineering, University of Manitoba, Winnipeg, Manitoba, Canada.

    Google Scholar 

  • Awumah, K., Goulter, I. and Bhatt, S. K., 1991. Entropy-based distribution measures in water-distribution networks. Journal of Hydraulic Engineering, Vol. 117, No. 5, pp. 595–614.

    Article  Google Scholar 

  • Awumah, K., Goulter, I. and Bhatt, S. K., 1991. Entropy-based distribution measures in water-distribution networks. Journal of Hydraulic Engineering, Vol. 117, No. 5, pp. 595–614.

    Article  Google Scholar 

  • Behara, M. and Chawla, J. S., 1974. Generalized gamma-entropy. Selecta. Statistica Canadiana, Vol. 2, pp. 15–38.

    Google Scholar 

  • Boltzmann, L., 1872. Weitere Studien uber das warmegleichgewich unter gasmolekulen. K. Acad. Wiss. (Wein) Sitzb., II Abt., Vol. 66, pp. 275.

    Google Scholar 

  • Burg, J. P., 1968. A new technique for time series data. Paper presented at the NATO Advanced Study Institute on Signal Processing with Emphasis on Underwater Acoustics, Enschede, The Netherlands, August 12–13.

    Google Scholar 

  • Burg, J. P., 1972. The relationship between maximum entropy spectra and maximum likelihood spectra. Geophysics, Vol. 37, pp. 375–376.

    Article  Google Scholar 

  • Burg, J. P., 1975. Maximum spectral analysis. Ph.D. dissertation, Stanford University, Palo Alto, California.

    Google Scholar 

  • Chapman, T. G., 1986. Entropy as a measure of hydrologic data uncertainty. Journal of Hydrology, Vol. 85, pp. 111–126.

    Article  Google Scholar 

  • Chiu, C. L., 1986. Entropy and probability concepts in hydraulics. Journal of Hydraulic Engineering, Vol. 113, No. 5, pp. 583–600.

    Article  Google Scholar 

  • Chiu, C. L., 1988. Entropy and 2-D velocity distribution in open channels. Journal of Hydraulic Engineering, Vol. 114, No. 7, pp. 738–756.

    Article  Google Scholar 

  • Chiu, C. L., 1989. Velocity distribution in open channel flow. Journal of Hydraulic Engineering, Vol. 115, No. 5, pp. 576–594.

    Article  Google Scholar 

  • Chiu, C. L., 1991. Application of entropy concept in open-channel flow study. Journal of Hydraulic Engineering, Vol. 117, No. 5, pp. 615–628.

    Article  Google Scholar 

  • Davy, B. W. and Davies, T. R. H., 1979. Entropy concepts in fluvial geomorphology: a reevaluation. Water Resources Research, Vol. 15, No. 1, pp. 103–106.

    Article  Google Scholar 

  • Fiorentino, M., Arora, K. and Singh, V. P., 1987b. The two-component extreme-value distribution for flood frequency analysis: Another look and derivation of a new estimation method. Stochastic Hydrology and Hydraulics, Vol. 1, pp. 199–208.

    Article  Google Scholar 

  • Fiorentino, M., Singh, V. P. and Arora, K., 1987a. On the two-component extreme-value distribution and its point and regional estimators. Regional Flood Frequency Analysis, edited by V. P. Singh, pp. 252–272, D. Reidel Publishing Company, Boston.

    Google Scholar 

  • Harmancioglu, N. B., 1981. Measuring the information content of hydrological processes by the entropy concept. Journal of the Civil Engineering, Faculty of Ege University. Centennial of Ataturk’s Birth, pp. 13–38.

    Google Scholar 

  • Harmancioglu, N. B., 1984. Entropy concept as used in determination of optimal sampling intervals. Proceedings of the International Conference on Hydraulic Engineering Software, HYDROSOFT ′84, Potoroz, Yugoslavia, pp. 6–99 to 6–110.

    Google Scholar 

  • Harmancioglu, N. B. and Baron, T., 1989. Effects of recharge systems on hydrologic information transfer along rivers. IAHS Publication 181, pp. 223–233.

    Google Scholar 

  • Harmancioglu, N. B. and Yevjevich, V., 1985. Transfer of hydrologic information along rivers partially fed by karstified limestones. Proceedings of the International Symposium on Karst Water Resources, Ankara, IAHS Publication 161, pp. 121–131.

    Google Scholar 

  • Harmancioglu, N. B. and Yevjevich, V., 1986. Transfer of information among water quality variables of the Potomac River, Phase III: transferable and transferred information. Completion Report, D. C. Water Resources Research Center, University of the District of Columbia, Washington, D. C.

    Google Scholar 

  • Harmancioglu, N. B. and Yevjevich, V., 1987. Transfer of hydrologic information among river points. Journal of Hydrology, Vol. 91, pp. 103–118.

    Article  Google Scholar 

  • Harmancioglu, N. B., Yevjevich, V. and Obseysekera, J. T. B., 1986. Measures of information transfer between variables. Proceedings of the Fourth International Symposium on Multivariate Analysis of Hydrologie Variables, pp. 481–499.

    Google Scholar 

  • Havrada, J. H. and Charvat, F., 1967. Quantification methods of classificatory processes: concept of structural a entropy. Kybernatica, Vol. 3, pp. 30–35.

    Google Scholar 

  • Husain, T., 1989. Hydrologic uncertainty measure and network design. Water Resources Bulletin, Vol. 25, No. 3, pp. 527–534.

    Article  Google Scholar 

  • Jain, D. and Singh, V. P., 1986. Estimating parameters of EV1 distribution for flood frequency analysis. Water Resources Bulletin, Vol. 23, No. 1, pp. 59–72.

    Google Scholar 

  • Jaynes, E. T., 1957a. Information theory and statistical mechanics, I. Physical Review, Vol. 106, pp. 620–630.

    Article  Google Scholar 

  • Jaynes, E. T., 1957b. Information theory and statistical mechanics, II. Physical Review, Vol. 108, pp. 171–190.

    Article  Google Scholar 

  • Jowitt, P. W., 1979. The extreme-value type I distribution and the principle of maximum entropy. Journal of Hydrology, Vol. 42, pp. 23–28.

    Article  Google Scholar 

  • Jowitt, P. W., 1991. A maximum entropy view of probability-distributed catchment models. Hydrological Sciences Journal, Vol. 36, No. 2 /4, pp. 123–134.

    Google Scholar 

  • Kapoor, V., 1990. Spatial uniformity of power and the altitudinal geometry of river networks. Water Resources Research, Vol. 26, No. 10, pp. 2303–2310.

    Article  Google Scholar 

  • Kapur, J. N., 1967. Generalised entropies of order α and type β. The Mathematics Seminar, Vol. 4, pp. 79–94.

    Google Scholar 

  • Kapur, J. N., 1968. On information of order α and β. Proceedings of the Indian Academy of Science, Vol. 48A. pp. 65–76.

    Google Scholar 

  • Kapur, J. N., 1986. Four families of measures of entropy. Indian Journal of Pure and Applied Mathematics, Vol. 17, No. 4, pp. 429–449.

    Google Scholar 

  • Kennedy, J. F., Richardson, P. D. and Sutera, S. P., 1964. Discussion of ‘Geometry of river channels’ by W. R. Langbein. Journal of the Hydraulics Division, Proceedings of the American Society of civil Engineers, Vol. 90, No. HY6 pp. 332–347.

    Google Scholar 

  • Khinchin, A. I., 1957. Mathematical Foundations of Information Theory. Dover Publications, New York.

    Google Scholar 

  • Krstanovic, P. F. and Singh, V. P., 1987. A multivariate flood analysis using entropy, in Hydrologic Frequency Modeling, edited by V. P. Singh, pp. 515–540, D. Reidel Publishing Company, Dordrecht, The Netherlands.

    Chapter  Google Scholar 

  • Krstanovic, P. F. and Singh, V. P., 1988a. Application of entropy theory to multivariate hydrologic analysis, Vol. 2. Technical Report, WRR9, pp. 271–557, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Krstanovic, P. F. and Singh, V. P., 1988b. Application of entropy theory to multivariate analysis, Vol. 1. Technical Report WRR9, pp. 1–271, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Krstanovic, P. F. and Singh, V. P., 1988b. Application of entropy theory to multivariate analysis, Vol. 1. Technical Report WRR9, pp. 1–271, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Krstanovic, P. F. and Singh, V. P., 1988b. Application of entropy theory to multivariate analysis, Vol. 1. Technical Report WRR9, pp. 1–271, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Kullback, S. and Leibler, R. A., 1951. On information and sufficiency. Annals of Mathematical Statistics, Vol. 22, pp. 79–86.

    Article  Google Scholar 

  • Leopold, L. B. and Langbein, W. B., 1962. The concept of entropy in landscape evolution. Geological Survey Professional Paper 500-A, A-20 p., Washington, D. C.

    Google Scholar 

  • Lind, N. C. and Hong, H. P., 1991. Entropy estimation of hydrological extremes. Stochastic Hydrology and Hydraulics, Vol. 5, No. 1, pp. 77–87.

    Article  Google Scholar 

  • Lind, N. C. and Solana, V., 1988. Cross-entropy estimation of random variables with fractile constraints. Paper No. 11, 26 p., Institute for Risk Research, University of Waterloo, Waterloo, Canada.

    Google Scholar 

  • Lind, N. C. and Solana, V., 1989. A cross-entropy method for flood probability analysis. Stochastic Hydrology and Hydraulics, Vol. 3, No. 3, pp. 191–202.

    Article  Google Scholar 

  • Linfoot, E. H., 1957. An information measure of correlation. Information Control, Vol. 1, pp. 85–89.

    Article  Google Scholar 

  • Moore, R. J. and Clarke, R. T., 1981. A distribution function approach to rainfall-runoff modeling. Water Resources Research, Vol. 17, No. 5, pp. 1367–1382.

    Article  Google Scholar 

  • Nordin, C. F., 1977. Discussion of ‘Applicability of unit stream power equation’ by C. T. Yang and J. B. Stall. Journal of the Hydraulics Division, Proceedings of the American Society of Civil Engineers, Vol. 103, No. HY2, pp. 209–211.

    Google Scholar 

  • Padmanabhan, G. and Rao, A. R., 1988. Maximum entropy spectral analysis of hydrologic data. Water Resources Research, Vol. 23, No. 4, pp. 1519–1533.

    Article  Google Scholar 

  • Renyi, A., 1961. On measures of entropy and information. Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, pp. 547–561.

    Google Scholar 

  • Scheidegger, A. E., 1964. Some implications of statistical mechanics in geomorphology. IAHS Bulletin, Vol. 9, No. 1, pp. 12–16.

    Google Scholar 

  • Shannon, C. E., 1948a. The mathematical theory of communications, I and II. Bell System Technical Journal, Vol. 27, pp. 379–423.

    Google Scholar 

  • Shannon, C. E., 1948b. The mathematical theory of communications, III and IV. Bell System Technical Journal, Vol. 27, pp. 623–656.

    Google Scholar 

  • Shannon, C. E. and Weaver, W., 1949. The Mathematical Theory of Communication. University of Illinois Press, 117 p., Urbana, Illinois.

    Google Scholar 

  • Singh, V. P., 1986. On the log-Gumbel (LG) distribution. Hydrology, Vol. VIII, No. 4, pp. 34–42.

    Google Scholar 

  • Singh, V. P., 1987a. On the extreme value (EV) type III distribution for low flows. Hydrological Sciences Journal, Vol. 32, No. 4, pp. 521–533.

    Article  Google Scholar 

  • Singh, V. P., 1987b. On application of the Weibull distribution in hydrology. Water Resources Management, Vol. 1, No. 1, pp. 33–43.

    Article  Google Scholar 

  • Singh, V. P., 1989. Hydrologic modeling using entropy. Journal of the Institution of Engineers, Civil Engineering Division, Vol. 70, Part CV2, pp. 55–60.

    Google Scholar 

  • Singh, V. P. and Cruise, J. F., 1990. Stochastic streamflow modeling for reservoir planning and management. IAHS Publication No. 194, pp. 11–28.

    Google Scholar 

  • Singh, V. P., Cruise, J. F. and Ma, M., 1989. A comparative evaluation of the estimators of two distributions by Monte Carlo simulation method. Technical Report WRR13, 126 p., Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Singh, V. P., Cruise, J. F and Ma, M., 1990a. A comparative evaluation of the estimators of the three-parameter lognormal distribution by Monte Carlo simulation. Computational Statistics and Data Analysis, Vol. 10, pp. 71–85.

    Article  Google Scholar 

  • Singh, V. P., Cruise, J. F. and Ma, M, 1990b. A comparative evaluation of the estimators of the Weibull distribution by Monte Carlo simulation. Journal of Statistical Computation and Simulation, Vol. 36, pp. 229–241.

    Article  Google Scholar 

  • Singh, V. P. and Jain, D., 1985. Comparing methods of parameter estimation for EV1 distribution for flood frequency distribution. Proceedings of the Vth World Congress on Water Resources., Brussels, Belgium, Vol. 3, pp. 1119–1132.

    Google Scholar 

  • Singh, V. P. and Krstanovic, P. F., 1987. A stochastic model for sediment yield using the principle of maximum entropy. Water Resources Research, Vol. 23, No. 5, pp. 781–793.

    Article  Google Scholar 

  • Singh, V. P. and Krstanovic, P. F., 1988. A stochastic model for water quality constituents. Proceedings of the 6th APD-IAHR Congress, Kyoto, Japan.

    Google Scholar 

  • Singh, V. P. and Rajagopal, A. K., 1987. A new method of parameter estimation for hydrologic frequency analysis. Hydrological Science and Technology, Vol. 2, No. 3, pp. 33–40.

    Google Scholar 

  • Singh, V. P., Rajagopal, A. K. and Singh, K., 1985. Application of the principle of maximum entropy (POME) to hydrologic frequency analysis. Completion Report 06, 144 p., Louisiana Water Resources Research Institute, Louisiana State University, Baton Rouge, Louisiana.

    Google Scholar 

  • Singh, V. P., Rajagopal, A. K. and Singh, K., 1986. Derivation of some frequency distributions using the principle of maximum entropy (POME). Advances in Water Resources, Vol. 9, No. 2, pp. 91–106.

    Article  Google Scholar 

  • Singh, V. P. and Singh, K., 1985a. Derivation of the gamma distribution by using the principle of maximum entropy (POME). Water Resources Bulletin, Vol. 21, No. 6, pp. 941–952.

    Article  Google Scholar 

  • Singh, V. P. and Singh, K., 1985b. Derivation of the Pearson type (PT) III distribution by using the principle of maximum entropy. Journal of Hydrology, Vol. 80, pp. 197–214.

    Article  Google Scholar 

  • Singh, V. P. and Singh, K., 1985c. Pearson type III distribution and the principle of maximum entropy. Proceedings of the Vth World Congress on Water Resources, Brussels, Belgium, Vol. 3, pp. 1133–1146.

    Google Scholar 

  • Singh, V. P. and Singh, K., 1987. Parameter estimation for TPLN distribution for flood frequency analysis. Water Resources Bulletin, Vol. 23, No. 6, pp. 1185–1192.

    Article  Google Scholar 

  • Singh, V. P. and Singh, K., 1988. Parameter estimation for log-Pearson type III distribution by POME. Journal of Hydraulic Engineering, Vol. 114, No. 1, pp. 112–122.

    Article  Google Scholar 

  • Sonuga, J. O., 1972. Principle of maximum entropy in hydrologic frequency analysis. Journal of Hydrology, Vol. 17, No. 3, pp. 177–219.

    Article  Google Scholar 

  • Sonuga, J. O., 1976. Entropy principle applied to the rainfall-runoff process. Journal of Hydrology, Vol. 30, pp. 81–94.

    Article  Google Scholar 

  • Theil, H., 1970. Economics and Information Theory. North Holland, Amsterdam, The Netherlands.

    Google Scholar 

  • Tomlin, S. G., 1969. A kinetic theory of distribution and similar problems. Environment and Planning, Vol. 1, pp. 221.

    Article  Google Scholar 

  • Tomlin, S. G., 1970. Time-dependent traffic distribution. Transportation Research, Vol. 4, No. 1.

    Google Scholar 

  • White, D. J., 1968. Operations research and entropy. Operational Research Quarterly, Vol. 20, No. 1, pp. 126.

    Article  Google Scholar 

  • Wilson, A. G., 1970. The use of the concept of entropy in system modelling. Operational Research Quarterly, Vol. 21, No. 2, pp. 247–265.

    Article  Google Scholar 

  • Yang, C. T., 1971a. Potential energy and stream morphology. Water Resources Research, Vol. 7, No. 2, pp. 311–322.

    Article  Google Scholar 

  • Yang, C. T., 1971b. On river meanders. Journal of Hydrology, Vol. 13, pp. 231–253.

    Article  Google Scholar 

  • Yang, C. T., 1972. Unit stream power and sediment transport. Journal of the Hydraulics Division, Proceedings of the American Society of Civil Engineers, Vol. 98, No. HY10, pp. 1805–1826.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Water Resources Program Department of Civil Engineering, Louisiana State University, Baton Rouge, LA, 70803-6405, USA

    V. P. Singh

  2. Department of Environmental Engineering and Physics, University of Basilicata via della, Tecnica 3, 85100, Potenza, Italy

    M. Fiorentino

Authors
  1. V. P. Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Fiorentino
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Civil Engineering, Louisiana State University, Baton Rouge, USA

    V. P. Singh

  2. Department of Environmental Engineering and Physics, University of Basilicata, Potenza, Italy

    M. Fiorentino

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Singh, V.P., Fiorentino, M. (1992). A Historical Perspective of Entropy Applications in Water Resources. In: Singh, V.P., Fiorentino, M. (eds) Entropy and Energy Dissipation in Water Resources. Water Science and Technology Library, vol 9. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-2430-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-2430-0_2

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5072-2

  • Online ISBN: 978-94-011-2430-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation