Optimal Learning Recognizer for Unknown Signal Sets in a Channel with Feedback Link

  • Kokichi Tanaka
  • Shinichi Tamura


A general Kalman filer type supervised optimum quadric dichotomizer for an on-off sequence of unknown signal is presented. Then, the optimum analogue feedback is obtained which makes the average of forward signal transmission energy minimum. The extension of the proposed machine to nonsupervised problems is also discussed. The effectiveness of a feedback method over a non-feedback method is clarified. It is also tested by computer simulation.


Transmission Energy Unknown Signal Feedback Method Feedback Link Message Probability 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. (1).
    J. Spragins, “Learning without a teacher,” IEEE Trans. Inform. Theory, vol. IT-12, pp. 223–230, Apr. 1966CrossRefGoogle Scholar
  2. (2).
    C.V. Jakowatz, R.L. Shuey, and G.M. White, “Adaptive waveform recognition,” in Proc. 4th Symp. on Information Theory, C. Cherry, Ed., Washington, D.C.: Butterworths, 1961.Google Scholar
  3. (3).
    M.J. Hinch, “A model for a self-adapting filter,” Inform. Contr., vol. 5, pp. 185–203, Sept. 1962.CrossRefGoogle Scholar
  4. (4).
    K. Tanaka, S. Higuchi, and S. Maekawa, “An identification method of system characteristics using a new type of adaptive correlating filter,” in Proc. Int. Fed. Automatic Control Tokyo Symp., Aug. 1965, pp. 245–254.Google Scholar
  5. (5).
    E.M. Glaser, “Signal detection by adaptive filters,” IRE Trans. Inform. Theory, vol. IT-7, pp. 87–97, Apr. 1961.CrossRefGoogle Scholar
  6. (6).
    N. Abramson and D. Braverman, “Learning to recognize patterns in a random environment,” IRE Trans. Inform. Theory, vol. IT-8, pp. 58–63, Sept. 1962.CrossRefGoogle Scholar
  7. (7).
    H.J. Scudder, III, “Adaptive communication receivers,” IEEE Trans. Inform. Theory, vol. IT-11, pp. 167–174, Apr. 1965.CrossRefGoogle Scholar
  8. (8).
    H.J. Scudder, “Probability of error of some adaptive pattern- recognition machines,” IEEE Trans. Inform. Theory, vol. IT-11, pp. 363–371. July 1965.CrossRefGoogle Scholar
  9. (9).
    S. Tamura, S. Higuchi, and K. Tanaka, “On the recognition of time-varying patterns using learning procedures, “IEEE Trans. Inform. Theory, vol. IT-17, pp. 445–452, July 1971.CrossRefGoogle Scholar
  10. (10).
    C.E. Shannon, “The zero error capacity of a noisy channel,” IRE Trans. Inform. Theory, vol IT-2, pp. 3–13, Sept. 1956.CrossRefGoogle Scholar
  11. (11).
    J.P.M. Schalkwijk and T. Kailath, “A coding scheme for additive noise channels with feedback-Part I and II,” IEEE Trans. Inform. Theory, vol. IT-12, pp. 172–182, pp. 183–189, Apr. 1966.CrossRefGoogle Scholar
  12. 12).
    R.L. Kashyap, “Feedback coding schemes for an additive noise channel with a noisy feedback link,” IEEE Trans. Inform. Theory, vol. IT-14, pp. 471–480, May 1968.CrossRefGoogle Scholar
  13. (13).
    G.L. Turin, “Signal design for sequential detection systems with feeback,” IEEE Trans. Inform. Theory, vol. IT-11, pp. 401–408, July 1965.CrossRefGoogle Scholar
  14. (14).
    J.K. Omura, “Optimal linear transmission of analogue data for channels with feedback,” IEEE Trans. Inform. Theory, vol. IT-14, pp. 38–43, January 1968.CrossRefGoogle Scholar
  15. (15).
    J.P.M. Schalkwijk, “Center-of-gravity information feedback,” IEEE Trans. Inform. Theory, vol. IT-14, pp. 324–331, March 1968.CrossRefGoogle Scholar
  16. (16).
    S. Tamura and K. Tanaka, “Synchronization for unknown signal sequence by learning procedure,” IEEE Trans. Commun., vol. COM-20, pp. 780–787, August 1972.CrossRefGoogle Scholar
  17. (17).
    J.S. Meditch, Stochastic Optimal Linear Estimation and Control. New York: McGraw-Hill, 1969.Google Scholar
  18. (18).
    K. Tanaka and S. Tamura,”Some considerations on a type of pattern recognition using nonsupervised learning procedure,” in Int Fed, Automatic Control int, Sympt Technical and Biological Problems of Control, Yerevan, Armenia, Sept. 1968.Google Scholar
  19. (19).
    K. Tanaka, “Some studies on pattern recognition with non- supervised learning procedures,” in Pattern Recognition and Machine Learning, K.S. Fu Ed., New York: Plenum, 1971, pp. 1–17.Google Scholar
  20. (20).
    J.C. Hancock and P.A. Wintz, Signal Detection Theory, New York: McGraw-Hill, 1966.Google Scholar

Copyright information

© Plenum Press, New York 1974

Authors and Affiliations

  • Kokichi Tanaka
    • 1
  • Shinichi Tamura
    • 1
  1. 1.Osaka UniversityToyonaka, Osaka 560Japan

Personalised recommendations