Skip to main content

Classification of Spatiotemporal Patterns with Applications to Recognition of Sonar Sequences

  • Chapter
Neural Representation of Temporal Patterns

Abstract

Many tasks performed by humans and animals involve decision-making and behavioral responses to spatiotemporally patterned stimuli. Thus the recognition and processing of time-varying signals is fundamental to a wide range of cognitive processes. Classification of such signals is also basic to many engineering applications such as speech recognition, seismic event detection, sonar classification and real-time control (Lippmann, 1989; Maren, 1990).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • Ambros-Ingerson, J., Granger, R., and Lynch, G., 1990, Simulation of paleocortex performs hierarchical clustering, Science, 247:1344.

    Article  PubMed  CAS  Google Scholar 

  • Banzhaf, W. and Kyuma, K., 1991, The time-into-intensity-mapping network, Biol. Cybern., 66:115.

    Article  Google Scholar 

  • Beck, S., Deuser, L., Still, R., and Whiteley, J., 1991, A hybrid neural network classifier of short duration acoustic signals, Proc. IJCNN, 1:119.

    Google Scholar 

  • Bell, T., 1988, Sequential processing using attractor transitions, in: “Proceedings of the 1988 Connectionist Models Summer School”, Morgan Kaufmann Publishers, San Mateo, CA.

    Google Scholar 

  • Braitenberg, V., 1990, Reading the structure of brains, Network, 1:1.

    Article  Google Scholar 

  • Byrne, J. H. and Gingrich, K. J., 1989, Mathematical model of cellular and molecular processes contributing to associative and nonassociative learning in Aplysia, in: “Neural Models of Plasticity”, J. Byrne, and W. Berry, eds., Academic Press, San Diego, CA.

    Google Scholar 

  • Chang, H. J. and Ghosh, J., 1993, Pattern association and retrieval in a continuous neural system, Biol Cybern., 69:77.

    Article  PubMed  CAS  Google Scholar 

  • Changeux, J.-P., Dehaene, S., and Nadal, J.-P., 1987, Neural networks that learn temporal sequences by selection, Proc. Natl. Acad. Sci. USA, 84:2727.

    Article  PubMed  Google Scholar 

  • Chen, C., 1985, Automatic recognition of underwater transient signals-a review, Proc. ICASSP, 1270.

    Google Scholar 

  • Day, S. P. and Davenport, M. R., 1993, Continuous-time temporal back-propagation with adaptable time delays, IEEE Trans Neural Networks, 4:348.

    Article  CAS  Google Scholar 

  • Dayhoff, J., 1990, Regularity properties in pulse transmission networks, Proceedings of the Third International Joint Conference on Neural Networks, 3:621.

    Google Scholar 

  • de Vries, B. and Principe, J. C., 1990, The gamma model -a new neural net model for temporal processing, Neural Networks, 5:565.

    Article  Google Scholar 

  • de Vries, B. and Principe, J. C., 1991, A theory for neural networks with time delays, in: “Advances in Neural Information Processing Systems-III”, R.P. Lippmann, J. E. Moody and D. Touretzky, eds., Morgan Kaufmann Publishers, San Mateo, CA.

    Google Scholar 

  • Deuser, L. and Middleton, D., 1979, On the classification of underwater acoustic signals: An environmentally adaptive approach, J. Acoust. Soc. Am., 65:438.

    Article  Google Scholar 

  • Djuric, P. M., Kay, S. M., and Boudreaux-Bartels, G. F., 1992, Segmentation of nonstationary signals, in: Proc. ICASSP, 5:161.

    Google Scholar 

  • Elman, J., 1990, Finding structure in time, Cognit. Sci., 14:179.

    Article  Google Scholar 

  • Freeman, W. J., Yao, Y., and Burke, B., 1988, Central pattern generating and recognizing in olfactory bulb: a correlation learning rule, Neural Networks, 1:277.

    Article  Google Scholar 

  • Freitag, L. and Tyack, P., 1993, Passive acoustic localization of the Atlantic bottlenose dolphin using whistles and echolocation clicks, J. Acoust. Soc. Am., 93:2197.

    Article  PubMed  CAS  Google Scholar 

  • Ghosh, J., 1993, Representation and classification of temporal patterns, in: “Tutorial Notes, ANNIE ’93”, Publisher: Univ. of Missouri-Rolla, St. Louis, Nov. 1993.

    Google Scholar 

  • Ghosh, J., Deuser, L., and Beck, S., 1990, Impact of feature vector selection on static classification of acoustic transient signals, in: “Government Neural Network Applications Workshop”

    Google Scholar 

  • Ghosh, J., Deuser, L., and Beck, S., 1992, A neural network based hybrid system for detection, characterization and classification of short-duration oceanic signals, IEEE J. Ocean Engineering, 17:351.

    Article  Google Scholar 

  • Ghosh, J. and Gangishetti, N., 1993, Robust classification of variable length sonar sequences, Proc. SPIE 1965:96.

    Article  Google Scholar 

  • Ghosh, J. and Karamcheti, V., 1992, Sequence learning using recurrent networks: Analysis of internal representations, SPIE Proc. 1710:449.

    Article  Google Scholar 

  • Granger, R., Ambros-Ingerson, J., and Lynch, G., 1991, Derivation of encoding characteristics of layer II cerebral cortex, J. Cognit. Neurosci., 61:78.

    Google Scholar 

  • Grossberg, S., 1970, Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II, Stud. App. Math., 49:135.

    Google Scholar 

  • Haykin, S., 1994, “Neural Networks: A Comprehensive Foundation”, Macmillan, New York, NY.

    Google Scholar 

  • Hecht-Nielsen, R., 1987, Nearest matched filter classification of spatiotemporal patterns, Applied Optics, 26:1892.

    Article  PubMed  CAS  Google Scholar 

  • Hecht-Nielsen, R., 1990, “Neurocomputing”, Addison Wesley, Reading, MA.

    Google Scholar 

  • Hermand, J.-P. and Nicolas, P., 1989, Adaptive classification of underwater transients, Proc. ICASSP, Vol. IV 2712–2715.

    Google Scholar 

  • Hertz, J., Krogh, A., and Palmer, R. G., 1991, “Introduction to the Theory of Neural Computation”, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Hopfield, J. and Tank, D., 1989, Neural architecture and biophysics for sequence recognition, in: “Neural Models of Plasticity”, J. Byrne, and W. Berry., eds., Academic Press, San Diego, CA.

    Google Scholar 

  • Jordan, M., 1989, Serial order: A parallel, distributed processing approach, in: “Advances in Connectionist Theory: Speech”, J. Elman,and D. Rumelhart, eds., Lawrence Erlbaum Associates, Hillsdale, NJ.

    Google Scholar 

  • Kohonen, T., 1988, The “neural phonetic typewriter”, IEEE Computer, 21:11.

    Article  Google Scholar 

  • Kohonen, T., 1989, “Self-Organization and Associative Memory”, Springer-Verlag, Berlin.

    Book  Google Scholar 

  • Kohonen, T., 1990, The self-organizing map, Proc. IEEE, 78:1464.

    Article  Google Scholar 

  • Kung, S., 1993, “Digital Neural Networks”, Prentice Hall, Englewood Cliffs, NJ.

    Google Scholar 

  • Kurogi, S., 1987, A model of neural network for spatiotemporal pattern recognition, Biol. Cybern., 57:103.

    Article  PubMed  CAS  Google Scholar 

  • Lang, K. J., Waibel, A. H., and Hinton, G. E., 1990, A time-delay neural network architecture for isolated word recognition, Neural Networks, 3:23.

    Article  Google Scholar 

  • Lefebvre, T., Nicolas, J., and Degoul, P., 1990, Numerical to symbolical conversion for acoustic signal classification using a two-stage neural architecture, in: “Proceedings of the International Neural Network Conference, Paris”.

    Google Scholar 

  • Lin, D., Dayhoff, J. E., and Ligomenides, P. A., 1992, Trajectory recognition with a time-delay neural network, in: “Proceedings of the International Joint Conference on Neural Networks, Baltimore”, 3:197.

    Google Scholar 

  • Lin, D.-T., Ligomenides, P. A., and Dayhoff, J. E., 1993, Learning spatiotemporal topology using an adaptive time-delay neural network, World Congress on Neural Networks, Oregon, 1:291.

    Google Scholar 

  • Lippmann, R. P., 1989, Review of neural networks for speech recognition, Neural Computat., 1:1.

    Article  Google Scholar 

  • Maren, A., 1990, Neural networks for spatio-temporal recognition, in: “Handbook of Neural Computing Applications”, A. Maren, C. Harston, and R. Pap, eds., Academic Press, San Diego, CA.

    Google Scholar 

  • Mozer, M. C., 1993, Neural network architectures for temporal sequence processing, in: “Time Series Prediction”, A.S. Weigend, and N. Gershenfeld, eds., Addison Wesley, Reading, MA.

    Google Scholar 

  • Pao, Y., Hemminger, T., Adams, D., and Clary, S., 1991, An episodal neural-net computing approach to the detection and interpretation of underwater acoustic transients, in: “Conference on Neural Networks for Ocean Engineering”, IEEE Press, New York, NY.

    Google Scholar 

  • Payne, K., Tyack, P., and Payne, R., 1983, Progressive changes in the songs of humpback whales (Megaptera novaegliae), a detailed analysis of two seasons in Hawaii, in: “Behavior and Communication of Whales”, Westview, Boulder, CO.

    Google Scholar 

  • Pearlmutter, B. A., 1989, Learning state space trajectories in recurrent neural networks, Neural Computat., 1:263.

    Article  Google Scholar 

  • Pineda, F. J., 1989, Recurrent backpropagation and the dynamical approach to adaptive neural computation, Neural Computat., 1:161.

    Article  Google Scholar 

  • Principe, J. C., Kuo, J.-M., and Celebi, S., 1994, An analysis of the gamma memory in dynamic neural networks, IEEE Trans. Neural Networks, 5:331.

    Article  CAS  Google Scholar 

  • Rioul, O. and Vetterli, M., 1991, Wavelets and signal processing, IEEE Signal Processing Magazine, 14:38.

    Google Scholar 

  • Sandberg, I., 1991, Structure theorems for nonlinear systems, Multidimensional Systems and Signal Processing, 2:267.

    Article  Google Scholar 

  • Sandberg, I., 1992a, Approximately finite memory and input-output maps, IEEE Trans. Circuits Systems, 39:549.

    Google Scholar 

  • Sandberg, I., 1992b, Approximations for nonlinear functionals, IEEE Trans. Circuits Systems, 39:65.

    Google Scholar 

  • Sandberg, I., 1994, General structures for classification, IEEE Trans. Circuits Systems, 41:372.

    Article  Google Scholar 

  • Sato, M., 1990, A real time learning algorithm for recurrent analog neural networks, Biol. Cybern., 62:237.

    Article  Google Scholar 

  • Sayigh, L., Tyack, P., Wells, R., and Scott, M., 1990, Signature whistles of free-ranging bottlenose dolphins Tursiops truncatus: stability and mother-offspring comparisons, Behav. Ecol. Sociobiol., 26:247.

    Article  Google Scholar 

  • Shamma, S., 1989, Spatial and temporal processing in central auditory networks, in: “Methods in Neuronal Modeling: From Synapses to Networks”, C. Koch, and I. Segev, eds., MIT Press, Cambridge, MA.

    Google Scholar 

  • Simpson, P., 1990, Neural networks for SONAR signal processing, in: “Handbook of Neural Computing Applications”, A. Maren, C. Harston, and R. Pap, eds., Academic Press, San Diego, CA.

    Google Scholar 

  • Stiles, B. and Ghosh, J., 1995, A habituation based mechanism for encoding temporal information in artificial neural networks, Proc. SPIE Vol. 2492, Orlando, April 1995, pp. 404–415.

    Chapter  Google Scholar 

  • Sun, G., Chen, H., Lee, Y., and Liu, Y., 1992, Time warping recurrent neural networks and trajectory classification, in: “Proceedings of the International Joint Conference on Neural Networks, Baltimore”, 1:431.

    Google Scholar 

  • Sutton, R. S., 1988, Learning to predict by the methods of temporal differences, Machine Learning, 3:9.

    Google Scholar 

  • Tank, D. and Hopfield, J., 1987, Neural computation by time compression, Proc. Natl. Acad. Sci. USA, 84:1896

    Article  PubMed  CAS  Google Scholar 

  • Urick, R., 1975, “Principles of Underwater Sound”, (2nd Ed.), McGraw-Hill, New York, NY.

    Google Scholar 

  • Waibel, A., 1989, Modular construction of time-delay neural networks for speech recognition, Neural Computat., 1:39.

    Article  Google Scholar 

  • Waibel, A. and Hampshire, J., 1989, Building blocks for speech, Byte, pp. 235–242.

    Google Scholar 

  • Wan, E., 1990, Temporal backpropagation for FIR neural networks, International Joint Conference on Neural Networks, San Diego, 1:575.

    Google Scholar 

  • Wang, D. and Arbib, M., 1990, Complex temporal sequence learning based on short-term memory, Proc. IEEE, 78:1536.

    Article  Google Scholar 

  • Wang, D., Buhmann, J., and von der Malsburg, C., 1990, Pattern segmentation in associative memory, Neural Computat, 2:94.

    Article  Google Scholar 

  • Weigend, A. S. and Gershenfeld, N., eds., 1993, “Time Series Prediction: Forecasting the Future and understanding the past”, Addison Wesley, Reading, MA.

    Google Scholar 

  • Werbos, P., 1988, Generalization of backpropagation with application to a recurrent gas market model, Neural Networks, 1:339.

    Article  Google Scholar 

  • Whitehead, H. and Weilgart, L., 1990, Click rates from sperm whales, J. Acoust. Soc. Am., 87:1798.

    Article  Google Scholar 

  • Widrow, B. and Stearns, S., 1985, “Adaptive Signal Processing”, Prentice-Hall, Englewood Cliffs, NJ.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer Science+Business Media New York

About this chapter

Cite this chapter

Ghosh, J., Deuser, L. (1995). Classification of Spatiotemporal Patterns with Applications to Recognition of Sonar Sequences. In: Covey, E., Hawkins, H.L., Port, R.F. (eds) Neural Representation of Temporal Patterns. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-1919-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-1919-5_10

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-5785-8

  • Online ISBN: 978-1-4615-1919-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics