SpringerLink
Log in

Effects of the number of hidden nodes used in a structured-based neural network on the reliability of image classification

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

A structured-based neural network (NN) with backpropagation through structure (BPTS) algorithm is conducted for image classification in organizing a large image database, which is a challenging problem under investigation. Many factors can affect the results of image classification. One of the most important factors is the architecture of a NN, which consists of input layer, hidden layer and output layer. In this study, only the numbers of nodes in hidden layer (hidden nodes) of a NN are considered. Other factors are kept unchanged. Two groups of experiments including 2,940 images in each group are used for the analysis. The assessment of the effects for the first group is carried out with features described by image intensities, and, the second group uses features described by wavelet coefficients. Experimental results demonstrate that the effects of the numbers of hidden nodes on the reliability of classification are significant and non-linear. When the number of hidden nodes is 17, the classification rate on training set is up to 95%, and arrives at 90% on the testing set. The results indicate that 17 is an appropriate choice for the number of hidden nodes for the image classification when a structured-based NN with BPTS algorithm is applied.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Zou W, Li Y, Lo KC, Chi Z (2006) Improvement of image classification with wavelet and independent component analysis (ICA) based on a structured neural network. Proceedings of IEEE world congress on computational intelligence’2006 (WCCI’2006), Vancouver, pp 7680–7685

  2. Zou W, Lo KC, Chi Z (2006) Structured-based neural network classification of images using wavelet coefficients. In: Proceedings of third international symposium on neural networks (ISNN). Lecture notes in computer science 3972: advances in Neural Networks-ISNN2006, part II Springer, Chengdu, pp 331–336

  3. Giles CL, Gori M (1998) Adaptive processing of sequences and data structures. Springer, Berlin

    Google Scholar 

  4. Sperduti A, Starita A (1997) Supervised neural networks for classification of structures. IEEE Trans Neural Netw 8:714–735

    Google Scholar 

  5. Goller C, Kuchler A (1996) Learning task-dependent distributed representations by back-propagation through structure. In: Proceedings IEEE international conference nerual networks, pp 347–352

  6. Cho SY, Chi ZR, Siu WC, Tsio AC (2003) An improved algorithm for learning long-term dependency problems in adaptive processing of data structures. IEEE Trans Neural Netw 14:781–793

    Google Scholar 

  7. Wanas N, Auda G, Kamel MS, Karray F (1998) On the optimal number of hidden nodes in a neural network. IEEE Can Conf Elect Comp Eng 2:918–921

    Google Scholar 

  8. Mirchandani G, Cao W (1989) On hidden nodes for neural nets. IEEE Trans Circuits Syst 36(5):661–664

    MathSciNet  Google Scholar 

  9. Nocera P, Quelavoine R (1994) Diminishing the number of nodes in multi-layered neural networks. IEEE world congress on computational intelligence, pp 4421–4424

  10. Gorman RP, Sejnowski TJ (1988) Analysis of hidden units in a layered network trained to classify sonar targets. Neural Netw 1:75–89

    Google Scholar 

  11. Rojas R (2003) Networks of width one are universal classifiers. In: Proceedings of the international joint conference on neural networks, pp 3124–3127

  12. How many hidden units should I use? http://www.faqs.org/faqs/ai-faq/neural-nets/part3/section-10.html (accessed 29 Aug 2007)

  13. Tsoi AC (1998) Adaptive processing of data structures: an expository overview and comments. Technical report. Faculty of Informatics, University of Wollongong, Australia

  14. Tsoi AC, Hangenbucnher M (1999) Adaptive processing of data structures. Keynote Speech. In: Proceedings of third international conference on computational intelligence and multimedia applications (ICCIMA ’99), 2–2 (summary)

  15. Frasconi P, Gori M, Sperduti A (1998) A general framework for adaptive processing of data structures. IEEE Trans Neural Netw 9:768–785

    Google Scholar 

  16. Cho S, Chi Z, Wang Z, Siu W (2003) An efficient learning algorithm for adaptive processing of data structure. Neural Process Lett 17:175–190

    MATH  Google Scholar 

  17. Dummer G, Winton R (1986) An elementary guide to reliability, 3rd edn. Pergamon Press, New York, 47p

  18. Snedecor GW, Cochran WG (1989) Statistical methods. Iowa State University press, Ames, 507p

Download references

Acknowledgments

The work described in this paper was partially supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (Project no. PolyU 5229/03E). The authors greatly appreciate the valuable comments and suggestions received from the reviewers of this paper.

Author information

Authors and Affiliations

  1. Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong

    Weibao Zou

  2. Shenzhen Institute of Advanced Technology, Shenzhen, China

    Weibao Zou

  3. Department of Mathematics and Computing, The University of Southern Queensland, Toowoomba, QLD, Australia

    Yan Li

  4. University of Central Florida, Orlando, FL, USA

    Arthur Tang

Authors
  1. Weibao Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arthur Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weibao Zou.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zou, W., Li, Y. & Tang, A. Effects of the number of hidden nodes used in a structured-based neural network on the reliability of image classification. Neural Comput & Applic 18, 249–260 (2009). https://doi.org/10.1007/s00521-008-0177-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-008-0177-3

Keywords

Search

Navigation