Journal of Guangdong University of Technology ›› 2006, Vol. 23 ›› Issue (3): 95-101.

• Comprehensive Studies • Previous Articles     Next Articles

A Heuristic Approach for Improving Performance of Neural Network with the Optimal Brain Surgeon

  

  1. (School of Information Science and Technology,Guangdong University of Business Studies,Guangzhou 510320,China)
  • Online:2006-06-02 Published:2006-06-02

Abstract: A new heuristic approach is proposed for the automated optimization of neural network.It combines fast optimal brain surgeon,dynamic optimization of learning parameters and fast cross-validation.The fast optimal brain surgeon optimizes architecture of neural network automatically.The dynamic optimization of learning parameters is able to dynamically vary its learning parameters and select optimal learning parameters.The fast cross-validation provides improvements of avoiding overfitting problem effectively.Experimental results demonstrate that with the heuristic approach,considerable performance gains are obtained compared to the other algorithms.This includes better generalization,optimal network architecture,and faster learning. 

Key words: neural network; optimal brain surgeon; top-down; learning parameters optimization; cross-validation; generalization;

[1] 杨钟瑾,史忠科.  快速选定神经网络优化结构的方法[J]. 计算机科学. 2005(04)

[2] 杨钟瑾,史忠科.  快速自顶向下优化神经网络结构的方法[J]. 系统仿真学报. 2005(01)

[1] (美)MartinT.Hagan等著.神经网络设计[M]. 机械工业出版社, 2002

[2] 史忠科著.神经网络控制理论[M]. 西北工业大学出版社, 1997

[1] Kung S,Fallside F,Sorenson J A,et at.Neural networks for signal processing. Proceed ing of the 1992 IEEEW orkshop . 1992

[2] Rumelhart DE,Hinton GE,Williams RJ.Learning internal representations by error propagation. Parallel Distributed Processing: Exploration in the Microstructures of Cognition . 1986

[3] Simon Haykin.Neural Networks. . 1994

[4] Fahlaman SE,Lebiere C.The cascade-correlation learning architecture. Advances in Neural Information Processing Systems . 1990

[5] Hassibi B,Stork D G,Wol G J.Optimal brain surgeon and general network pruning. IEEE International Conference on Neural Networks . 1993

[6] Holland John H.Adaptation in natural and artificial system. . 1975

[7] Yu X H,Chen G A,Cheng S X.Dynamic learning rate optimization of the back propagation algorithm. IEEE Transactions on Neural Networks . 1995

[8] Blum E K,Li L K.Approximation theory and feedforward networks. Neural Networks . 1991

[9] Fletcher R.Practical Methods of Optimization. . 1990

[10] Guyon I,Wang P S P.Special Issue on Neural Networks and Pattern Recognition. Pattern Recognition Artificial Intelligence . 1993

[11] FRIEDMAN J H.An overview of predictive learning and function approximation. From statisticsto neural networks:theory and pattern recognition applications,Proceeding of the ASI Conference,Subseries F . 1994

[12] MOODY J.Prediction risk and architecture selection for neural networks. From Sta-tistics to Neural Networks:Theory and Pattern Recognition Applications,NATO ASI Series F . 1994
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!