Estimating the Number of Hidden Nodes of the Single-Hidden-Layer Feedforward Neural Networks
Title | Estimating the Number of Hidden Nodes of the Single-Hidden-Layer Feedforward Neural Networks |
Publication Type | Conference Paper |
Year of Publication | 2019 |
Authors | Cai, Guang-Wei, Fang, Zhi, Chen, Yue-Feng |
Conference Name | 2019 15th International Conference on Computational Intelligence and Security (CIS) |
Date Published | 05 March 2020 |
Publisher | IEEE |
ISBN Number | 978-1-7281-6092-4 |
Keywords | Artificial neural networks, attribute-based data normalization, compositionality, Computer architecture, cyber physical systems, data normalization, decomposition, Eigenvalues and eigenfunctions, feedforward neural nets, Feedforward neural networks, hidden nodes, Metrics, normalized data, optimal number, pubcrawl, sample-based data normalization, single-hidden-layer feedforward neural network, singular value decomposition, Training, Training data |
Abstract | In order to solve the problem that there is no effective means to find the optimal number of hidden nodes of single-hidden-layer feedforward neural network, in this paper, a method will be introduced to solve it effectively by using singular value decomposition. First, the training data need to be normalized strictly by attribute-based data normalization and sample-based data normalization. Then, the normalized data is decomposed based on the singular value decomposition, and the number of hidden nodes is determined according to main eigenvalues. The experimental results of MNIST data set and APS data set show that the feedforward neural network can attain satisfactory performance in the classification task. |
URL | https://ieeexplore.ieee.org/document/9023723 |
DOI | 10.1109/CIS.2019.00044 |
Citation Key | cai_estimating_2019 |
- hidden nodes
- Training data
- Training
- singular value decomposition
- single-hidden-layer feedforward neural network
- sample-based data normalization
- pubcrawl
- optimal number
- normalized data
- Metrics
- Artificial Neural Networks
- Feedforward neural networks
- feedforward neural nets
- Eigenvalues and eigenfunctions
- decomposition
- data normalization
- cyber physical systems
- computer architecture
- Compositionality
- attribute-based data normalization