Ye, Qiang
(2010)
Competitive Learning Neural Network Ensemble Weighted by Predicted Performance.
Doctoral Dissertation, University of Pittsburgh.
(Unpublished)
Abstract
Ensemble approaches have been shown to enhance classification by combining the outputs from a set of voting classifiers. Diversity in error patterns among base classifiers promotes ensemble performance. Multi-task learning is an important characteristic for Neural Network classifiers. Introducing a secondary output unit that receives different training signals for base networks in an ensemble can effectively promote diversity and improve ensemble performance. Here a Competitive Learning Neural Network Ensemble is proposed where a secondary output unit predicts the classification performance of the primary output unit in each base network. The networks compete with each other on the basis of classification performance and partition the stimulus space. The secondary units adaptively receive different training signals depending on the competition. As the result, each base network develops ¡°preference¡± over different regions of the stimulus space as indicated by their secondary unit outputs. To form an ensemble decision, all base networks¡¯ primary unit outputs are combined and weighted according to the secondary unit outputs. The effectiveness of the proposed approach is demonstrated with the experiments on one real-world and four artificial classification problems.
Share
| Citation/Export: |
|
| Social Networking: |
|
Details
| Item Type: |
University of Pittsburgh ETD
|
| Status: |
Unpublished |
| Creators/Authors: |
|
| ETD Committee: |
|
| Date: |
12 May 2010 |
| Date Type: |
Completion |
| Defense Date: |
5 March 2010 |
| Approval Date: |
12 May 2010 |
| Submission Date: |
10 March 2010 |
| Access Restriction: |
No restriction; Release the ETD for access worldwide immediately. |
| Institution: |
University of Pittsburgh |
| Schools and Programs: |
School of Information Sciences > Information Science |
| Degree: |
PhD - Doctor of Philosophy |
| Thesis Type: |
Doctoral Dissertation |
| Refereed: |
Yes |
| Uncontrolled Keywords: |
bias and variance; classification; diversity; ensemble; multi-task learning; competitive learning; neural networks |
| Other ID: |
http://etd.library.pitt.edu/ETD/available/etd-03102010-152349/, etd-03102010-152349 |
| Date Deposited: |
10 Nov 2011 19:32 |
| Last Modified: |
15 Nov 2016 13:37 |
| URI: |
http://d-scholarship.pitt.edu/id/eprint/6478 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](/images/feed-icon-32x32.png){kind=icon}