Integrating Discriminant and Descriptive Information for Dimension Reduction and Classification

dc.contributor.authorYu, Jie
dc.contributor.authorTian, Qi
dc.contributor.authorRui, Ting
dc.contributor.authorHuang, Thomas S.
dc.description.abstractIn this paper, a novel hybrid dimension reduction technique for classification is proposed based on the hybrid analysis of principal component analysis (PCA) and linear discriminant analysis (LDA). LDA is known for capturing the most discriminant features of the data in the projected space while PCA is known for preserving the most descriptive ones after projection. Our hybrid technique integrates discriminant and descriptive information and finds a richer set of alternatives beyond LDA and PCA in a 2D parametric space, which fits a specific classification task and data distribution better. Theoretical study shows that our technique also alleviates the singularity problem of scatter matrix, which is caused by small training set, and increases the effective dimension of the projected subspace. In order to find the hybrid features adaptively and avoid exhaustive parameter searching, we further propose a boosted hybrid analysis method that incorporates a non-linear boosting process to enhance a set of hybrid classifiers and combine them into a more accurate one. Compared with the other techniques that aim at combining PCA and LDA, our approaches are novel because our method finds alternatives to LDA and PCA in a 2D parameter space and the boosting process provides enhancement and robust combination of the classifiers. Extensive experiments are conducted on benchmark and real image databases to compare our proposed methods to the state-of-the-art linear and non-linear discriminant analysis techniques. The results show the superior performance of our hybrid analysis methods.
dc.description.departmentComputer Science
dc.publisherUTSA Department of Computer Science
dc.relation.ispartofseriesTechnical Report; CS-TR-2007-012
dc.subjectimage classification
dc.subjectinformation retrieval
dc.subjectpattern recognition
dc.subjectartificial intelligence
dc.titleIntegrating Discriminant and Descriptive Information for Dimension Reduction and Classification
dc.typeTechnical Report


Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
234.87 KB
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
1.86 KB
Item-specific license agreed upon to submission