Open Access Open Access  Restricted Access Subscription Access

A Novel Clustering Algorithm based on Particle Swarm Optimization

Xiaojun Wu

Abstract


K-means clustering algorithm is widely used in the clustering analysis. It takes the mean value of each cluster center as the Heuristic information, so it has high computation efficiency. But it also has limitations: sensitive to the initial center and easy to fall into local optimum. Particle Swarm Optimization has the characteristics of Parallelism and distribution in searching which is convenient in processing massive data. Because of its  good ability in global searching, it can overcome the disadvantages of K-means algorithm. By improving PSO algorithm, it can enhance the searching probability around the optimal solutions and reduce the sensitivity to the initialization. The combination of the improved PSO algorithm and K-means can improve the stability and convergence efficiency. Experimental results on four UCI data  sets show that the novel algorithm has the ability to identify clusters more efficiently.

Full Text:

PDF

References


Jiawei,Han.M.Kamber, Data Mining: Concepts and Techniques.Los Altos, CA:Morgan Kaufmann Publishers,2001

Jiang Yuan, Zhang Chaoyang, Qiu Peiliang, Clustering Algorithm in Data Mining[J]. Journal of Electronics & Information Technology. 2005(4) 655-660

Zhang Wei, Liao Xiaofeng, Wu Zhongfu. A new Clustering Algorithm based on GA[J]. Computer Science. 2002,29(6):114 -1171

Selim S Z, Ismail M A. K-means-type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality[J]. IEEE Trans. on Pattern Analysis and Machine Intelligence, 1984,6(1): 81-87

Bandyopadhyay S, Maulik U. Genetic Clustering for Automatic Evolution of Clusters and Application to Image Classification[J].Pattern Recognition, 2002, 35(2): 1197-1208.

De Castro L N, Von Zuben F J. An evolutionary immune network for data clustering [C]M Proceeding of the IEEE Brazilian Symposium on Artificial Neural Networks, Riode Janeiro, Brazil. 2000: 84-89.

ZhangD X, LiuX Z, Guan Z H. A dynamic clustering algorithm based on pso and application in fuzzy identification[C]. //Proceedings of the IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing, California, USA, 2006: 232-235.

Clerc M. The Swarm and the Queen: Towards a Deterministic and Adaptive Particle Swarm Optimization. In:Proc.1999 Congress on Evolutionary Computation. Washington, DC, Piscataway, NJ:IEEEServiceCenter,1999, 1951-1957.

Gao Ying, Xie Shengli. The Immune Particle Swarm Optimization Algorithm[J]. Computer Engineering and Applications. 2004，40 (6)：416-420.

Gao Ying, Xie Shengli. Chaotic Particle Swarm Optimization Algorithm[J]. Computer Science. 2004，31(8)：13-15.

Parsopoulos K E. Stretching Technique for Obtaining Global Minimizers through Particle Swarm Optimization[R].Proceedings of the Workshop on PSO,Indianapolis:Purdue school of Engineering and Technology,INPUI,2001.

Wang Zhengshuai, Deng Kazhong. Random PSO Algorithm based on Culture Framework[J].Computer Science. 2012,39(6):198-200

Wang Wan-liang, Tang Yu. The State of Art in Particle Swarm Optimization Algorithm[J]. Journal of ZheJiang University of Technology. 2007，35(2)；136-141.

Wu Xiaojun, Yang Zhanzhong, Zhao Ming. A uniform searching particle swarm optimization algorithm [J].ACTA Electronic Sinica.2011(6):1261-1266

Vance Faber. Clustering and the Continuous k-Means Algorithm.Los Alamos Science Number 22 1994, http://www.c3.lanl.gov/~kelly/ml/pubs/1994_concept/sidebar.pdf.

Mali U, Bandyopadhyay S. Genetic algorithm-based clustering technique. Pattern Recognition, 2000, 33(9): 1455–1465

OMRANGM, SALMAN A, ENGELBRECHTA P. Image classifica-tion using particle swarm optimization[C] //Proc of the 4th Asia-Pa-cific Conference on Simulated Evolution and Learning. 2002: 370-374.

Yang Jiujun, Deng Huiwen, Teng Zi. Cluster analysis based on hybrid particle swarm optimization algorithm[J]. Computer Engineering and Design. 2008,29(22):5820-5823

Wang Lei, Ji Huan, Xu Qingzheng. A Dynamic Clustering Analysis Based on Artificial Immune Particle Swarm Optimization Algorithm[J]. Journal of Xi’an University of Technology. 2008,24(4):390-394

Liu Xiangdong, Sha Qiufu, Liu Yongkui, Duan Xiaodong. Clustering Analysis based on PSO[J]. Computer Engineering. 2006,32(6):201-202,217

WANG Li, LIU Yu-shu, ZHAO Xin-xin, etal. Particle swarm optimization for fuzzy C-means clustering [C] //Proc of the 6th World Congress on Intelligent Control and Automation. 2006: 6055-6058.

LI Li-li, LIU Xi-yu, LIU Ming-ming. A novel fuzzy clustering based on particle swarm optimization[C] //Proc of the 1st IEEE International Symposium on Information Technologies and Applications in Education. 2007: 88-90.

OMRANM G H, SALMANA, ENGLBRECHTA P. Dynamic clustering using particle swarm optimization with application in image segmentation[J].Pattern Analysis and Applications, 2005,8(4):332-344.

OMRANM G, ENGLBRECHTA P, SALMAN A. Dynamic clustering using particle swarm optimization with application in unsupervised image classification[C] //Proc of the 5th World Enformatika Conference. 2005: 199-204.

Fvan den Bergh, A P Engelbrecht. A cooperative approach to particle swarm optimization[J]. IEEE Transactions On Evolutionary Computation, 2004, 8(3):225-239




DOI: http://dx.doi.org/10.21535%2FProICIUS.2014.v10.304

Refbacks

  • There are currently no refbacks.