상세정보
학술대회
Performance-related Internal Clustering Validation Index for Clustering-based Anomaly Detection
- 발행일
- 202110
- 출처
- International Conference on Information and Communication Technology Convergence (ICTC) 2021, pp.1036-1041
- 협약과제
- 21ZK1100, 호남권 지역산업 기반 ICT 융합기술 고도화 지원사업, 이길행
- 초록
- One possible way to improve unsupervised anomaly detection is to use per-cluster models, particularly when the given data includes various cluster-level features. In realizing clustering-based anomaly detection, one natural question is how to determine the number of clusters that will likely lead to the optimal performance. In this paper, we propose a method that reflects the performance of anomaly detection in determining the number of clusters. We first derive an internal clustering validation index using the normality scores of trained per-cluster models for unlabeled training data for cases with different numbers of clusters. Then, we determine the number of clusters by selecting the case whose clustering validation index is the highest, which means that per-cluster models extract useful features for anomaly detection. Through experiments, we show that our proposed clustering validation index is highly correlated with anomaly detection accuracy (i.e., the average Pearson correlation coefficient is 0.965).
- KSP 제안 키워드
- Cluster models, Cluster-level, Clustering validation, Clustering-Based, Detection accuracy, Determine the number of clusters, Pearson correlation coefficient, optimal performance, training data, unsupervised anomaly detection