GPU-acceleration of neighborhood-based dimensionality reduction algorithm EmbedSOM

Abstract:

Dimensionality reduction methods have found vast applications as visualization tools in diverse areas of science. Although many different methods exist, their performance is often insufficient for providing quick insight into many contemporary datasets. In this paper, we propose a highly optimized GPU implementation of EmbedSOM, a dimensionality reduction algorithm based on self-organizing maps. We detail the optimizations of k-NN search and 2D projection kernels which comprise the core of the algorithm. To tackle the thread divergence and low arithmetic intensity, we use a modified bitonic sort for k-NN search and a projection kernel that utilizes vector loads and register caches. The evaluated performance benchmarks indicate that the optimized EmbedSOM implementation is capable of projecting over 30 million individual data points per second.

BibTeX:

@inproceedings{smelko_gpuacceleration_2024,
    title = {{GPU-acceleration of neighborhood-based dimensionality reduction algorithm EmbedSOM}},
    author = {Šmelko, Adam and Kruliš, Martin and Klepl, Jiří},
    year = {2024},
    booktitle = {{16th Workshop on General Purpose Processing Using GPU}},
    publisher = {Association for Computing Machinery},
    location = {Edinburgh, Scotland},
    doi = {10.1145/3649411.3649414},
    isbn = {979-8-4007-1817-5},
    pages = {13--18},
    url = {https://dl.acm.org/doi/10.1145/3649411.3649414},
}

Proceedings paper