Trustworthiness of t-Distributed Stochastic Neighbour Embedding
Title | Trustworthiness of t-Distributed Stochastic Neighbour Embedding |
Publication Type | Conference Paper |
Year of Publication | 2016 |
Authors | Pandey, Shishir, Vaze, Rahul |
Conference Name | Proceedings of the 3rd IKDD Conference on Data Science, 2016 |
Publisher | ACM |
Conference Location | New York, NY, USA |
ISBN Number | 978-1-4503-4217-9 |
Keywords | composability, dimension reduction, nonlinear embedding, pubcrawl, t-SNE, trustworthiness, trustworthy |
Abstract | A well known technique for embedding high dimensional objects in two or three dimensional space is the t-distributed stochastic neighbour embedding (t-SNE). The t-SNE minimizes the Kullback-Liebler (KL) divergence between two probability distributions, one induced on points in the high dimensional space and the other induced on points in the low dimensional embedding space. In this work, we consider a more general framework of using Renyi divergence which is parametrized by the order a, the KL-divergence is a special case when a - 1.We study how various Renyi divergences perform when compared to the KL-divergence. We show that in terms of the metrics of trustworthiness and neighbourhood preservation, the embedding becomes better as Renyi divergence approaches the KL-divergence. |
URL | http://doi.acm.org/10.1145/2888451.2888465 |
DOI | 10.1145/2888451.2888465 |
Citation Key | pandey_trustworthiness_2016 |