Please use this identifier to cite or link to this item:
https://scholarbank.nus.edu.sg/handle/10635/237667
DC Field | Value | |
---|---|---|
dc.title | SUPPORTING GENERIC CLUSTERING AND SIMILARITY SEARCH FOR MASSIVE DATASETS | |
dc.contributor.author | LUO PINGYI | |
dc.date.accessioned | 2023-02-28T18:00:48Z | |
dc.date.available | 2023-02-28T18:00:48Z | |
dc.date.issued | 2022-08-01 | |
dc.identifier.citation | LUO PINGYI (2022-08-01). SUPPORTING GENERIC CLUSTERING AND SIMILARITY SEARCH FOR MASSIVE DATASETS. ScholarBank@NUS Repository. | |
dc.identifier.uri | https://scholarbank.nus.edu.sg/handle/10635/237667 | |
dc.description.abstract | Clustering and Similarity Search are two crucial challenges in big data analytics. The large cardinality, dimensionality, and diverse nature of big data require analytic methods to be both efficient and flexible for various distance functions. However, there is a lack of research focused on generic functionality that simultaneously supports multiple distance functions. In this thesis, we first propose a generic distributed clustering framework to process large-scale data with different distance functions by leveraging different Locality-Sensitive Hashing. We further investigate the clustering problem in sparse data and introduce a new method k-FreqItems with a novel sparse center representation called FreqItem. Additionally, we present a seeding technique that significantly improves the convergence speed of k-FreqItems. Finally, with the support of our clustering methods, we incorporate a generic similarity search framework GENIE with a two-level distributed indexing structure and develop a scalable framework dGENIE for billion-scale data. | |
dc.language.iso | en | |
dc.subject | Clustering, Similarity Search, Generic Framework, Locality-Sensitive Hashing, Large-scale data, Parallel Computing | |
dc.type | Thesis | |
dc.contributor.department | COMPUTER SCIENCE | |
dc.contributor.supervisor | Kum Hoe, Anthony Tung | |
dc.description.degree | Ph.D | |
dc.description.degreeconferred | DOCTOR OF PHILOSOPHY (SOC) | |
dc.identifier.orcid | 0000-0002-7389-4266 | |
Appears in Collections: | Ph.D Theses (Open) |
Show simple item record
Files in This Item:
File | Description | Size | Format | Access Settings | Version | |
---|---|---|---|---|---|---|
LuoPY.pdf | 13.87 MB | Adobe PDF | OPEN | None | View/Download |
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.