Please use this identifier to cite or link to this item:
|Title:||Efficient token based clone detection with flexible tokenization||Authors:||Basit, H.A.
Token-based clone detection
|Issue Date:||2007||Citation:||Basit, H.A.,Puglisi, S.J.,Smyth, W.F.,Turpin, A.,Jarzabek, S. (2007). Efficient token based clone detection with flexible tokenization. Proceedings of the the 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering 2007, ESEC-FSE'07 : 513-516. ScholarBank@NUS Repository.||Abstract:||Code clones are similar code fragments that occur at multiple locations in a software system. Detection of code clones provides useful information for maintenance, reengineering, program understanding and reuse. Several techniques have been proposed to detect code clones. These techniques differ in the code representation used for analysis of clones, ranging from plain text to parse trees and program dependence graphs. Clone detection based on lexical tokens involves minimal code transformation and gives good results, but is computationally expensive because of the large number of tokens that need to be compared. We explored string algorithms to find suitable data structures and algorithms for efficient token based clone detection and implemented them in our tool Repeated Tokens Finder (RTF). Instead of using suffix tree for string matching, we use more memory efficient suffix array. RTF incorporates a suffix array based linear time algorithm to detect string matches. It also provides a simple and customizable tokenization mechanism. Initial analysis and experiments show that our clone detection is simple, scalable, and performs better than the previous well-known tools.||Source Title:||Proceedings of the the 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering 2007, ESEC-FSE'07||URI:||http://scholarbank.nus.edu.sg/handle/10635/41197|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on Aug 19, 2019
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.