I want to create an application that can determine if some text was copied between two documents by reading the text from the two documents and comparing them. I wanted to know if anyone had ever tried to do this and what was the best way of handling the same. If machine learning and natural language processing are involved: to what level?
Share
I believe Copyscape uses 4-grams to help determine uniqueness.
These strings are referred to as N-Grams.
However, another SO answer linked to a language independent algo comparing bi-grams on a character basis. It’s already implemented in Java, which would help save time.