Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.