Created by danilo 16/04/2018, Symmetric Delete spelling correction algorithm.
Created by danilo 16/04/2018,
Created by danilo 16/04/2018,
Inspired on https://github.com/wolfgarbe/SymSpell
The Symmetric Delete spelling correction algorithm reduces the complexity of edit candidate generation and dictionary lookup for a given Damerau-Levenshtein distance. It is six orders of magnitude faster (than the standard approach with deletes + transposes + replaces + inserts) and language independent.
See https://github.com/JohnSnowLabs/spark-nlp/blob/master/src/test/scala/com/johnsnowlabs/nlp/annotators/spell/symmetric/SymmetricDeleteModelTestSpec.scala for further reference.
Created by danilo 16/04/2018, Symmetric Delete spelling correction algorithm. It retrieves tokens and utilizes distance metrics to compute possible derived words.
Inspired by https://github.com/wolfgarbe/SymSpell
See https://github.com/JohnSnowLabs/spark-nlp/blob/master/src/test/scala/com/johnsnowlabs/nlp/annotators/spell/symmetric/SymmetricDeleteModelTestSpec.scala for further reference.