| Word Salad (computer Science) |
Article Index for Word |
Website Links For Word |
Information AboutWord Salad (computer Science) |
In context of mental health, see also Word Salad (mental Health) . Word salad is a mixture of seemingly meaningful words that together signify nothing; the phrase draws its name from the positive symptom of psychosis, Word Salad (mental Health) . When applied to a physical Theory , "word salad" it is a derogatory description that labels the theory as senseless or utterly devoid of meaning. In the context of Computer Science and Linguistics , explicitly constructed word salad is a tool for demonstrating the difference between random utterance and coherent expression of thought. Software such as the Dissociated Press within Emacs demonstrates the construction of interesting-but-meaningless word salad from large samples of coherent language, by constructing new, random documents that share some of the same word or letter clustering properties as the language sample. These word salads appear as natural language to the inattentive eye or ear, but are clearly meaningless when read or listened to with full attention. In the 21st century, E-mail Spammer s have begun using word salad construction as a way to elude e-mail filtering. IN SPAM E-MAIL In response to the growing problem of Spam E-mail , filtering tools became available starting around 2002 which implemented a widely employed method known as the Naive Bayes Classifier . This method uses the probability of various words appearing in spam Emails to automatically classify them as spam. For a short time, this worked fairly well to classify emails as probable spam. In response, spammers developed word salad to fool programs employing this method of classification. By adding large amounts of random text somewhere in their message, spammers hope to confuse Bayesian classifiers into classifying the message as " Ham E-mail " (non-spam e-mail). Typically, this text contains random words from a dictionary. Algorithms for detecting word salad are clearly possible and not particularly difficult to implement. They would be, for the most part, more computationally intensive than most rules used by spam filters today ( 2006 ). A statistical approach based on Zipf's Law of word frequency has potential in detecting simple word salad, as do grammar checking and the use of Natural Language Processing algorithms. Statistical Markovian analysis, where short phrases are used to determine if they are likely to occur in normal English sentences, is another statistical approach that would be effective against completely random phrasing but might be fooled by Dissociated Press techniques. Sentence and paragraph salad In a related technique, actual text from some large corpus of legitimate English (the plays of Shakespeare , other etexts distributed by Project Gutenberg , random World Wide Web pages, or the like) is added into the email. This approach attempts to get around algorithms that could be devised to detect the more primitive form of word salad. Paragraph salad will reduce the effectiveness of any of the algorithms mentioned above and will lead to higher scores with any Bayesian filters. The only algorithms that might thwart sentence and paragraph salad would be very high level and expensive natural language processing, some kind of artificial intelligence algorithm involving a search engine, or exhaustive listing of spam emails. All of these techniques would be exceptionally expensive, and would likely not be very successful at filtering spam despite their high cost. Letter salad |
|
|