Ai Winter Article Index for
Ai
Website Links For
Winter
 

Information About

Ai Winter




An AI Winter is a collapse in the perception of Artificial Intelligence research. The term was coined by analogy with the relentless spiral of a Nuclear Winter : a chain reaction of pessimism in the AI community, followed by pessimism in the press, followed by a severe cutback in funding, followed by the end of serious research. AI Expert Newsletter: W is for Winter

It first appeared in 1984 as the topic of a public debate at the annual meeting of AAAI (then called the "American Association of Artificial Intelligence"). Two leading AI researchers, Roger Schank and Marvin Minsky , warned the business community that enthusiasm for AI had spiraled out of control and that disappointment would certainly follow. They were right. Just three years later, the billion dollar AI industry began to collapse.

The process of hype, disappointment and funding cuts are common in many advancing technologies (consider the Dot-com Bubble and the Software Crisis ), but the problem has been particularly acute for AI. The pattern has occurred many times:
  • 1966: the failure of Machine Translation ,

  • 1970: the abandonment of Connectionism ,

  • 1971-75: DARPA 's frustration with the Speech Understanding Research program at CMU ,

  • 1973: the end of AI research in England in response to the Lighthill Report ,

  • 1973-74: DARPA 's cutbacks to academic AI research in general,

  • 1987: the collapse of the Lisp Machine market,

  • 1993: Expert Systems slowly reaching the bottom,

  • 1990 or so: the quiet disappearance of the Fifth Generation Computer project's original goals

  • and the generally bad reputation AI has had since.

  • The worst times for AI were the period 1974-1980 and then 1987 to the present. Sometimes one or the other of these periods (or some part of them) is referred to as ''the'' AI winter.Two examples: (1) : "Lighthill's {Link without Title} report provoked a massive loss of confidence in AI by the academic establishment in the UK (and to a lesser extent in the US). It persisted for a decade - the so-called '"AI Winter'", (2) : "Overall, the AI industry boomed from a few million dollars in 1980 to billions of dollars in 1988. Soon after that came a period called the 'AI Winter'".


The historical episodes known as AI Winters are collapses only in the ''perception'' of AI by government bureacrats and venture capitalists. Despite the rise and fall of AI's reputation, it has continued to develop new and successful technologies.




EARLY EPISODES


Machine translation and the ALPAC report of 1966

See Also: History of machine translation


During the Cold War , the US government was particularly interested in the automatic, instant translation of Russian documents and scientific reports. The government aggressively supported efforts at Machine Translation starting in 1954. At the outset, the researchers were optimistic. Noam Chomsky 's new work in Grammar was streamlining the translation process and there were "many predictions of imminent 'breakthroughs'".John Hutchins 2005 The history of machine translation in a nutshell.


However, researchers had underestimated the profound difficulty of Disambiguation . In order to translate a sentence, a machine needed to have some idea what the sentence was about, otherwise it made ludicrous mistakes. A famous example was "the spirit is willing but the flesh is weak." Translated back and forth with Russian, it became "the vodka is good but the meat is rotten." Later researchers would call this the Commonsense Knowledge problem.

By 1964, National Research Council had become concerned about the lack progress and formed the Automatic Language Processing Advisory Committee ( ALPAC ) to look into the problem. They concluded, in a famous 1966 report, that machine translation was more expensive, less accurate and slower than human translation. After spending some 20 million dollars, the NRC ended all support. Careers were destroyed and research ended.

Machine translation is still an Open research problem in the 21st century.


The abandonment of perceptrons in 1969


]]
A for 10 years. Eventually, the work of Hopfield and others would revive the field and thereafter it would become a vital and useful part of artificial intelligence. Rosenblatt would not live to see this, as he died in a boating accident shortly after the book was published. and see also

The specific problems brought up by ''Perceptrons'' were ultimately addressed using Backpropagation and other modern Machine Learning techniques.



THE SETBACKS OF 1974


The S.U.R. debacle

DARPA was deeply disappointed with researchers working on the Speech Understanding Research program at CMU . DARPA had hoped, and felt it had been promised, to get a system that could respond to voice commands from a pilot. The SUR team had developed a system which could recognize spoken English, but ''only if the words were spoken in a particular order''. DARPA felt it had been duped and cancelled a three million dollar a year grant.

Many years later, successful commercial Speech Recognition systems would use the technology developed by the CMU team (such as Hidden Markov Models ) and the market for Speech Recognition systems would reach $4 billion by 2001.


The Lighthill report

See Also: Lighthill report



Professor Sir James Lighthill was asked by the Parliament Of The United Kingdom to evaluate the state of AI research in England . His report, now called the Lighthill Report , criticize the utter failure of AI to achieve its "grandiose objectives." He concluded that nothing being done in AI couldn't be done in other sciences. The report led to the complete dismantling of AI research in that country.

Lighthill was shown to be fundamentally mistaken in a public debate broadcast by the BBC . The winners of the debate were a team composed of Donald Michie , Richard Gregory and John McCarthy .


DARPA's funding cuts

After the passage of Mansfield Amendment in 1969, DARPA had been under increasing pressure to fund "mission-oriented direct research, rather than basic undirected research." Researchers now had to show that their work would soon produce some useful military technology. The Lighthill Report and DARPA 's own study (the American Study Group) suggested that most AI research was unlikely to produce anything truly useful in the foreseeable future. As a result, AI research proposals were held to a very high standard. Pure undirected research of the kind that had gone on in the 60s would not be funded by DARPA . (only the sections ''before'' 1980 apply to the current discussion).

By 1974, funding for AI projects was hard to find. AI researcher had been much too optimistic. Of course, what they delivered stopped considerably short of that. But they felt they couldn't in their next proposal promise less than in the first one, so they promised more."


THE SETBACKS OF THE LATE 80S AND EARLY 90S


The collapse of the Lisp machine market in 1987

In the 1980s a form of AI program called an " and Intellicorp , and hardware companies like Symbolics and Lisp Machines Inc. who built specialized computers, called Lisp Machines , that were optimized to process the programming language Lisp , the preferred language for AI.

In 1987, three years after Minsky and Schank 's prediction, the market for specialized AI hardware collapsed. Desktop computers from Apple and IBM had been steadily gaining speed and power and in 1987 they became more powerful than the more expensive Lisp Machines .One reason is that, as processor chips become more complex, the cost of designing one becomes greater relative to the cost of producing each copy. The value of high production volumes becomes correspondingly greater. Eventually, the cost-performance of a chip made in high volumes passes that of a specialized chip with lower production volumes, even if the latter is architecturally more suited to a given application area. There was no longer a good reason to buy them. An entire industry worth half a billion dollars was demolished overnight.

Commercially, many Lisp Machine companies failed, like Symbolics , Lisp Machines Inc. , Lucid Inc. , etc. However, a number of customer companies (that is, companies using systems written in Lisp and developed on Lisp machine platforms) continued to maintain systems. In some cases, this maintenance involved the assumption of the resulting support work. The maturation of Common Lisp saved many systems such as ICAD .


The fall of expert systems


Eventually the earliest successful expert systems, such as XCON , proved too expensive to maintain. They were difficult to update, the could not learn, they were "brittle" (i.e., they could made grotesque mistakes when given unusual inputs), and the fell prey to problems (such as the Qualification Problem ) that had been identified years earlier. Expert systems proved useful, but only in a few special contexts.

The few remaining Expert System Shell companies were eventually forced to downsize and search for new markets and software paradigms, like Case Based Reasoning or universal Database access.


The fizzle of the fifth generation


See Also: Fifth generation computer



In 1981, the Japanese Ministry Of International Trade And Industry set aside $850 million dollars for the Fifth Generation Computer project. Their objectives were to write programs and build machines that could carry on conversations, translate languages, interpret pictures, and reason like human beings. By 1991, the impressive list of goals penned in 1981 had not been met. Indeed, some of them had not been met in 2001. As with other AI projects, expectations had run much higher than what was actually possible.


THE STATE OF AI TODAY


The winter that wouldn't end

A survey of recent reports suggests that AI's reputation is still less than pristine:



AI underground

During an AI winter, AI researchers tend not to call their research AI but something else, for example Knowledge-based Systems or Informatics .


Fear of another winter

Concerns are sometimes raised that a new AI winter could be triggered by any overly ambitious or unrealistic promise by prominent AI scientists. For example, some researchers feared that the widely publicised promises in the early 1990s that Cog would show the intelligence of a human two-year-old might lead to an AI winter. In fact, the Cog project and the success of Deep Blue seems to have led to an ''increase'' of interest in Strong AI in that decade from both government and industry.


Hope of another spring

There are also constant reports that another AI spring is imminent:
  • Heather Halvenstein in ''Computerworld'', 2005: "Researchers now are emerging from what has been called an 'AI winter'"Heather Havenstein Spring comes to AI Winter , ''Computer World'', 2/14/2005

  • John Markoff in ''The New York Times'', 2005: "Now there is talk about an A.I. spring among researchers"




AI Now

Technologies developed by AI researchers have achieved commercial success in a number of domains, for example Fuzzy Logic controllers have been developed for automatic gearboxes in automobiles (the 2006 Audi TT, VW Toureg and VW Caravell feature the DSP transmission which utilizes Fuzzy logic, a number of Skoda varients [http://en.wikipedia.org/wiki/%C5%A0koda_Fabia also currently include a Fuzzy Logic based controler). Camera sensors widely utilize Fuzzy Logic [http://en.wikipedia.org/wiki/Fuzzy_control_system#History_.26_applications] to enable focus (ironically).

Heuristic Search and Data Analytics are both technologies that have developed from the Evolutionary Computing and Machine Learning subdivision of the AI research community. Again, these techniques have been applied to a wide range of real world problems with considerable commercial success.

In the case of Heuristic Search iLog has developed a large number of applications including deriving job shop schedules for many manufacturing installations [http://findarticles.com/p/articles/mi_m0KJI/is_7_117/ai_n14863928 . Many telecommunications companies also make use of this technology in the management of their workforces, for example BT has deployed heuristic search[http://www.theorsociety.com/Science_of_Better/htdocs/prospect/can_do/success_stories/dwsbt.htm] in a scheduling application that provides the work schedules of 20000 engineers.

Data Analytics technology utilizing algorithms for the automated formation of classifiers that were developed in the supervised machine learning community in the 1990's (for example, TDIDT, Support Vector Machines, Neural Nets, IBL) are now used pervasively by companies for marketing survey targeting and discovery of trends and features in data-sets.

Another way to judge the state of AI research is to look at the research programs that are currently being funded by the major funding agencies in the developed world.

Two bodies are currently supporting research in AI. DARPA in the USA supports a Grand Challenge Program which has developed fully automated road vehicles that can successfully navigate real world terrain [http://www.darpa.mil/body/video/DARPA_GCE_Highlights.wmv in a fully autonomous fashion.

DARPA has also supported programs on the Semantic Web with a great deal of emphasis on intelligent management of content and automated understanding. However James Hendler who was the manager of the DARPA program at the time has expressed some disappointment {Link without Title} with the outcome of the programme.

As of 2007 DARPA is soliciting AI research proposals under a number of programs including "Cognitive Technology Threat Warning System (CT2WS)", "SN07-43 Human Assisted Neural Devices", "AUTONOMOUS REAL-TIME GROUND UBIQUITOUS SURVEILLANCE- IMAGING SYSTEM (ARGUS-IS)" and "URBAN REASONING AND GEOSPATIAL EXPLOITATION TECHNOLOGY (URGENT)"

The EU-FP7 programme is a civilian funding program that is used to provide support to researchers in the European Union. Currently it funds AI research under the Cognitive Systems , Interaction and Robotics Programme (€193m), the Digital Libraries and Content Programme (€203m) and the FET programme (€185m) ftp://ftp.cordis.europa.eu/pub/ist/docs/kct/fp7-ict-at-glance_en.pdf


NOTES



REFERENCES









SEE ALSO



EXTERNAL LINKS