I found an interesting article that I want to share with you about Data Mining.
The article was Published at "The New York Times" on October 7, 2008 by Eric Lichtblau
WASHINGTON — "A federal panel of policy makers and scientific experts urged a government-wide evaluation Tuesday of programs that sift through databases looking for clues on terrorism, to determine whether the programs are effective and legal. The federal government has made aggressive use of so-called data-mining tools since the attacks of Sept. 11, 2001, as counterterrorism officials in many intelligence agencies have sought to analyze records on travel habits, calling patterns, e-mail use, financial transactions and other data to pinpoint possible terrorist activity.
The National Security Agency’s program for wiretapping terror suspects without warrants, the screening of suspicious airline passengers and the Pentagon’s ill-fated Total Information Awareness program, shut down by Congress in 2003 because of privacy concerns, have all relied on aspects of data mining.
But in a 352-page government study released on Tuesday, a committee of the National Research Council warned that successfully using these tools to deter terrorism “will be extremely difficult to achieve” because of legal, technological and logistical problems. It said a haphazard approach to using such tools threatened both Americans’ privacy rights and the country’s legitimate national security needs.
Mining through data patterns has been shown to work in commercial settings to predict what kind of toothpaste people may buy and what kind of movie they are likely to rent, or to detect casino card-counters or those engaged in credit card fraud.
But there is little evidence to confirm that the techniques work to actually find terrorists, despite the growing use in the last seven years, committee members said. Part of the problem, they said, is that the sample of known terrorists and actual attacks is so small that it is difficult to establish patterns of suspicious behavior.
The push to accumulate enormous amounts of information has also produced the risk of “a huge number of false leads” that could implicate people with no actual connections to terrorism, the committee said.
“More data does not mean better data,” said William J. Perry, the former defense secretary who was co-chairman of the panel, with Charles M. Vest, president of the National Academy of Engineering. "
Read entire article here
