Comments on: When a terabyte is small http://lemire.me/blog/archives/2008/02/21/when-a-terabyte-is-small/ Computer Scientist and Open Scholar: Databases, Information Retrieval, Business Intelligence. Wed, 23 May 2012 16:42:57 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: Kevembuangga http://lemire.me/blog/archives/2008/02/21/when-a-terabyte-is-small/comment-page-1/#comment-49741 Kevembuangga Thu, 21 Feb 2008 21:20:03 +0000 http://www.daniel-lemire.com/blog/archives/2008/02/21/when-a-terabyte-is-small/#comment-49741 BTW, why not using outsourced storage and computation power? The NYT did it: http://open.blogs.nytimes.com/tag/hadoop/ (via Lukas Biewald http://www.lukasbiewald.com/?p=134 ) BTW, why not using outsourced storage and computation power?
The NYT did it:
http://open.blogs.nytimes.com/tag/hadoop/

(via Lukas Biewald http://www.lukasbiewald.com/?p=134 )

]]> By: Kevembuangga http://lemire.me/blog/archives/2008/02/21/when-a-terabyte-is-small/comment-page-1/#comment-49740 Kevembuangga Thu, 21 Feb 2008 20:59:15 +0000 http://www.daniel-lemire.com/blog/archives/2008/02/21/when-a-terabyte-is-small/#comment-49740 LOL!!! You are probably not old enough to know that rule: No matter the size of the drive it is ALWAYS 95/98% full so for the "next run" (whatever this is) you have first to upgrade. This is probably even more "solid" than Moore's law. In the very early 70s a 5 <b>megabytes</b> drive was "large"... LOL!!!
You are probably not old enough to know that rule:
No matter the size of the drive it is ALWAYS 95/98% full so for the “next run” (whatever this is) you have first to upgrade.
This is probably even more “solid” than Moore’s law.
In the very early 70s a 5 megabytes drive was “large”…

]]> By: Sérgio Nunes http://lemire.me/blog/archives/2008/02/21/when-a-terabyte-is-small/comment-page-1/#comment-49739 Sérgio Nunes Thu, 21 Feb 2008 20:00:35 +0000 http://www.daniel-lemire.com/blog/archives/2008/02/21/when-a-terabyte-is-small/#comment-49739 I think this is one big obstacle for current research in IR. The time spent dealing with "infrastructure" is getting bigger. This leaves less time for real research. I think that, in the broad field of IR, "industry research" is going to produce much more results in the next years than "academia research". Google's Peter Norvig is quoted saying - Google does not have the best minds, they have a great infrastructure that allows them to experiment much faster. How can academia deal with this? I think this is one big obstacle for current research in IR. The time spent dealing with “infrastructure” is getting bigger. This leaves less time for real research. I think that, in the broad field of IR, “industry research” is going to produce much more results in the next years than “academia research”.

Google’s Peter Norvig is quoted saying – Google does not have the best minds, they have a great infrastructure that allows them to experiment much faster.

How can academia deal with this?

]]>