Pete: Thanks for the information. This all sounds promising. I am sure that Hadoop can run on top of any of these VM management systems. (Rich tends to make anything that runs on Eucalyptus sound like a miraculous property of his software, but this is pretty standard stuff.) We've been running Hadoop on TeraPort, by the way. (Just FYI--there is some local experience.) Having 7 PB of storage would be great. Right now we can't even get 1 TB of storage at Argonne! :-) Ian. On Mar 16, 2009, at 10:51 PM, Pete Beckman wrote:
Here's the short overview:
We pitched $6-$8M in common infrastructure upgrades that can support computing at ANL (chilled water, power, UPSes, etc)
We pitched $4M in a 8000+ core cluster that we could slice up into chunks for research to run apps
We pitched $4M in a storage upgrade so we would have ~7PB of storage to do data-intensive map-reduce style stuff
We have not heard a word more about it from DC. Last Friday, after chatting with Rich Wolski about Nick and his PhD Candidacy exam, we discussed about the status of Eucalyptus and his suggestions for easily virtualizable network switches, etc. Traction with Eucalyptus has been amazing, and the Ubuntu folks will be distributing it as part of their distro in the upcoming Karmic Koala release. That means that shortly after that, most linux distros around the world will come with cloud computing built in... wow. RightScale has also partnered with him so the software works together. He told me that hadoop and AppScale run nicely on Eucalyptus, so when we do get our cloud booted, he suggested we run hadoop and appscale simply as instances.
I chatted with ORNL about their plan, and they had pitched a pod (a tractor trailer with servers in it). I've got Susan looking at them, and she has talked to Rackable and Verari and some others. We are exploring prices and utility. Susan found some articles where Microsoft has been pushing them....
In a similar note, last week I saw a presentation from a Sun guy, he claimed that 70% of their customers cannot buy the hardware they have money for because of data center limitations....
-Pete
On Mar 16, 2009, at 5:05 PM, Ian Foster wrote:
I'd be interested in any updates on DOE cloud initiatives, if they are available. Last I heard, there was talk of $12M each to Argonne, ORNL, LBNL for hardware. Is that still the plan? How are we proceeding to spec the hardware, etc.?
I'm still hoping we can set up an Azure tutorial. It seems like Tony and Dan are not communicating at all, with each of them telling us that they are working to make something happen.
_______________________________________________ Clouds mailing list [email protected] https://lists.mcs.anl.gov/mailman/listinfo/clouds