lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 1 month agoDatacenters in space are a terrible, horrible, no good idea.taranis.ieexternal-linkmessage-square284linkfedilinkarrow-up1673arrow-down114cross-posted to: technology@lemmy.ziptechnology@lemmy.mlpulse_of_truth@infosec.pubhackernews@lemmy.bestiver.se
arrow-up1659arrow-down1external-linkDatacenters in space are a terrible, horrible, no good idea.taranis.ielemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 1 month agomessage-square284linkfedilinkcross-posted to: technology@lemmy.ziptechnology@lemmy.mlpulse_of_truth@infosec.pubhackernews@lemmy.bestiver.se
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·1 month ago So from the inference / customer computation side of things, it isn’t a problem. Not necessarily. There are inference schemes where spreading MoE models across 40+ GPUs with a fast interconnect yields better efficiency. looks like blackwells can run sunstained at 88c The coolant still needs to remain relatively cool to hold that silicon temperature, though. Practically it can’t be like 60C.
minus-squareNotMyOldRedditName@lemmy.worldlinkfedilinkEnglisharrow-up1·1 month ago The coolant still needs to remain relatively cool to hold that silicon temperature, though. Practically it can’t be like 60C. Ah, ya that makes sense, whatever the numbers the the chip can be the coolant will be less.
Not necessarily. There are inference schemes where spreading MoE models across 40+ GPUs with a fast interconnect yields better efficiency.
The coolant still needs to remain relatively cool to hold that silicon temperature, though. Practically it can’t be like 60C.
Ah, ya that makes sense, whatever the numbers the the chip can be the coolant will be less.