#python #asynchronous_programming #asyncio #deep_learning #deep_neural_networks #dht #distributed_systems #distributed_training #hivemind #mixture_of_experts #pytorch #volunteer_computing
https://github.com/learning-at-home/hivemind
https://github.com/learning-at-home/hivemind
GitHub
GitHub - learning-at-home/hivemind: Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across…
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world. - learning-at-home/hivemind
#python #bloom #deep_learning #distributed_systems #language_models #large_language_models #machine_learning #neural_networks #pytorch #volunteer_computing
https://github.com/bigscience-workshop/petals
https://github.com/bigscience-workshop/petals
GitHub
GitHub - bigscience-workshop/petals: 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading - bigscience-workshop/petals