GitHub Trends
10.1K subscribers
15.3K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#python #billion_parameters #compression #data_parallelism #deep_learning #gpu #inference #machine_learning #mixture_of_experts #model_parallelism #pipeline_parallelism #pytorch #trillion_parameters #zero

DeepSpeed is a powerful tool for training and using large artificial intelligence models quickly and efficiently. It allows you to train models with billions or even trillions of parameters, which is much faster and cheaper than other methods. With DeepSpeed, you can achieve significant speedups, reduce costs, and improve the performance of your models. For example, it can train ChatGPT-like models 15 times faster than current state-of-the-art systems. This makes it easier to work with large language models without needing massive resources, making AI more accessible and efficient for everyone.

https://github.com/microsoft/DeepSpeed
#go #compression #decompression #deflate #go #golang #gzip #snappy #zip #zstandard #zstd

The "github.com/klauspost/compress" package offers many fast and efficient compression tools in pure Go, including zstandard, S2 (a faster Snappy replacement), optimized deflate for gzip/zip/zlib, and snappy with better compression and concurrency. It also provides entropy encoders (huff0, FSE), HTTP gzip handlers, and a parallel gzip implementation (pgzip). These tools are drop-in replacements for Go's standard libraries but run about twice as fast, saving time and resources. You can easily add it to your project with `go get`. It supports current and recent Go versions and offers options to disable unsafe code or assembly for compatibility. This package benefits you by improving compression speed and efficiency while maintaining compatibility with standard Go compression APIs, making your applications faster and more resource-friendly.

https://github.com/klauspost/compress