GitHub Trends
10.1K subscribers
15.3K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#python #amd #cuda #gpt #inference #inferentia #llama #llm #llm_serving #llmops #mlops #model_serving #pytorch #rocm #tpu #trainium #transformer #xpu

vLLM is a library that makes it easy, fast, and cheap to use large language models (LLMs). It is designed to be fast with features like efficient memory management, continuous batching, and optimized CUDA kernels. vLLM supports many popular models and can run on various hardware including NVIDIA GPUs, AMD CPUs and GPUs, and more. It also offers seamless integration with Hugging Face models and supports different decoding algorithms. This makes it flexible and easy to use for anyone needing to serve LLMs, whether for research or other applications. You can install vLLM easily with `pip install vllm` and find detailed documentation on their website.

https://github.com/vllm-project/vllm
1
#javascript #amd #build_tool #commonjs #compiler #es2015 #es6 #esm #javascript #javascript_compiler #javascript_modules #loaders #module_bundler #plugins #web #web_performance #webpack

Webpack is a tool that helps you manage and bundle your JavaScript files for use in a browser. Here’s what you need to know Webpack combines multiple JavaScript files into one or several bundles, making it easier to load them in your web application.
- **Module Formats** You can use loaders to preprocess files (e.g., converting TypeScript to JavaScript) and plugins to extend Webpack's functionality (e.g., extracting CSS into separate files).
- **Code Splitting** It offers various optimizations to reduce the output size of your JavaScript, such as minifying and deduplicating modules.

Using Webpack can make your web application faster and more efficient by optimizing how your code is loaded and executed. You can install it using npm or yarn with commands like `npm install --save-dev webpack` or `yarn add webpack --dev`.

https://github.com/webpack/webpack
#cplusplus #amd #dlss #framegeneration #fsr2 #fsr3 #intel #nvidia #tweak #upscaler #xess

OptiScaler is a tool that helps you change how games look by using different upscaling methods like DLSS, FSR, or XeSS. It allows you to replace one method with another in games that already support these technologies. This means you can choose the best option for your computer's hardware, improving performance and visuals. OptiScaler also offers features like frame generation and anti-lag options, making it easier to customize your gaming experience. However, be careful not to use it with online games as it might trigger anti-cheat systems.

https://github.com/cdozdil/OptiScaler