#rust #component_model #distributed_systems #durable_computing #durable_execution #fault_tolerance #high_reliability #serverless #wasi #wasm #wasm_component

Golem is a tool that lets you run WebAssembly components in a cloud environment. You can start using Golem on your local machine with Docker containers. Once set up, you can use the `golem-cli` tool to add and run your own code components. This makes it easy to test and deploy your applications in a distributed cloud setting. The benefit is that you can develop and test your applications locally before deploying them to the cloud, making it simpler and faster to get your projects up and running.

https://github.com/golemcloud/golem

#go #bigdata #cloud_native #distributed_systems #filesystem #go #golang #hdfs #object_storage #posix #redis #s3 #storage

JuiceFS is a powerful file system designed for cloud environments. It allows you to use massive cloud storage as if it were local storage, without changing your code. Here are the key benefits JuiceFS offers low latency and high throughput, making it suitable for big data, machine learning, and AI applications.
- **POSIX Compatibility** Supports Kubernetes and various object storage services like Amazon S3, Google Cloud Storage, and more.
- **Strong Consistency** Ensures data security and efficiency.
- **Shared Access**: Multiple clients can read and write files simultaneously.

Using JuiceFS, you can efficiently manage large amounts of data in the cloud, making it easier to integrate with various platforms and applications.

https://github.com/juicedata/juicefs

#go #cloud #cloud_computing #cloud_native #distributed_systems #go #golang #message_bus #message_queue #messaging #microservices_architecture #nats_server

NATS is a simple, secure, and fast communication system for digital systems, services, and devices. It can run anywhere, from your own server to the cloud or even a small device like a Raspberry Pi. NATS helps make complex systems easier to design and operate. With over 40 different language implementations, it's versatile and widely supported. Using NATS benefits you by providing a reliable and secure way to communicate between different parts of your system, making your work more efficient and stable.

https://github.com/nats-io/nats-server

#elixir #blockchain #consensus #cryptography #distributed_systems #elixir #erlang #operating_system #p2p #protocol

Anoma is a protocol that allows you to run a node for a decentralized network. To use it, you need to install several dependencies depending on your operating system (Mac, Windows, or Linux). You can either download pre-built binaries or compile the code yourself. Here are the key steps Download the release for your platform, extract it, and run the `bin/anoma` command.
- **Compilation**: Install necessary tools like Git, CMake, Rust, and Elixir, then follow the compilation instructions.

Following development is easy through GitHub issues, project overviews, and research forums. This helps you stay updated on what's being worked on and how the project is progressing.

The benefit to you is that you can participate in and contribute to a cutting-edge decentralized network, staying informed about its development and helping shape its future.

https://github.com/anoma/anoma

#other #architecture #awesome #awesome_list #backend #big_data #computer_science #design_patterns #devops #distributed_systems #interview #interview_practice #interview_questions #lists #machine_learning #programming #resources #scalability #system #system_design #web_development

This resource provides a comprehensive guide to building scalable, reliable, and performant large-scale systems. Here are the key benefits It offers detailed articles and case studies from prominent engineers on how to design systems that can handle heavy loads and perform well for both single users and millions of users.
- **System Design Interviews** It covers how to scale teams effectively, focusing on increasing team output and value rather than just growing the team size.
- **Community Contributions** The resource covers a wide range of topics including scalability, availability, stability, performance, intelligence, architecture, and more, providing a holistic view of system engineering.

Overall, this guide is invaluable for anyone looking to build or maintain large-scale systems efficiently.

https://github.com/binhnguyennus/awesome-scalability

#go #bugtracker #decentralized_application #distributed_systems #git #gitdb

git-bug is a powerful, decentralized issue tracker that stores issues, comments, and users directly inside a Git repository as versioned objects, not just files. This means you can manage your issues offline, sync them later, and keep everything clean and organized within your existing Git workflow. It’s very fast, supports syncing with platforms like GitHub and GitLab, and offers multiple ways to interact, including command line, text user interface, or web browser. This tool helps you track and manage project issues efficiently without needing a separate server or database, making collaboration and version control seamless.

https://github.com/git-bug/git-bug

#rust #bigdata #cloud_native #distributed_systems #filesystem #minio #object_storage #oss #rust #s3

RustFS is a fast and safe distributed object storage system built with Rust, offering high performance and scalability for large data needs like AI and big data. It is compatible with S3, easy to use, and open source under the business-friendly Apache 2.0 license. Compared to others like MinIO, RustFS provides better memory safety, no risky data logging, and supports local cloud providers. You can quickly install it via a script or Docker, manage storage through a simple web console, and benefit from a strong community and detailed documentation. This makes RustFS a reliable, cost-effective choice for secure, scalable storage.

https://github.com/rustfs/rustfs

#java #distributed_systems #durable_execution #grpc #java #javascript #microservice_orchestration #orchestration_engine #orchestrator #reactjs #spring_boot #workflow_automation #workflow_engine #workflow_management #workflows

Conductor is an open-source tool that helps you manage and automate complex workflows involving many microservices and systems. It makes your workflows flexible, reliable, and scalable by handling retries, errors, and monitoring automatically. You can define workflows as code in JSON, use various task types, and manage workflows dynamically without tightly coupling services. It offers an easy-to-use web interface and supports multiple databases like Redis and MySQL. This helps you build, run, and monitor workflows efficiently, saving time and reducing errors in managing distributed applications. It also has SDKs for Java, Python, JavaScript, Go, and C# to integrate easily with your projects.

https://github.com/conductor-oss/conductor

#go #blob_storage #cloud_drive #distributed_file_system #distributed_storage #distributed_systems #erasure_coding #fuse #hadoop_hdfs #hdfs #kubernetes #object_storage #posix #replication #s3 #s3_storage #seaweedfs #tiered_file_system

SeaweedFS is a fast, simple, and highly scalable distributed file system designed to store billions of files and serve them quickly, especially small files. It uses a master server to manage volumes on volume servers, which handle file data and metadata, enabling very fast file access with minimal disk reads. It supports features like replication, erasure coding, cloud integration for elastic storage, and compatibility with many metadata stores and APIs including Amazon S3. This means you get efficient, cost-effective storage with fast access, easy scaling, and flexible deployment options for large-scale file storage needs.

https://github.com/seaweedfs/seaweedfs

#java #awesome #backend #computer_science #distributed_systems #high_level_design #hld #interview #interview_questions #scalability #system_design

You can learn important system design concepts for free, covering topics like scalability, availability, CAP theorem, caching, databases, APIs, microservices, and distributed systems. This resource offers clear explanations, interview preparation guides, and practical design problems from easy to hard, helping you understand how to build reliable, scalable software systems. It also provides links to courses, books, newsletters, and videos to deepen your knowledge. Using these materials can improve your skills for system design interviews and real-world software architecture, making you more confident and effective in designing complex systems.

https://github.com/ashishps1/awesome-system-design-resources