#jupyter_notebook #big_data #bigdata #cortx_community #distributed_storage #distributed_systems #hackathons #hacktoberfest #hacktoberfest2020 #inclusivity #object_storage #object_storage_service #objectstorage #objectstore #open_source #opensource #s3 #s3_storage #software_defined_storage #storage #storage_api

https://github.com/Seagate/cortx

#go #distributed #distributed_storage #distributed_systems #golang #object_storage #storage

https://github.com/storj/storj

#go #cloud_native #distributed_systems #filesystem #golang #hdfs #object_storage #posix #redis #s3 #storage

https://github.com/juicedata/juicefs

#go #bigdata #cloud_native #distributed_systems #filesystem #go #golang #hdfs #object_storage #posix #redis #s3 #storage

JuiceFS is a powerful file system designed for cloud environments. It allows you to use massive cloud storage as if it were local storage, without changing your code. Here are the key benefits JuiceFS offers low latency and high throughput, making it suitable for big data, machine learning, and AI applications.
- **POSIX Compatibility** Supports Kubernetes and various object storage services like Amazon S3, Google Cloud Storage, and more.
- **Strong Consistency** Ensures data security and efficiency.
- **Shared Access**: Multiple clients can read and write files simultaneously.

Using JuiceFS, you can efficiently manage large amounts of data in the cloud, making it easier to integrate with various platforms and applications.

https://github.com/juicedata/juicefs

#rust #bigdata #cloud_native #distributed_systems #filesystem #minio #object_storage #oss #rust #s3

RustFS is a fast and safe distributed object storage system built with Rust, offering high performance and scalability for large data needs like AI and big data. It is compatible with S3, easy to use, and open source under the business-friendly Apache 2.0 license. Compared to others like MinIO, RustFS provides better memory safety, no risky data logging, and supports local cloud providers. You can quickly install it via a script or Docker, manage storage through a simple web console, and benefit from a strong community and detailed documentation. This makes RustFS a reliable, cost-effective choice for secure, scalable storage.

https://github.com/rustfs/rustfs

#go #blob_storage #cloud_drive #distributed_file_system #distributed_storage #distributed_systems #erasure_coding #fuse #hadoop_hdfs #hdfs #kubernetes #object_storage #posix #replication #s3 #s3_storage #seaweedfs #tiered_file_system

SeaweedFS is a fast, simple, and highly scalable distributed file system designed to store billions of files and serve them quickly, especially small files. It uses a master server to manage volumes on volume servers, which handle file data and metadata, enabling very fast file access with minimal disk reads. It supports features like replication, erasure coding, cloud integration for elastic storage, and compatibility with many metadata stores and APIs including Amazon S3. This means you get efficient, cost-effective storage with fast access, easy scaling, and flexible deployment options for large-scale file storage needs.

https://github.com/seaweedfs/seaweedfs