#go #replication #s3 #sqlite

https://github.com/benbjohnson/litestream

#cplusplus #cloud_native #cncf #container #data_lake_store #distributed_storage #filesystem #hybrid_cloud_acceleration #kubernetes #object_store #online_erasure_coding_subsystem #posix #s3 #storage

https://github.com/cubefs/cubefs

#javascript #ftp #ftps #git #ldap #nfs #s3 #sftp #smb #webdav

Filestash is a powerful file manager that lets you access and manage your files from anywhere, using various protocols like FTP, SFTP, WebDAV, and more. It supports multiple cloud services such as Dropbox, Google Drive, and Amazon S3. You can use it in your browser, and it's also mobile-friendly. Key features include video and image viewers, audio players, office document support, and customizable plugins. This tool is super fast, user-friendly, and allows you to upload and download files easily. It's beneficial because it centralizes your file management, making it easy to access and share files across different platforms.

https://github.com/mickael-kerjean/filestash

#go #azure_blob #azure_blob_storage #azure_files #backblaze_b2 #cloud_storage #dropbox #encryption #ftp #fuse_filesystem #go #golang #google_cloud_storage #google_drive #onedrive #openstack_swift #rclone #s3 #sftp #sync #webdav

Rclone is a tool that helps you sync files and directories between your computer and various cloud storage services. It supports many cloud providers like Google Drive, Amazon S3, Dropbox, and more. Rclone ensures file integrity by checking hashes, preserves timestamps, and offers different sync modes such as copy, sync, and bisync. You can also use it to compress, encrypt, or chunk large files. It's free software under the MIT license and has detailed documentation and a community forum for support. This makes managing your cloud storage easier and more efficient.

https://github.com/rclone/rclone

#go #bigdata #cloud_native #distributed_systems #filesystem #go #golang #hdfs #object_storage #posix #redis #s3 #storage

JuiceFS is a powerful file system designed for cloud environments. It allows you to use massive cloud storage as if it were local storage, without changing your code. Here are the key benefits JuiceFS offers low latency and high throughput, making it suitable for big data, machine learning, and AI applications.
- **POSIX Compatibility** Supports Kubernetes and various object storage services like Amazon S3, Google Cloud Storage, and more.
- **Strong Consistency** Ensures data security and efficiency.
- **Shared Access**: Multiple clients can read and write files simultaneously.

Using JuiceFS, you can efficiently manage large amounts of data in the cloud, making it easier to integrate with various platforms and applications.

https://github.com/juicedata/juicefs

#java #azure #backblaze_b2 #cloudfront #cryptomator #cyberduck #dracoon #dropbox #ftp #google_drive #google_storage #hubic #irods #onedrive #onedrive_for_business #onedrive_storage #openstack_swift #s3 #sftp #sharepoint #webdav

Cyberduck is a free file transfer client that works on macOS, Windows, and Linux. It helps you move files between your computer and servers easily. You can use it to connect to various types of servers like FTP, SFTP, and more. The software is open-source, meaning its code is available for anyone to see and contribute to. This makes it reliable and secure. You can also translate it into many languages, making it accessible to users worldwide. For help, there are detailed documentation and mailing lists where you can ask questions or get updates about new features. Overall, Cyberduck simplifies file transfers and is highly customizable.

https://github.com/iterate-ch/cyberduck

#go #amazon_s3 #cloud #cloudnative #cloudstorage #go #k8s #kubernetes #multi_cloud #multi_cloud_kubernetes #objectstorage #s3 #storage

MinIO is a fast and scalable object storage system that works like Amazon S3. It's great for storing large amounts of data, especially for machine learning and analytics projects. MinIO is easy to use, runs on many platforms, and supports Kubernetes for easy management. It also provides strong data protection with features like erasure coding and encryption. This makes MinIO a good choice for businesses that need reliable and efficient data storage solutions.

https://github.com/minio/minio

#java #ai #apache_kafka #aws #azure #cloud #cloud_first #cloud_native #ebs #gcp #kafka #llm #messaging #minio #s3 #serverless #spot #streaming

AutoMQ provides a cloud-native alternative to Apache Kafka that runs on S3 storage, cutting costs by up to 90% while enabling instant scaling and eliminating cross-zone traffic fees. It offers high reliability, serverless operation, and full Kafka compatibility, making it easier and cheaper to manage large-scale data streaming without sacrificing performance or features.

https://github.com/AutoMQ/automq

#typescript #anki #chatgpt #deepseek #electron #evernote #knowledge_base #local_first #markdown #note_taking #notes_app #notion #obsidian #ocr #ollama #openai #pdf #s3 #self_hosted #webdav

SiYuan is a privacy-first personal knowledge management tool. It allows you to organize your thoughts and notes in a secure way, even offline. You can use features like block-level references, Markdown editing, and mathematical formulas. It also supports AI tools and has apps for Android, iOS, and HarmonyOS. SiYuan is open source and free for most features, making it a great choice for managing your personal knowledge securely.

https://github.com/siyuan-note/siyuan

#python #aws #aws_cli #aws_sdk #cloud #cloud_management #cloudformation #cloudwatch #dynamodb #ec2 #ecs #elasticsearch #iam #kinesis #lambda #machine_learning #rds #redshift #route53 #s3 #serverless

AWS Lambda lets you run code without managing servers, automatically scaling to handle any number of requests and charging you only for the compute time you use. It supports many programming languages and integrates well with other AWS services, making it ideal for tasks like real-time data processing, image handling, chatbots, and automating backups. This serverless approach saves you time and money by removing infrastructure management and adapting instantly to demand spikes, so your applications stay responsive and cost-efficient even as usage changes. Lambda is great for building scalable, event-driven applications quickly and easily.

https://github.com/donnemartin/awesome-aws

#rust #bigdata #cloud_native #distributed_systems #filesystem #minio #object_storage #oss #rust #s3

RustFS is a fast and safe distributed object storage system built with Rust, offering high performance and scalability for large data needs like AI and big data. It is compatible with S3, easy to use, and open source under the business-friendly Apache 2.0 license. Compared to others like MinIO, RustFS provides better memory safety, no risky data logging, and supports local cloud providers. You can quickly install it via a script or Docker, manage storage through a simple web console, and benefit from a strong community and detailed documentation. This makes RustFS a reliable, cost-effective choice for secure, scalable storage.

https://github.com/rustfs/rustfs

#go #blob_storage #cloud_drive #distributed_file_system #distributed_storage #distributed_systems #erasure_coding #fuse #hadoop_hdfs #hdfs #kubernetes #object_storage #posix #replication #s3 #s3_storage #seaweedfs #tiered_file_system

SeaweedFS is a fast, simple, and highly scalable distributed file system designed to store billions of files and serve them quickly, especially small files. It uses a master server to manage volumes on volume servers, which handle file data and metadata, enabling very fast file access with minimal disk reads. It supports features like replication, erasure coding, cloud integration for elastic storage, and compatibility with many metadata stores and APIs including Amazon S3. This means you get efficient, cost-effective storage with fast access, easy scaling, and flexible deployment options for large-scale file storage needs.

https://github.com/seaweedfs/seaweedfs