OSDN -- Develop and Download Open Source Software

RSS
Download List

Project Description

S3QL is a file system that stores all its data online. It supports Amazon S3, Google Storage, and OpenStack and effectively provides you with a hard disk of dynamic, infinite capacity that can be accessed from any computer with Internet access. S3QL provides a standard, full featured Unix file system that is conceptually indistinguishable from any local file system. Additional features include compression, encryption, data de-duplication, immutable trees, and snapshotting, which make it especially suitable for online backup and archiving. The design favors simplicity and elegance over performance and feature-creep. Care has been taken to make the source code as readable and serviceable as possible. Solid error detection, error handling, and extensive automated test cases are provided.

System Requirements

System requirement is not defined
Information regarding Project Releases and Project Resources. Note that the information here is a quote from Freecode.com page, and the downloads themselves may not be hosted on OSDN.

2012-02-25 12:10
1.10

The s3s, s3cs, and gss backends have been removed. Use the new --ssl option together with the s3, s3c, and gs backends instead. S3QL no longer keeps track of consistency guarantees for the different backends. The increasing number of different storage providers offering different regions, redundancy, and availability levels makes this no longer feasible. The User's Guide contains a new section, "Important Rules to Avoid Losing Data". Reading it is strongly recommended.
Tags: Stable

2012-01-22 11:16
1.9

This release makes file times no longer change when changing the system time zone, fixes and improves contrib/benchmark.p, fixes the "Too many chained redirections" bug, retries on 5xx server errors, and adds experimental native support for OpenStack/SWIFT servers and experimental proxy support.
Tags: Stable

2011-12-06 12:29
1.8

A "ValueError: Can't dump NULL values" crash when file system metadata was uploaded during heavy file system activity was fixed. s3qlcp and directory listing performance for very large directories were improved. An rm performance regression was fixed. --blocksize was renamed to --max-obj-size. Some crashes that happened under heavily concurrent file system usage were fixed. python-llfuse 0.37 is now used.
Tags: Stable

2011-11-28 07:22
1.7

Metadata is now stored in a custom, delta-encoded binary format, and inodes are assigned sequentially and not reused. This makes S3QL fully NFS-compatible. s3qlcp now also copies extended attributes and no longer generates incorrect block reference counts when copying a file which has identical blocks. This release eliminates a race condition in s3qlcp. When copying a file with s3qlcp immediately after it was modified or created, it was possible that s3qlcp would copy the new file attributes but the old data blocks.
Tags: Stable

2011-11-21 12:41
1.6

fsck will gracefully recover if temporary indices already exist (e.g. if the previous fsck was interrupted). This release will not fail with a "BadDigest" error when objects are only partially retrieved from the backend.

Project Resources

Project Page Home Page