Generational Append-Only Storage Files

Version 5 by damien
on Feb 18, 2012 03:08.

compared with
Version 6 by damien
on May 11, 2012 19:29.

This line was removed.
This word was removed. This word was added.
This line was added.

Changes (1)

View Page History

If the oldest generation file shrinks down its live data size to where it can fit inside its next younger generation, it will be copied to that generation instead of compacted, and the oldest generation removed.

h3. Example Costs

TODO: Formulas to compute average and amortized IO costs of common operations. Explain how this works for large datasets where randomly distributed amount of the data is updated and update patterns when the update frequency takes a zipfian distribution (.