~bzr-pqm/bzr/bzr.dev

  • Committer: John Arbash Meinel
  • Date: 2009-02-26 22:41:52 UTC
  • mto: (0.20.21 trunk)
  • Revision ID: john@arbash-meinel.com-20090226224152-z4jiazt0gp1vsylk
Try a different method of streaming the chk pages.
In this method, we work out what chk pages are referenced by what inventory
pages. And then fetch them based on breadth-first references.
This should mean that pages that will compress well together are
sent together, rather than in arbitrary ordering.
Note that we might want to do even a little better, and use
a list for the first time we encounter it, rather than sets everywhere.
(we still want a set to make sure we don't add it multiple times to the list)

Then again, 'unordered' may reorder it anyway, so it may not matter.
We should also consider using multiple chk streams, because it
will likely result in better compression, by forcing breaks in the
gc groups.
Filename Latest Rev Last Changed Committer Comment Size
..
tests 0.17.1 16 years ago Robert Collins Starting point. Interface tests hooked up and fail Diff
.bzrignore 0.18.13 16 years ago John Arbash Meinel Copy the EquivalenceTable code into pyrex and get 29 bytes Diff Download File
__init__.py 0.21.3 15 years ago John Arbash Meinel Start putting together a GroupCompress format that 5.9 KB Diff Download File
_groupcompress_c.pyx 0.17.20 16 years ago Robert Collins More C tweaks from John. 26.2 KB Diff Download File
COPYING 0.17.1 16 years ago Robert Collins Starting point. Interface tests hooked up and fail 17.5 KB Diff Download File
DESIGN 0.17.24 15 years ago Robert Collins Add a group cache to decompression, 5 times faster 5.4 KB Diff Download File
equivalence_table.py 0.18.12 16 years ago John Arbash Meinel Switch away from probing hidden member variables 2.8 KB Diff Download File
errors.py 0.17.1 16 years ago Robert Collins Starting point. Interface tests hooked up and fail 839 bytes Diff Download File
groupcompress.py 0.22.4 15 years ago John Arbash Meinel Bring in the missing update from 'trunk' 40.8 KB Diff Download File
NEWS 0.17.1 16 years ago Robert Collins Starting point. Interface tests hooked up and fail 265 bytes Diff Download File
README 0.17.1 16 years ago Robert Collins Starting point. Interface tests hooked up and fail 908 bytes Diff Download File
repofmt.py 0.22.5 15 years ago John Arbash Meinel Try a different method of streaming the chk pages. 33.1 KB Diff Download File
File setup.py 0.18.13 16 years ago John Arbash Meinel Copy the EquivalenceTable code into pyrex and get 2.9 KB Diff Download File
TODO 0.17.23 15 years ago Robert Collins Only decompress as much of the zlib data as is nee 168 bytes Diff Download File