325
by Martin Pool
- more revfile design notes |
1 |
.. -*- mode: indented-text; compile-command: "make -C doc" -*-
|
321
by Martin Pool
doc: revfile storage and related things |
2 |
|
3 |
||
4 |
*******************
|
|
5 |
Things to do in bzr
|
|
6 |
*******************
|
|
7 |
||
287
by Martin Pool
- todo: plugins |
8 |
|
293
by Martin Pool
- todos |
9 |
See also various low-level TODOs in the source code. Try looking in |
284
by Martin Pool
- more TODO items |
10 |
the list archive or on gmane.org for previous discussion of these |
293
by Martin Pool
- todos |
11 |
issues. |
12 |
||
13 |
These are classified by approximate size: an hour or less, a day or |
|
14 |
less, and several days or more. |
|
15 |
||
282
by Martin Pool
- move all TODO items into ./TODO |
16 |
|
17 |
Small things
|
|
18 |
------------
|
|
19 |
||
20 |
* Add of a file that was present in the base revision should put back
|
|
21 |
the previous file-id. |
|
22 |
||
23 |
* Handle diff of files which do not have a trailing newline; probably
|
|
24 |
requires patching difflib to get it exactly right, or otherwise |
|
25 |
calling out to GNU diff. |
|
26 |
||
27 |
* Import ElementTree update patch.
|
|
28 |
||
287
by Martin Pool
- todo: plugins |
29 |
* Plugins that provide commands. By just installing a file into some
|
322
by Martin Pool
- update todo list |
30 |
directory (e.g. ``/usr/share/bzr/plugins``) it should be possible to
|
31 |
create new top-level commands (``bzr frob``). Extensions can be
|
|
287
by Martin Pool
- todo: plugins |
32 |
written in either Python (in which case they use the bzrlib API) or |
33 |
in a separate process (in sh, C, whatever). It should be possible |
|
34 |
to get help for plugin commands. |
|
35 |
||
288
by Martin Pool
TODO |
36 |
* Smart rewrap text in help messages to fit in $COLUMNS (or equivalent
|
37 |
on Windows) |
|
38 |
||
289
by Martin Pool
todo |
39 |
* -r option should take a revision-id as well as a revno.
|
40 |
||
322
by Martin Pool
- update todo list |
41 |
* ``bzr info`` could show space used by working tree, versioned files, |
290
by Martin Pool
todo |
42 |
unknown and ignored files. |
43 |
||
322
by Martin Pool
- update todo list |
44 |
* ``bzr info`` should count only people with distinct email addresses as |
290
by Martin Pool
todo |
45 |
different committers. (Or perhaps only distinct userids?) |
46 |
||
322
by Martin Pool
- update todo list |
47 |
* On Windows, command-line arguments should be `glob-expanded`__, |
293
by Martin Pool
- todos |
48 |
because the shell doesn't do this. However, there are probably some |
49 |
commands where this shouldn't be done, such as 'bzr ignore', because |
|
50 |
we want to accept globs. |
|
51 |
||
329
by Martin Pool
- refactor command functions into command classes |
52 |
* ``bzr ignore`` command that just adds a line to the ``.bzrignore`` file |
53 |
and makes it versioned. Fix this to break symlinks. |
|
295
by Martin Pool
todo |
54 |
|
312
by Martin Pool
todo |
55 |
* Any useful sanity checks in 'bzr ignore'? Perhaps give a warning if
|
56 |
they try to add a single file which is already versioned, or if they |
|
57 |
add a pattern which already exists, or if it looks like they gave an |
|
58 |
unquoted glob. |
|
310
by Martin Pool
- new 'bzr ignored' command! |
59 |
|
325
by Martin Pool
- more revfile design notes |
60 |
__ http://mail.python.org/pipermail/python-list/2001-April/037847.html |
61 |
||
327
by Martin Pool
todo |
62 |
* Separate read and write version checks?
|
325
by Martin Pool
- more revfile design notes |
63 |
|
405
by Martin Pool
todo |
64 |
* ``bzr status DIR`` should give status on all files under that |
65 |
directory. |
|
66 |
||
484
by Martin Pool
todo |
67 |
* ``bzr log DIR`` should give changes to any files within DIR. |
68 |
||
329
by Martin Pool
- refactor command functions into command classes |
69 |
* Check all commands have decent help.
|
70 |
||
71 |
* ``bzr inventory -r REV`` and perhaps unify this with ``bzr ls``, |
|
72 |
giving options to display ids, types, etc. |
|
73 |
||
341
by Martin Pool
todo |
74 |
* Split BzrError into various more specific subclasses for different
|
75 |
errors people might want to catch. |
|
326
by Martin Pool
todo |
76 |
|
393
by Martin Pool
todo: export to tarball |
77 |
* If the export destination ends in '.tar', '.tar.gz', etc then create
|
78 |
a tarball instead of a directory. (Need to actually make a |
|
79 |
temporary directory and then tar that up.) |
|
80 |
||
81 |
http://www.gelato.unsw.edu.au/archives/git/0504/2194.html |
|
395
by Martin Pool
- fix error raised from invalid InventoryEntry name |
82 |
|
414
by Martin Pool
todo |
83 |
* RemoteBranch could maintain a cache either in memory or on disk. We
|
84 |
know more than an external cache might about which files are |
|
85 |
immutable and which can vary. On the other hand, it's much simpler |
|
86 |
to just use an external proxy cache. |
|
87 |
||
487
by Martin Pool
todo |
88 |
* Maybe also store directories in the statcache so that we can quickly
|
89 |
identify that they still exist. |
|
90 |
||
414
by Martin Pool
todo |
91 |
|
282
by Martin Pool
- move all TODO items into ./TODO |
92 |
Medium things
|
93 |
-------------
|
|
94 |
||
95 |
* Merge revert patch.
|
|
96 |
||
329
by Martin Pool
- refactor command functions into command classes |
97 |
* ``bzr mv`` that does either rename or move as in Unix. |
282
by Martin Pool
- move all TODO items into ./TODO |
98 |
|
478
by Martin Pool
- put back support for running diff or status on |
99 |
* More efficient diff of only selected files. We should be able to
|
100 |
just get the id for the selected files, look up their location and |
|
101 |
diff just those files. No need to traverse the entire inventories. |
|
282
by Martin Pool
- move all TODO items into ./TODO |
102 |
|
479
by Martin Pool
todo |
103 |
* ``bzr status DIR`` or ``bzr diff DIR`` should report on all changes |
104 |
under that directory. |
|
105 |
||
282
by Martin Pool
- move all TODO items into ./TODO |
106 |
* Fix up Inventory objects to represent root object as an entry.
|
107 |
||
552
by Martin Pool
- update todo list |
108 |
* Don't convert entire entry from ElementTree to an object when it is
|
109 |
read in, but rather wait until the program actually wants to know |
|
110 |
about that node. |
|
282
by Martin Pool
- move all TODO items into ./TODO |
111 |
|
112 |
* Extract changes from one revision to the next to a text form
|
|
113 |
suitable for transmission over email. |
|
114 |
||
115 |
* More test cases.
|
|
116 |
||
491
by Martin Pool
- Selective commit! |
117 |
- Selected-file commit
|
118 |
||
119 |
- Impossible selected-file commit: adding things in non-versioned
|
|
120 |
directories, crossing renames, etc. |
|
121 |
||
282
by Martin Pool
- move all TODO items into ./TODO |
122 |
* Write a reproducible benchmark, perhaps importing various kernel versions.
|
123 |
||
124 |
* Directly import diffs! It seems a bit redundant to need to rescan
|
|
125 |
the directory to work out what files diff added/deleted/changed when |
|
126 |
all the information is there in the diff in the first place. |
|
127 |
Getting the exact behaviour for added/deleted subdirectories etc |
|
128 |
might be hard. |
|
129 |
||
130 |
At the very least we could run diffstat over the diff, or perhaps |
|
131 |
read the status output from patch. Just knowing which files might |
|
132 |
be modified would be enough to guide the add and commit. |
|
133 |
||
134 |
Given this we might be able to import patches at 1/second or better. |
|
135 |
||
136 |
* Get branch over http.
|
|
137 |
||
138 |
* Pull pure updates over http.
|
|
139 |
||
140 |
* revfile compression.
|
|
141 |
||
142 |
* Split inventory into per-directory files.
|
|
143 |
||
284
by Martin Pool
- more TODO items |
144 |
* Fix ignore file parsing:
|
145 |
||
146 |
- fnmatch is not the same as unix patterns
|
|
147 |
||
148 |
- perhaps add extended globs from rsh/rsync
|
|
149 |
||
150 |
- perhaps a pattern that matches only directories or non-directories
|
|
151 |
||
312
by Martin Pool
todo |
152 |
* Consider using Python logging library as well as/instead of
|
153 |
bzrlib.trace. |
|
154 |
||
334
by Martin Pool
doc |
155 |
* Commands should give some progress indication by default.
|
156 |
||
157 |
- But quieten this with ``--silent``. |
|
158 |
||
312
by Martin Pool
todo |
159 |
* Change to using gettext message localization.
|
282
by Martin Pool
- move all TODO items into ./TODO |
160 |
|
315
by Martin Pool
todo |
161 |
* Make a clearer separation between internal and external bzrlib
|
162 |
interfaces. Make internal interfaces use protected names. Write at |
|
163 |
least some documentation for those APIs, probably as docstrings. |
|
164 |
||
165 |
Consider using ZopeInterface definitions for the external interface; |
|
166 |
I think these are already used in PyBaz. They allow automatic |
|
167 |
checking of the interface but may be unfamiliar to general Python |
|
321
by Martin Pool
doc: revfile storage and related things |
168 |
developers, so I'm not really keen. |
315
by Martin Pool
todo |
169 |
|
170 |
* Commands to dump out all command help into a manpage or HTML file or
|
|
171 |
whatever. |
|
172 |
||
326
by Martin Pool
todo |
173 |
* Handle symlinks in the working directory; at the very least it
|
174 |
should be possible for them to be present and ignored/unknown |
|
175 |
without causing assertion failures. |
|
176 |
||
177 |
Eventually symlinks should be versioned. |
|
178 |
||
329
by Martin Pool
- refactor command functions into command classes |
179 |
* Allow init in a subdirectory to create a nested repository, but only
|
180 |
if the subdirectory is not already versioned. Perhaps also require |
|
181 |
a ``--nested`` to protect against confusion.
|
|
182 |
||
183 |
* Branch names?
|
|
184 |
||
339
by Martin Pool
many more diffs |
185 |
* More test framework:
|
186 |
||
187 |
- Class that describes the state of a working tree so we can just
|
|
188 |
assert it's equal. |
|
189 |
||
342
by Martin Pool
todo |
190 |
* There are too many methods on Branch() that really manipulate the
|
346
by Martin Pool
todo |
191 |
WorkingTree. They should be moved across. |
192 |
||
193 |
Also there are some methods which are duplicated on Tree and |
|
194 |
Inventory objects, and it should be made more clear which ones are |
|
195 |
proxies and which ones behave differently, and how. |
|
342
by Martin Pool
todo |
196 |
|
361
by Martin Pool
todo |
197 |
* Try using XSLT to add some formatting to REST-generated HTML. Or
|
198 |
maybe write a small Python program that specifies a header and foot |
|
199 |
for the pages and calls into the docutils libraries. |
|
200 |
||
366
by Martin Pool
todo |
201 |
* --format=xml for log, status and other commands.
|
329
by Martin Pool
- refactor command functions into command classes |
202 |
|
370
by Martin Pool
todo |
203 |
* Attempting to explicitly add a file that's already added should give
|
204 |
a warning; however there should be no warning for directories (since |
|
205 |
we scan for new children) or files encountered in a directory that's |
|
206 |
being scanned. |
|
329
by Martin Pool
- refactor command functions into command classes |
207 |
|
377
by Martin Pool
- todo notes on inventory |
208 |
* Better handling of possible collisions on case-losing filesystems;
|
209 |
make sure a single file does not get added twice under different |
|
210 |
names. |
|
211 |
||
212 |
* Clean up XML inventory:
|
|
213 |
||
214 |
- Use nesting rather than parent_id pointers.
|
|
215 |
||
216 |
- Hold the ElementTree in memory in the Inventory object and work
|
|
217 |
directly on that, rather than converting into Python objects every |
|
453
by Martin Pool
- Split WorkingTree into its own file |
218 |
time it is read in. Probably still exposoe it through some kind of |
377
by Martin Pool
- todo notes on inventory |
219 |
object interface though, but perhaps that should just be a proxy |
220 |
for the elements. |
|
221 |
||
222 |
- Less special cases for the root directory.
|
|
223 |
||
388
by Martin Pool
doc |
224 |
* Perhaps inventories should remember the revision in which each file
|
225 |
was last changed, as well as its current state? This is a bit |
|
226 |
redundant but might often be interested to know. |
|
227 |
||
442
by Martin Pool
todo |
228 |
* stat cache should perhaps only stat files as necessary, rather than
|
229 |
doing them all up-front. On the other hand, that disallows the |
|
230 |
opimization of stating them in inode order. |
|
231 |
||
451
by Martin Pool
todo |
232 |
* It'd be nice to pipeline multiple HTTP requests. Often we can
|
233 |
predict what will be wanted in future: all revisions, or all texts |
|
234 |
in a particular revision, etc. |
|
235 |
||
236 |
urlgrabber's docs say they are working on batched downloads; we |
|
237 |
could perhaps ride on that or just create a background thread (ew). |
|
238 |
||
459
by Martin Pool
- diff now uses stat-cache -- much faster |
239 |
* Paranoid mode where we never trust SHA-1 matches.
|
240 |
||
502
by Martin Pool
todo |
241 |
* Don't commit if there are no changes unless forced.
|
242 |
||
522
by Martin Pool
todo |
243 |
* --dry-run mode for commit? (Or maybe just run with
|
244 |
check-command=false?) |
|
502
by Martin Pool
todo |
245 |
|
246 |
* Generally, be a bit more verbose unless --silent is specified.
|
|
247 |
||
522
by Martin Pool
todo |
248 |
* Function that finds all changes to files under a given directory;
|
249 |
perhaps log should use this if a directory is given. |
|
250 |
||
548
by Martin Pool
- Write statcache using \u style encoding to avoid |
251 |
* XML attributes might have trouble with filenames containing \n and
|
252 |
\r. Do we really want to support this? I think perhaps not. |
|
253 |
||
315
by Martin Pool
todo |
254 |
|
282
by Martin Pool
- move all TODO items into ./TODO |
255 |
Large things
|
256 |
------------
|
|
257 |
||
321
by Martin Pool
doc: revfile storage and related things |
258 |
* Generate annotations from current file relative to previous
|
259 |
annotations. |
|
260 |
||
261 |
- Is it necessary to store any kind of annotation where data was
|
|
262 |
deleted? |
|
263 |
||
325
by Martin Pool
- more revfile design notes |
264 |
* Update revfile_ format and make it active:
|
321
by Martin Pool
doc: revfile storage and related things |
265 |
|
266 |
- Texts should be identified by something keyed on the revision, not
|
|
267 |
an individual text-id. This is much more useful for annotate I |
|
268 |
think; we want to map back to the revision that last changed it. |
|
269 |
||
270 |
- Access revfile revisions through the Tree/Store classes.
|
|
271 |
||
272 |
- Check them from check commands.
|
|
273 |
||
274 |
- Store annotations.
|
|
275 |
||
325
by Martin Pool
- more revfile design notes |
276 |
.. _revfile: revfile.html |
277 |
||
294
by Martin Pool
todo |
278 |
* Hooks for pre-commit, post-commit, etc.
|
279 |
||
280 |
Consider the security implications; probably should not enable hooks |
|
281 |
for remotely-fetched branches by default. |
|
282 |
||
283 |
* Pre-commit check. If this hook is defined, it needs to be handled
|
|
284 |
specially: create a temporary directory containing the tree as it |
|
285 |
will be after the commit. This means excluding any ignored/unknown |
|
286 |
files, and respecting selective commits. Run the pre-commit check |
|
287 |
(e.g. compile and run test suite) in there. |
|
288 |
||
519
by Martin Pool
- todo: discussion of pre-commit tests |
289 |
Possibly this should be done by splitting the commit function into |
290 |
several parts (under a single interface). It is already rather |
|
291 |
large. Decomposition: |
|
292 |
||
293 |
- find tree modifications and prepare in-memory inventory
|
|
294 |
||
295 |
- export that inventory to a temporary directory
|
|
296 |
||
297 |
- run the test in that temporary directory
|
|
298 |
||
299 |
- if that succeeded, continue to actually finish the commit
|
|
300 |
||
301 |
What should be done with the text of modified files while this is |
|
302 |
underway? I don't think we want to count on holding them in memory |
|
303 |
and we can't trust the working files to stay in one place so I |
|
304 |
suppose we need to move them into the text store, or otherwise into |
|
305 |
a temporary directory. |
|
306 |
||
307 |
If the commit does not actually complete, we would rather the |
|
308 |
content was not left behind in the stores. |
|
309 |
||
282
by Martin Pool
- move all TODO items into ./TODO |
310 |
* Web interface
|
311 |
||
312 |
* GUI (maybe in Python GTK+?)
|
|
313 |
||
284
by Martin Pool
- more TODO items |
314 |
* C library interface
|
321
by Martin Pool
doc: revfile storage and related things |
315 |
|
316 |
* Expansion of $Id$ keywords within working files. Perhaps do this in
|
|
317 |
exports first as a simpler case because then we don't need to deal |
|
318 |
with removing the tags on the way back in. |
|
319 |
||
329
by Martin Pool
- refactor command functions into command classes |
320 |
* ``bzr find`` |