~bzr-pqm/bzr/bzr.dev

325 by Martin Pool
- more revfile design notes
1
.. -*- mode: indented-text; compile-command: "make -C doc" -*- 
321 by Martin Pool
doc: revfile storage and related things
2
3
4
*******************
5
Things to do in bzr
6
*******************
7
287 by Martin Pool
- todo: plugins
8
293 by Martin Pool
- todos
9
See also various low-level TODOs in the source code.  Try looking in
284 by Martin Pool
- more TODO items
10
the list archive or on gmane.org for previous discussion of these
293 by Martin Pool
- todos
11
issues.
12
13
These are classified by approximate size: an hour or less, a day or
14
less, and several days or more.
15
282 by Martin Pool
- move all TODO items into ./TODO
16
17
Small things
18
------------
19
20
* Add of a file that was present in the base revision should put back
21
  the previous file-id.
22
23
* Handle diff of files which do not have a trailing newline; probably
24
  requires patching difflib to get it exactly right, or otherwise
25
  calling out to GNU diff.
26
27
* Import ElementTree update patch.
28
287 by Martin Pool
- todo: plugins
29
* Plugins that provide commands.  By just installing a file into some
322 by Martin Pool
- update todo list
30
  directory (e.g. ``/usr/share/bzr/plugins``) it should be possible to
31
  create new top-level commands (``bzr frob``).  Extensions can be
287 by Martin Pool
- todo: plugins
32
  written in either Python (in which case they use the bzrlib API) or
33
  in a separate process (in sh, C, whatever).   It should be possible
34
  to get help for plugin commands.
35
288 by Martin Pool
TODO
36
* Smart rewrap text in help messages to fit in $COLUMNS (or equivalent
37
  on Windows)
38
289 by Martin Pool
todo
39
* -r option should take a revision-id as well as a revno.
40
322 by Martin Pool
- update todo list
41
* ``bzr info`` could show space used by working tree, versioned files,
290 by Martin Pool
todo
42
  unknown and ignored files. 
43
322 by Martin Pool
- update todo list
44
* ``bzr info`` should count only people with distinct email addresses as
290 by Martin Pool
todo
45
  different committers.  (Or perhaps only distinct userids?)
46
322 by Martin Pool
- update todo list
47
* On Windows, command-line arguments should be `glob-expanded`__,
293 by Martin Pool
- todos
48
  because the shell doesn't do this.  However, there are probably some
49
  commands where this shouldn't be done, such as 'bzr ignore', because
50
  we want to accept globs.
51
329 by Martin Pool
- refactor command functions into command classes
52
* ``bzr ignore`` command that just adds a line to the ``.bzrignore`` file
53
  and makes it versioned.  Fix this to break symlinks.
295 by Martin Pool
todo
54
312 by Martin Pool
todo
55
* Any useful sanity checks in 'bzr ignore'?  Perhaps give a warning if
56
  they try to add a single file which is already versioned, or if they
57
  add a pattern which already exists, or if it looks like they gave an
58
  unquoted glob.
310 by Martin Pool
- new 'bzr ignored' command!
59
325 by Martin Pool
- more revfile design notes
60
__ http://mail.python.org/pipermail/python-list/2001-April/037847.html
61
327 by Martin Pool
todo
62
* Separate read and write version checks?
325 by Martin Pool
- more revfile design notes
63
405 by Martin Pool
todo
64
* ``bzr status DIR`` should give status on all files under that
65
  directory.
66
484 by Martin Pool
todo
67
* ``bzr log DIR`` should give changes to any files within DIR.
68
329 by Martin Pool
- refactor command functions into command classes
69
* Check all commands have decent help.
70
71
* ``bzr inventory -r REV`` and perhaps unify this with ``bzr ls``,
72
  giving options to display ids, types, etc.
73
341 by Martin Pool
todo
74
* Split BzrError into various more specific subclasses for different
75
  errors people might want to catch.
326 by Martin Pool
todo
76
393 by Martin Pool
todo: export to tarball
77
* If the export destination ends in '.tar', '.tar.gz', etc then create
78
  a tarball instead of a directory.  (Need to actually make a
79
  temporary directory and then tar that up.)
80
81
  http://www.gelato.unsw.edu.au/archives/git/0504/2194.html
395 by Martin Pool
- fix error raised from invalid InventoryEntry name
82
  
414 by Martin Pool
todo
83
* RemoteBranch could maintain a cache either in memory or on disk.  We
84
  know more than an external cache might about which files are
85
  immutable and which can vary.  On the other hand, it's much simpler
86
  to just use an external proxy cache.
87
487 by Martin Pool
todo
88
* Maybe also store directories in the statcache so that we can quickly
89
  identify that they still exist.
90
414 by Martin Pool
todo
91
282 by Martin Pool
- move all TODO items into ./TODO
92
Medium things
93
-------------
94
95
* Merge revert patch.
96
329 by Martin Pool
- refactor command functions into command classes
97
* ``bzr mv`` that does either rename or move as in Unix.
282 by Martin Pool
- move all TODO items into ./TODO
98
478 by Martin Pool
- put back support for running diff or status on
99
* More efficient diff of only selected files.  We should be able to
100
  just get the id for the selected files, look up their location and
101
  diff just those files.  No need to traverse the entire inventories.
282 by Martin Pool
- move all TODO items into ./TODO
102
479 by Martin Pool
todo
103
* ``bzr status DIR`` or ``bzr diff DIR`` should report on all changes
104
  under that directory.
105
282 by Martin Pool
- move all TODO items into ./TODO
106
* Fix up Inventory objects to represent root object as an entry.
107
552 by Martin Pool
- update todo list
108
* Don't convert entire entry from ElementTree to an object when it is
109
  read in, but rather wait until the program actually wants to know
110
  about that node.
282 by Martin Pool
- move all TODO items into ./TODO
111
112
* Extract changes from one revision to the next to a text form
113
  suitable for transmission over email.
114
115
* More test cases.
116
491 by Martin Pool
- Selective commit!
117
  - Selected-file commit
118
119
  - Impossible selected-file commit: adding things in non-versioned
120
    directories, crossing renames, etc.
121
282 by Martin Pool
- move all TODO items into ./TODO
122
* Write a reproducible benchmark, perhaps importing various kernel versions.
123
124
* Directly import diffs!  It seems a bit redundant to need to rescan
125
  the directory to work out what files diff added/deleted/changed when
126
  all the information is there in the diff in the first place.
127
  Getting the exact behaviour for added/deleted subdirectories etc
128
  might be hard.
129
130
  At the very least we could run diffstat over the diff, or perhaps
131
  read the status output from patch.  Just knowing which files might
132
  be modified would be enough to guide the add and commit.
133
  
134
  Given this we might be able to import patches at 1/second or better.
135
136
* Get branch over http.
137
138
* Pull pure updates over http.
139
140
* revfile compression.
141
142
* Split inventory into per-directory files.
143
284 by Martin Pool
- more TODO items
144
* Fix ignore file parsing:
145
146
  - fnmatch is not the same as unix patterns
147
148
  - perhaps add extended globs from rsh/rsync
149
150
  - perhaps a pattern that matches only directories or non-directories
151
312 by Martin Pool
todo
152
* Consider using Python logging library as well as/instead of
153
  bzrlib.trace.
154
334 by Martin Pool
doc
155
* Commands should give some progress indication by default.
156
157
  - But quieten this with ``--silent``.
158
312 by Martin Pool
todo
159
* Change to using gettext message localization.
282 by Martin Pool
- move all TODO items into ./TODO
160
315 by Martin Pool
todo
161
* Make a clearer separation between internal and external bzrlib
162
  interfaces.  Make internal interfaces use protected names.  Write at
163
  least some documentation for those APIs, probably as docstrings.
164
165
  Consider using ZopeInterface definitions for the external interface;
166
  I think these are already used in PyBaz.  They allow automatic
167
  checking of the interface but may be unfamiliar to general Python
321 by Martin Pool
doc: revfile storage and related things
168
  developers, so I'm not really keen.
315 by Martin Pool
todo
169
170
* Commands to dump out all command help into a manpage or HTML file or
171
  whatever.
172
326 by Martin Pool
todo
173
* Handle symlinks in the working directory; at the very least it
174
  should be possible for them to be present and ignored/unknown
175
  without causing assertion failures. 
176
177
  Eventually symlinks should be versioned.
178
329 by Martin Pool
- refactor command functions into command classes
179
* Allow init in a subdirectory to create a nested repository, but only
180
  if the subdirectory is not already versioned.   Perhaps also require
181
  a ``--nested`` to protect against confusion.
182
183
* Branch names? 
184
339 by Martin Pool
many more diffs
185
* More test framework:
186
187
  - Class that describes the state of a working tree so we can just
188
    assert it's equal.
189
342 by Martin Pool
todo
190
* There are too many methods on Branch() that really manipulate the
346 by Martin Pool
todo
191
  WorkingTree.  They should be moved across.  
192
193
  Also there are some methods which are duplicated on Tree and
194
  Inventory objects, and it should be made more clear which ones are
195
  proxies and which ones behave differently, and how.
342 by Martin Pool
todo
196
361 by Martin Pool
todo
197
* Try using XSLT to add some formatting to REST-generated HTML.  Or
198
  maybe write a small Python program that specifies a header and foot
199
  for the pages and calls into the docutils libraries.
200
366 by Martin Pool
todo
201
* --format=xml for log, status and other commands.
329 by Martin Pool
- refactor command functions into command classes
202
370 by Martin Pool
todo
203
* Attempting to explicitly add a file that's already added should give
204
  a warning; however there should be no warning for directories (since
205
  we scan for new children) or files encountered in a directory that's
206
  being scanned.
329 by Martin Pool
- refactor command functions into command classes
207
377 by Martin Pool
- todo notes on inventory
208
* Better handling of possible collisions on case-losing filesystems;
209
  make sure a single file does not get added twice under different
210
  names.
211
212
* Clean up XML inventory:
213
214
  - Use nesting rather than parent_id pointers.
215
216
  - Hold the ElementTree in memory in the Inventory object and work
217
    directly on that, rather than converting into Python objects every
453 by Martin Pool
- Split WorkingTree into its own file
218
    time it is read in.  Probably still exposoe it through some kind of
377 by Martin Pool
- todo notes on inventory
219
    object interface though, but perhaps that should just be a proxy
220
    for the elements.
221
222
  - Less special cases for the root directory. 
223
388 by Martin Pool
doc
224
* Perhaps inventories should remember the revision in which each file
225
  was last changed, as well as its current state?  This is a bit
226
  redundant but might often be interested to know.
227
442 by Martin Pool
todo
228
* stat cache should perhaps only stat files as necessary, rather than
229
  doing them all up-front.  On the other hand, that disallows the
230
  opimization of stating them in inode order.
231
451 by Martin Pool
todo
232
* It'd be nice to pipeline multiple HTTP requests.  Often we can
233
  predict what will be wanted in future: all revisions, or all texts
234
  in a particular revision, etc.  
235
236
  urlgrabber's docs say they are working on batched downloads; we
237
  could perhaps ride on that or just create a background thread (ew).
238
459 by Martin Pool
- diff now uses stat-cache -- much faster
239
* Paranoid mode where we never trust SHA-1 matches.
240
502 by Martin Pool
todo
241
* Don't commit if there are no changes unless forced.
242
522 by Martin Pool
todo
243
* --dry-run mode for commit?  (Or maybe just run with
244
  check-command=false?)
502 by Martin Pool
todo
245
246
* Generally, be a bit more verbose unless --silent is specified.
247
522 by Martin Pool
todo
248
* Function that finds all changes to files under a given directory;
249
  perhaps log should use this if a directory is given.
250
548 by Martin Pool
- Write statcache using \u style encoding to avoid
251
* XML attributes might have trouble with filenames containing \n and
252
  \r.  Do we really want to support this?  I think perhaps not.
253
315 by Martin Pool
todo
254
282 by Martin Pool
- move all TODO items into ./TODO
255
Large things
256
------------
257
321 by Martin Pool
doc: revfile storage and related things
258
* Generate annotations from current file relative to previous
259
  annotations.
260
261
  - Is it necessary to store any kind of annotation where data was
262
    deleted?
263
325 by Martin Pool
- more revfile design notes
264
* Update revfile_ format and make it active:
321 by Martin Pool
doc: revfile storage and related things
265
266
  - Texts should be identified by something keyed on the revision, not
267
    an individual text-id.  This is much more useful for annotate I
268
    think; we want to map back to the revision that last changed it.
269
270
  - Access revfile revisions through the Tree/Store classes.
271
272
  - Check them from check commands.
273
274
  - Store annotations.
275
325 by Martin Pool
- more revfile design notes
276
.. _revfile: revfile.html
277
294 by Martin Pool
todo
278
* Hooks for pre-commit, post-commit, etc.
279
280
  Consider the security implications; probably should not enable hooks
281
  for remotely-fetched branches by default.
282
283
* Pre-commit check.  If this hook is defined, it needs to be handled
284
  specially: create a temporary directory containing the tree as it
285
  will be after the commit.  This means excluding any ignored/unknown
286
  files, and respecting selective commits.  Run the pre-commit check
287
  (e.g. compile and run test suite) in there.
288
519 by Martin Pool
- todo: discussion of pre-commit tests
289
  Possibly this should be done by splitting the commit function into
290
  several parts (under a single interface).  It is already rather
291
  large.  Decomposition:
292
293
   - find tree modifications and prepare in-memory inventory
294
295
   - export that inventory to a temporary directory
296
297
   - run the test in that temporary directory
298
299
   - if that succeeded, continue to actually finish the commit
300
301
  What should be done with the text of modified files while this is
302
  underway?  I don't think we want to count on holding them in memory
303
  and we can't trust the working files to stay in one place so I
304
  suppose we need to move them into the text store, or otherwise into
305
  a temporary directory.
306
307
  If the commit does not actually complete, we would rather the
308
  content was not left behind in the stores.  
309
282 by Martin Pool
- move all TODO items into ./TODO
310
* Web interface
311
312
* GUI (maybe in Python GTK+?)
313
284 by Martin Pool
- more TODO items
314
* C library interface
321 by Martin Pool
doc: revfile storage and related things
315
316
* Expansion of $Id$ keywords within working files.  Perhaps do this in
317
  exports first as a simpler case because then we don't need to deal
318
  with removing the tags on the way back in.
319
329 by Martin Pool
- refactor command functions into command classes
320
* ``bzr find``