1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
1 |
# Copyright (C) 2005, 2006 by Canonical Ltd
|
2 |
#
|
|
3 |
# This program is free software; you can redistribute it and/or modify
|
|
4 |
# it under the terms of the GNU General Public License as published by
|
|
5 |
# the Free Software Foundation; either version 2 of the License, or
|
|
6 |
# (at your option) any later version.
|
|
7 |
#
|
|
8 |
# This program is distributed in the hope that it will be useful,
|
|
9 |
# but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
10 |
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
11 |
# GNU General Public License for more details.
|
|
12 |
#
|
|
13 |
# You should have received a copy of the GNU General Public License
|
|
14 |
# along with this program; if not, write to the Free Software
|
|
15 |
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA
|
|
1
by mbp at sourcefrog
import from baz patch-364 |
16 |
|
1185.33.6
by Martin Pool
Code and tests for shorter formatting of error messages |
17 |
"""Messages and logging for bazaar-ng.
|
18 |
||
19 |
Messages are supplied by callers as a string-formatting template, plus values
|
|
20 |
to be inserted into it. The actual %-formatting is deferred to the log
|
|
21 |
library so that it doesn't need to be done for messages that won't be emitted.
|
|
22 |
||
23 |
Messages are classified by severity levels: critical, error, warning, info,
|
|
24 |
and debug.
|
|
25 |
||
26 |
They can be sent to two places: to stderr, and to ~/.bzr.log. For purposes
|
|
27 |
such as running the test suite, they can also be redirected away from both of
|
|
28 |
those two places to another location.
|
|
29 |
||
30 |
~/.bzr.log gets all messages, and full tracebacks for uncaught exceptions.
|
|
1185.33.51
by Martin Pool
Fix trace of non-ascii messages, and add test. |
31 |
This trace file is always in UTF-8, regardless of the user's default encoding,
|
32 |
so that we can always rely on writing any message.
|
|
1185.33.6
by Martin Pool
Code and tests for shorter formatting of error messages |
33 |
|
34 |
Output to stderr depends on the mode chosen by the user. By default, messages
|
|
35 |
of info and above are sent out, which results in progress messages such as the
|
|
36 |
list of files processed by add and commit. In quiet mode, only warnings and
|
|
37 |
above are shown. In debug mode, stderr gets debug messages too.
|
|
38 |
||
39 |
Errors that terminate an operation are generally passed back as exceptions;
|
|
40 |
others may be just emitted as messages.
|
|
41 |
||
42 |
Exceptions are reported in a brief form to stderr so as not to look scary.
|
|
43 |
BzrErrors are required to be able to format themselves into a properly
|
|
1759.2.1
by Jelmer Vernooij
Fix some types (found using aspell). |
44 |
explanatory message. This is not true for builtin exceptions such as
|
1185.33.6
by Martin Pool
Code and tests for shorter formatting of error messages |
45 |
KeyError, which typically just str to "0". They're printed in a different
|
46 |
form.
|
|
344
by Martin Pool
- It's not an error to use the library without |
47 |
"""
|
48 |
||
1185.16.74
by Martin Pool
doc |
49 |
# FIXME: Unfortunately it turns out that python's logging module
|
50 |
# is quite expensive, even when the message is not printed by any handlers.
|
|
51 |
# We should perhaps change back to just simply doing it here.
|
|
52 |
||
1097
by Martin Pool
- send trace messages out through python logging module |
53 |
|
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
54 |
import errno |
55 |
import os |
|
1097
by Martin Pool
- send trace messages out through python logging module |
56 |
import sys |
57 |
import logging |
|
58 |
||
1185.33.8
by Martin Pool
Cleanup exception formatting stuff |
59 |
import bzrlib |
1185.33.63
by Martin Pool
Better display of BzrError classes that are not BzrNewErrors. |
60 |
from bzrlib.errors import BzrError, BzrNewError |
1740.5.8
by Martin Pool
Review cleanups: better error reporting, put back report_exception. |
61 |
from bzrlib.symbol_versioning import (deprecated_function, |
62 |
zero_nine, |
|
63 |
)
|
|
1097
by Martin Pool
- send trace messages out through python logging module |
64 |
|
1101
by Martin Pool
- add global definition to quieten pychecker |
65 |
_file_handler = None |
1111
by Martin Pool
- add functions to enable and disable default logging, so that we can |
66 |
_stderr_handler = None |
1185.33.42
by Martin Pool
[patch] make --quiet a global option (robey) |
67 |
_stderr_quiet = False |
1185.43.7
by Martin Pool
Do debug messages not through python logging |
68 |
_trace_file = None |
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
69 |
_trace_depth = 0 |
1185.43.7
by Martin Pool
Do debug messages not through python logging |
70 |
_bzr_log_file = None |
71 |
||
1185.49.17
by John Arbash Meinel
[merge] Robey Pointer - some sftp fixes, and an http patch |
72 |
|
1097
by Martin Pool
- send trace messages out through python logging module |
73 |
# configure convenient aliases for output routines
|
74 |
||
75 |
_bzr_logger = logging.getLogger('bzr') |
|
76 |
||
1558.8.1
by Aaron Bentley
Fix overall progress bar's interaction with 'note' and 'warning' |
77 |
def note(*args, **kwargs): |
1793.2.16
by Aaron Bentley
More notes on 'note' |
78 |
# FIXME note always emits utf-8, regardless of the terminal encoding
|
1558.8.1
by Aaron Bentley
Fix overall progress bar's interaction with 'note' and 'warning' |
79 |
import bzrlib.ui |
80 |
bzrlib.ui.ui_factory.clear_term() |
|
81 |
_bzr_logger.info(*args, **kwargs) |
|
82 |
||
83 |
def warning(*args, **kwargs): |
|
84 |
import bzrlib.ui |
|
85 |
bzrlib.ui.ui_factory.clear_term() |
|
86 |
_bzr_logger.warning(*args, **kwargs) |
|
87 |
||
88 |
info = note |
|
1097
by Martin Pool
- send trace messages out through python logging module |
89 |
log_error = _bzr_logger.error |
90 |
error = _bzr_logger.error |
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
91 |
|
92 |
||
93 |
def mutter(fmt, *args): |
|
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
94 |
if _trace_file is None: |
95 |
return
|
|
1963.2.6
by Robey Pointer
pychecker is on crack; go back to using 'is None'. |
96 |
if (getattr(_trace_file, 'closed', None) is not None) and _trace_file.closed: |
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
97 |
return
|
1948.1.9
by John Arbash Meinel
Change mutter() so that it doesn't try so hard to write out perfect utf8, instead, rather than using a utf8 file, it changes unicode to utf8 manually |
98 |
|
99 |
if isinstance(fmt, unicode): |
|
100 |
fmt = fmt.encode('utf8') |
|
101 |
||
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
102 |
if len(args) > 0: |
1685.1.2
by John Arbash Meinel
Re-enabling the non_ascii tests after fixing trace.py, bzr ignore also does the right thing now |
103 |
# It seems that if we do ascii % (unicode, ascii) we can
|
104 |
# get a unicode cannot encode ascii error, so make sure that "fmt"
|
|
105 |
# is a unicode string
|
|
1948.1.9
by John Arbash Meinel
Change mutter() so that it doesn't try so hard to write out perfect utf8, instead, rather than using a utf8 file, it changes unicode to utf8 manually |
106 |
real_args = [] |
107 |
for arg in args: |
|
108 |
if isinstance(arg, unicode): |
|
109 |
arg = arg.encode('utf8') |
|
110 |
real_args.append(arg) |
|
111 |
out = fmt % tuple(real_args) |
|
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
112 |
else: |
1185.33.51
by Martin Pool
Fix trace of non-ascii messages, and add test. |
113 |
out = fmt |
114 |
out += '\n' |
|
1948.1.9
by John Arbash Meinel
Change mutter() so that it doesn't try so hard to write out perfect utf8, instead, rather than using a utf8 file, it changes unicode to utf8 manually |
115 |
_trace_file.write(out) |
1185.85.5
by John Arbash Meinel
mutter() should not fail because of unicode errors |
116 |
# TODO: jam 20051227 Consider flushing the trace file to help debugging
|
117 |
#_trace_file.flush()
|
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
118 |
debug = mutter |
1097
by Martin Pool
- send trace messages out through python logging module |
119 |
|
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
120 |
|
261
by Martin Pool
- auto-rollover of .bzr.log |
121 |
def _rollover_trace_maybe(trace_fname): |
359
by Martin Pool
- pychecker fixups |
122 |
import stat |
261
by Martin Pool
- auto-rollover of .bzr.log |
123 |
try: |
124 |
size = os.stat(trace_fname)[stat.ST_SIZE] |
|
333
by Martin Pool
- allow trace file to grow up to 4MB |
125 |
if size <= 4 << 20: |
261
by Martin Pool
- auto-rollover of .bzr.log |
126 |
return
|
127 |
old_fname = trace_fname + '.old' |
|
1185.1.40
by Robert Collins
Merge what applied of Alexander Belchenko's win32 patch. |
128 |
from osutils import rename |
129 |
rename(trace_fname, old_fname) |
|
261
by Martin Pool
- auto-rollover of .bzr.log |
130 |
except OSError: |
131 |
return
|
|
132 |
||
133 |
||
1111
by Martin Pool
- add functions to enable and disable default logging, so that we can |
134 |
def open_tracefile(tracefilename='~/.bzr.log'): |
59
by mbp at sourcefrog
lift out tracefile creation code |
135 |
# Messages are always written to here, so that we have some
|
136 |
# information if something goes wrong. In a future version this
|
|
137 |
# file will be removed on successful completion.
|
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
138 |
global _file_handler, _bzr_log_file |
1773.4.1
by Martin Pool
Add pyflakes makefile target; fix many warnings |
139 |
import codecs |
59
by mbp at sourcefrog
lift out tracefile creation code |
140 |
|
1185.31.35
by John Arbash Meinel
Couple small fixes, all tests pass on cygwin. |
141 |
trace_fname = os.path.join(os.path.expanduser(tracefilename)) |
261
by Martin Pool
- auto-rollover of .bzr.log |
142 |
_rollover_trace_maybe(trace_fname) |
403
by Martin Pool
- Don't give an error if the trace file can't be opened |
143 |
try: |
1185.33.11
by Martin Pool
Code format cleanups |
144 |
LINE_BUFFERED = 1 |
1948.1.9
by John Arbash Meinel
Change mutter() so that it doesn't try so hard to write out perfect utf8, instead, rather than using a utf8 file, it changes unicode to utf8 manually |
145 |
#tf = codecs.open(trace_fname, 'at', 'utf8', buffering=LINE_BUFFERED)
|
146 |
tf = open(trace_fname, 'at', LINE_BUFFERED) |
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
147 |
_bzr_log_file = tf |
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
148 |
if tf.tell() == 0: |
1100
by Martin Pool
- fix name error reported by Andrew Bennetts |
149 |
tf.write("\nthis is a debug log for diagnosing/reporting problems in bzr\n") |
150 |
tf.write("you can delete or truncate this file, or include sections in\n") |
|
151 |
tf.write("bug reports to bazaar-ng@lists.canonical.com\n\n") |
|
1097
by Martin Pool
- send trace messages out through python logging module |
152 |
_file_handler = logging.StreamHandler(tf) |
153 |
fmt = r'[%(process)5d] %(asctime)s.%(msecs)03d %(levelname)s: %(message)s' |
|
154 |
datefmt = r'%a %H:%M:%S' |
|
155 |
_file_handler.setFormatter(logging.Formatter(fmt, datefmt)) |
|
156 |
_file_handler.setLevel(logging.DEBUG) |
|
157 |
logging.getLogger('').addHandler(_file_handler) |
|
403
by Martin Pool
- Don't give an error if the trace file can't be opened |
158 |
except IOError, e: |
159 |
warning("failed to open trace file: %s" % (e)) |
|
260
by Martin Pool
- remove atexit() dependency for writing out execution times |
160 |
|
1097
by Martin Pool
- send trace messages out through python logging module |
161 |
|
1740.5.8
by Martin Pool
Review cleanups: better error reporting, put back report_exception. |
162 |
@deprecated_function(zero_nine) |
163 |
def log_exception(msg=None): |
|
164 |
"""Log the last exception to stderr and the trace file.
|
|
165 |
||
166 |
The exception string representation is used as the error
|
|
167 |
summary, unless msg is given.
|
|
168 |
"""
|
|
169 |
if msg: |
|
170 |
error(msg) |
|
171 |
else: |
|
172 |
exc_str = format_exception_short(sys.exc_info()) |
|
173 |
error(exc_str) |
|
174 |
log_exception_quietly() |
|
175 |
||
176 |
||
1185.16.82
by mbp at sourcefrog
- give a quieter warning if a plugin can't be loaded |
177 |
def log_exception_quietly(): |
178 |
"""Log the last exception to the trace file only.
|
|
179 |
||
180 |
Used for exceptions that occur internally and that may be
|
|
181 |
interesting to developers but not to users. For example,
|
|
182 |
errors loading plugins.
|
|
183 |
"""
|
|
1185.33.11
by Martin Pool
Code format cleanups |
184 |
import traceback |
1185.16.82
by mbp at sourcefrog
- give a quieter warning if a plugin can't be loaded |
185 |
debug(traceback.format_exc()) |
186 |
||
187 |
||
1111
by Martin Pool
- add functions to enable and disable default logging, so that we can |
188 |
def enable_default_logging(): |
189 |
"""Configure default logging to stderr and .bzr.log"""
|
|
1185.43.9
by Martin Pool
Make logging of errors go through our trace functions |
190 |
# FIXME: if this is run twice, things get confused
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
191 |
global _stderr_handler, _file_handler, _trace_file, _bzr_log_file |
1111
by Martin Pool
- add functions to enable and disable default logging, so that we can |
192 |
_stderr_handler = logging.StreamHandler() |
1185.34.2
by Jelmer Vernooij
Don't quite when tracefile can't be opened. Display warning |
193 |
logging.getLogger('').addHandler(_stderr_handler) |
1359
by Martin Pool
- merge in new BZR_NOISY vs BZR_DEBUG stuff from main |
194 |
_stderr_handler.setLevel(logging.INFO) |
1185.34.2
by Jelmer Vernooij
Don't quite when tracefile can't be opened. Display warning |
195 |
if not _file_handler: |
196 |
open_tracefile() |
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
197 |
_trace_file = _bzr_log_file |
1185.34.2
by Jelmer Vernooij
Don't quite when tracefile can't be opened. Display warning |
198 |
if _file_handler: |
1185.43.10
by Martin Pool
Remove need for BZR_DEBUG to get debug info in trace file. |
199 |
_file_handler.setLevel(logging.DEBUG) |
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
200 |
_bzr_logger.setLevel(logging.DEBUG) |
1359
by Martin Pool
- merge in new BZR_NOISY vs BZR_DEBUG stuff from main |
201 |
|
1185.33.42
by Martin Pool
[patch] make --quiet a global option (robey) |
202 |
|
203 |
def be_quiet(quiet=True): |
|
204 |
global _stderr_handler, _stderr_quiet |
|
205 |
||
206 |
_stderr_quiet = quiet |
|
207 |
if quiet: |
|
208 |
_stderr_handler.setLevel(logging.WARNING) |
|
209 |
else: |
|
210 |
_stderr_handler.setLevel(logging.INFO) |
|
211 |
||
212 |
||
213 |
def is_quiet(): |
|
214 |
global _stderr_quiet |
|
215 |
return _stderr_quiet |
|
216 |
||
217 |
||
1111
by Martin Pool
- add functions to enable and disable default logging, so that we can |
218 |
def disable_default_logging(): |
219 |
"""Turn off default log handlers.
|
|
220 |
||
221 |
This is intended to be used by the test framework, which doesn't
|
|
222 |
want leakage from the code-under-test into the main logs.
|
|
223 |
"""
|
|
1112
by Martin Pool
- disable standard logging to .bzr.log and stderr while running |
224 |
|
225 |
l = logging.getLogger('') |
|
226 |
l.removeHandler(_stderr_handler) |
|
227 |
if _file_handler: |
|
228 |
l.removeHandler(_file_handler) |
|
1185.43.7
by Martin Pool
Do debug messages not through python logging |
229 |
_trace_file = None |
1185.33.6
by Martin Pool
Code and tests for shorter formatting of error messages |
230 |
|
231 |
||
1185.33.13
by Martin Pool
Hide more stuff in bzrlib.trace |
232 |
def enable_test_log(to_file): |
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
233 |
"""Redirect logging to a temporary file for a test
|
234 |
|
|
235 |
returns an opaque reference that should be passed to disable_test_log
|
|
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
236 |
after the test completes.
|
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
237 |
"""
|
1185.33.13
by Martin Pool
Hide more stuff in bzrlib.trace |
238 |
disable_default_logging() |
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
239 |
global _trace_file |
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
240 |
global _trace_depth |
1185.33.13
by Martin Pool
Hide more stuff in bzrlib.trace |
241 |
hdlr = logging.StreamHandler(to_file) |
242 |
hdlr.setLevel(logging.DEBUG) |
|
243 |
hdlr.setFormatter(logging.Formatter('%(levelname)8s %(message)s')) |
|
1185.43.1
by Martin Pool
Remove direct logging calls from selftest |
244 |
_bzr_logger.addHandler(hdlr) |
245 |
_bzr_logger.setLevel(logging.DEBUG) |
|
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
246 |
result = hdlr, _trace_file, _trace_depth |
1185.43.7
by Martin Pool
Do debug messages not through python logging |
247 |
_trace_file = to_file |
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
248 |
_trace_depth += 1 |
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
249 |
return result |
250 |
||
251 |
||
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
252 |
def disable_test_log((test_log_hdlr, old_trace_file, old_trace_depth)): |
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
253 |
_bzr_logger.removeHandler(test_log_hdlr) |
1641.2.1
by Olaf Conradi
Close logging handler on disabling the test log. This will remove the |
254 |
test_log_hdlr.close() |
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
255 |
global _trace_file |
256 |
global _trace_depth |
|
1534.4.25
by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite. |
257 |
_trace_file = old_trace_file |
1534.11.7
by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs. |
258 |
_trace_depth = old_trace_depth |
259 |
if not _trace_depth: |
|
260 |
enable_default_logging() |
|
1185.33.13
by Martin Pool
Hide more stuff in bzrlib.trace |
261 |
|
262 |
||
1740.5.2
by Martin Pool
Improved tests for display of exceptions. |
263 |
def report_exception(exc_info, err_file): |
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
264 |
exc_type, exc_object, exc_tb = exc_info |
1711.2.86
by John Arbash Meinel
Restore logging of full traceback. Helps with debugging tests. |
265 |
# Log the full traceback to ~/.bzr.log
|
266 |
log_exception_quietly() |
|
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
267 |
if (isinstance(exc_object, IOError) |
268 |
and getattr(exc_object, 'errno', None) == errno.EPIPE): |
|
269 |
print >>err_file, "bzr: broken pipe" |
|
270 |
elif isinstance(exc_object, KeyboardInterrupt): |
|
271 |
print >>err_file, "bzr: interrupted" |
|
1740.5.6
by Martin Pool
Clean up many exception classes. |
272 |
elif getattr(exc_object, 'is_user_error', False): |
273 |
report_user_error(exc_info, err_file) |
|
274 |
elif isinstance(exc_object, (OSError, IOError)): |
|
275 |
# Might be nice to catch all of these and show them as something more
|
|
276 |
# specific, but there are too many cases at the moment.
|
|
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
277 |
report_user_error(exc_info, err_file) |
278 |
else: |
|
279 |
report_bug(exc_info, err_file) |
|
280 |
||
281 |
||
282 |
# TODO: Should these be specially encoding the output?
|
|
283 |
def report_user_error(exc_info, err_file): |
|
1740.5.5
by Martin Pool
Show short form for OSError and IOError too |
284 |
print >>err_file, "bzr: ERROR:", str(exc_info[1]) |
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
285 |
|
286 |
||
287 |
def report_bug(exc_info, err_file): |
|
1740.5.2
by Martin Pool
Improved tests for display of exceptions. |
288 |
"""Report an exception that probably indicates a bug in bzr"""
|
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
289 |
import traceback |
290 |
exc_type, exc_object, exc_tb = exc_info |
|
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
291 |
print >>err_file, "bzr: ERROR: %s: %s" % (exc_type, exc_object) |
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
292 |
print >>err_file |
1740.5.2
by Martin Pool
Improved tests for display of exceptions. |
293 |
traceback.print_exception(exc_type, exc_object, exc_tb, file=err_file) |
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
294 |
print >>err_file |
1740.5.6
by Martin Pool
Clean up many exception classes. |
295 |
print >>err_file, 'bzr %s on python %s (%s)' % \ |
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
296 |
(bzrlib.__version__, |
297 |
'.'.join(map(str, sys.version_info)), |
|
298 |
sys.platform) |
|
1740.5.6
by Martin Pool
Clean up many exception classes. |
299 |
print >>err_file, 'arguments: %r' % sys.argv |
1740.5.3
by Martin Pool
Cleanup more exception-formatting code |
300 |
print >>err_file |
1740.5.1
by Martin Pool
When an unhandled exception occurs, write the traceback to stderr. |
301 |
print >>err_file, "** please send this report to bazaar-ng@lists.ubuntu.com" |