~bzr-pqm/bzr/bzr.dev

2052.3.2 by John Arbash Meinel
Change Copyright .. by Canonical to Copyright ... Canonical
1
# Copyright (C) 2005 Canonical Ltd
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
2
#   Authors: Robert Collins <robert.collins@canonical.com>
3
#
4
# This program is free software; you can redistribute it and/or modify
5
# it under the terms of the GNU General Public License as published by
6
# the Free Software Foundation; either version 2 of the License, or
7
# (at your option) any later version.
8
#
9
# This program is distributed in the hope that it will be useful,
10
# but WITHOUT ANY WARRANTY; without even the implied warranty of
11
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
12
# GNU General Public License for more details.
13
#
14
# You should have received a copy of the GNU General Public License
15
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
16
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
17
18
"""This module provides a transactional facility.
19
20
Transactions provide hooks to allow data objects (i.e. inventory weaves or
21
the revision-history file) to be placed in a registry and retrieved later
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
22
during the same transaction. Transactions in bzr are not atomic - they
23
depend on data ordering of writes, so we do not have commit or rollback
24
facilities at the transaction level.
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
25
26
Read only transactions raise an assert when objects are listed as dirty
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
27
against them - preventing unintended writes.
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
28
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
29
Write transactions preserve dirty objects in the cache, though due to the
30
write ordering approach we use for consistency 'dirty' is a misleading term.
31
A dirty object is one we have modified.
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
32
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
33
Both read and write transactions *may* flush unchanged objects out of
34
memory, unless they are marked as 'precious' which indicates that
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
35
repeated reads cannot be obtained if the object is ejected, or that
36
the object is an expensive one for obtaining.
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
37
"""
38
6379.6.7 by Jelmer Vernooij
Move importing from future until after doc string, otherwise the doc string will disappear.
39
from __future__ import absolute_import
40
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
41
import sys
42
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
43
import bzrlib.errors as errors
44
from bzrlib.identitymap import IdentityMap, NullIdentityMap
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
45
from bzrlib.trace import mutter
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
46
47
48
class ReadOnlyTransaction(object):
49
    """A read only unit of work for data objects."""
50
51
    def finish(self):
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
52
        """Clean up this transaction."""
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
53
54
    def __init__(self):
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
55
        super(ReadOnlyTransaction, self).__init__()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
56
        self.map = IdentityMap()
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
57
        self._clean_objects = set()
58
        self._clean_queue = []
59
        self._limit = -1
60
        self._precious_objects = set()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
61
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
62
    def is_clean(self, an_object):
63
        """Return True if an_object is clean."""
1711.9.11 by John Arbash Meinel
change return foo in bar to return (foo in bar)
64
        return (an_object in self._clean_objects)
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
65
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
66
    def register_clean(self, an_object, precious=False):
67
        """Register an_object as being clean.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
68
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
69
        If the precious hint is True, the object will not
70
        be ejected from the object identity map ever.
71
        """
72
        self._clean_objects.add(an_object)
73
        self._clean_queue.append(an_object)
74
        if precious:
75
            self._precious_objects.add(an_object)
76
        self._trim()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
77
1417.1.8 by Robert Collins
use transactions in the weave store interface, which enables caching for log
78
    def register_dirty(self, an_object):
79
        """Register an_object as being dirty."""
1553.5.33 by Martin Pool
LockDir review comment fixes
80
        raise errors.ReadOnlyObjectDirtiedError(an_object)
1417.1.8 by Robert Collins
use transactions in the weave store interface, which enables caching for log
81
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
82
    def set_cache_size(self, size):
83
        """Set a new cache size."""
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
84
        if size < -1:
85
            raise ValueError(size)
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
86
        self._limit = size
87
        self._trim()
88
89
    def _trim(self):
90
        """Trim the cache back if needed."""
91
        if self._limit < 0 or self._limit - len(self._clean_objects) > 0:
92
            return
93
        needed = len(self._clean_objects) - self._limit
94
        offset = 0
95
        while needed and offset < len(self._clean_objects):
96
            # references we know of:
97
            # temp passed to getrefcount in our frame
98
            # temp in getrefcount's frame
99
            # the map forward
100
            # the map backwards
101
            # _clean_objects
102
            # _clean_queue
103
            # 1 missing ?
104
            if (sys.getrefcount(self._clean_queue[offset]) <= 7 and
105
                not self._clean_queue[offset] in self._precious_objects):
106
                removed = self._clean_queue[offset]
107
                self._clean_objects.remove(removed)
108
                del self._clean_queue[offset]
109
                self.map.remove_object(removed)
110
                mutter('removed object %r', removed)
111
                needed -= 1
112
            else:
113
                offset += 1
114
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
115
    def writeable(self):
116
        """Read only transactions do not allow writes."""
117
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
118
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
119
class WriteTransaction(ReadOnlyTransaction):
120
    """A write transaction
121
122
    - caches domain objects
123
    - clean objects can be removed from the cache
124
    - dirty objects are retained.
125
    """
126
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
127
    def finish(self):
128
        """Clean up this transaction."""
129
        for thing in self._dirty_objects:
130
            callback = getattr(thing, 'transaction_finished', None)
131
            if callback is not None:
132
                callback()
133
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
134
    def __init__(self):
135
        super(WriteTransaction, self).__init__()
136
        self._dirty_objects = set()
137
138
    def is_dirty(self, an_object):
139
        """Return True if an_object is dirty."""
1711.9.11 by John Arbash Meinel
change return foo in bar to return (foo in bar)
140
        return (an_object in self._dirty_objects)
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
141
142
    def register_dirty(self, an_object):
143
        """Register an_object as being dirty.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
144
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
145
        Dirty objects are not ejected from the identity map
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
146
        until the transaction finishes and get informed
147
        when the transaction finishes.
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
148
        """
149
        self._dirty_objects.add(an_object)
150
        if self.is_clean(an_object):
151
            self._clean_objects.remove(an_object)
152
            del self._clean_queue[self._clean_queue.index(an_object)]
153
        self._trim()
154
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
155
    def writeable(self):
156
        """Write transactions allow writes."""
157
        return True
158
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
159
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
160
class PassThroughTransaction(object):
161
    """A pass through transaction
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
162
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
163
    - nothing is cached.
164
    - nothing ever gets into the identity map.
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
165
    """
166
167
    def finish(self):
1563.2.34 by Robert Collins
Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction
168
        """Clean up this transaction."""
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
169
        for thing in self._dirty_objects:
170
            callback = getattr(thing, 'transaction_finished', None)
171
            if callback is not None:
172
                callback()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
173
174
    def __init__(self):
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
175
        super(PassThroughTransaction, self).__init__()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
176
        self.map = NullIdentityMap()
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
177
        self._dirty_objects = set()
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
178
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
179
    def register_clean(self, an_object, precious=False):
180
        """Register an_object as being clean.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
181
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
182
        Note that precious is only a hint, and PassThroughTransaction
183
        ignores it.
184
        """
1417.1.6 by Robert Collins
introduce transactions for grouping actions done to and with branches
185
1417.1.8 by Robert Collins
use transactions in the weave store interface, which enables caching for log
186
    def register_dirty(self, an_object):
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
187
        """Register an_object as being dirty.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
188
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
189
        Dirty objects get informed
190
        when the transaction finishes.
191
        """
192
        self._dirty_objects.add(an_object)
1417.1.8 by Robert Collins
use transactions in the weave store interface, which enables caching for log
193
1417.1.10 by Robert Collins
add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.
194
    def set_cache_size(self, ignored):
195
        """Do nothing, we are passing through."""
1594.2.20 by Robert Collins
Add finished() notifications to transactions.
196
197
    def writeable(self):
198
        """Pass through transactions allow writes."""
199
        return True