Data migration ############## Preparing for data migration ---------------------------- Before starting a migration, there are a few important things to do first: 1. Take a complete backup. 2. Take some time to purge obsolete branches. A complete backup gives you a safety net in case anything goes wrong. Purging obsolete branches reduces the amount of data that needs to be migrated. See `Finding obsolete branches`_ later for some tips on doing this. Introducing the upgrade-related commands ---------------------------------------- There are 3 important commands to be aware of when migrating data. * **check** - check a repository, branch or tree for data integrity errors * **reconcile** - fix data integrity errors * **upgrade** - migrate data to a different format. **reconcile** is rarely needed but it's good practice to run **check** before and after running **upgrade**. For detailed help on these commands, see the `Bazaar User Reference`_. .. _Bazaar User Reference: ../user-reference/index.html Communicating with your community --------------------------------- To enable a smooth transition to the new format, you should: 1. Make one person responsible for migrating the trunk. 2. Test the migration of trunk works successfully. 3. Schedule a time for the trunk migration and notify your community in advance. This advance warning should be long enough for users to have time to upgrade Bazaar and any required plugins before the migration date. For larger projects, allow some time for the migration itself. You should have a good idea of how long the migration will take after doing the test migration. It may make sense to do the migration on a weekend or a Friday, giving yourself some breathing space if things go wrong. After the trunk is migrated, you'll need to notify your community accordingly, giving them instructions as to how to migrate their local branches. Sample instructions are provided later in this document. Migrating a standalone branch ----------------------------- The steps are: 1. Run **bzr check**. 2. If there are errors, try using **bzr reconcile** to fix them. If that fails, file a bug so we can help you resolve the issue and get your trunk clean. If it works, take a backup copy of your now clean trunk. 2. Run **bzr upgrade --format** where *format* is 2a or later. 3. Run **bzr check** to confirm the final result is good. Migrating branches in a shared repository ----------------------------------------- Upgrade things in the following order: 1. Upgrade the shared repository. 2. Upgrade the branches. 3. Upgrade any lightweight checkouts. As in the standalone branch case, be sure to run **check** before and after the upgrade to check for any existing or introduced issues. Migrating branches on Launchpad ------------------------------- You have two options for upgrading your Launchpad branches. You can either upgrade them remotely or you can upgrade them locally and push the migrated branch to Launchpad. We recommend the latter. Upgrading remotely currently requires a fast, rock solid network connection to the Launchpad servers, and any interruption in that connection can leave you with a partially upgraded branch. The instructions below are the safest and often fastest way to upgrade your Launchpad branches. To allow isolation between public and private branches, Launchpad uses stacked branches rather than shared repositories as the core technology for efficient branch storage. The process for migrating to a new format for projects using Launchpad code hosting is therefore different to migrating a personal or in-house project. In Launchpad, a project can define a *development series* and associate a branch with that series. The branch then becomes the *focus of development* and gets special treatment and a shortcut URL. By default, if anybody branches your project's focus of development and pushes changes back to Launchpad, their branch will be stacked on your development focus branch. Also, branches can be associated with other Launchpad artifacts such as bugs and merge proposals. All of these things mean that upgrading your focus of development branch is trickier. Here are the steps to follow: 1. The nominated person grabs a copy of trunk and does the migration locally. 2. On Launchpad, unset the current trunk from being the development focus. (This *must* be done or the following step won't work as expected.) 1. Go to your project's home page on Launchpad 2. Look for "XXX is the current focus of development" 3. Click on the edit (pencil) icon 4. Click on "Change details" in the portlet on the right 5. Scroll down to where it says "Branch: (Optional)" 6. Blank out this input field and click "Change" 3. Push the migrated trunk to Launchpad. See below if you want your new migrated development focus branch to have the same name as your old pre-migration development focus branch. 4. Set it as the development focus. Follow the instructions above but at step 5, enter the name of the newly migrated branch you just pushed. 5. Ask users subscribed to the old trunk to subscribe to the new one. In summary, these steps mean that the old trunk is still available and existing branches stacked on it will continue to be so. However, the development focus has switched to the migrated trunk and any new branches pushed to Launchpad for your project will now stack on it. You are now ready to tell your community that the new trunk is available and to give them instructions on migrating any local branches they have. If you want your new migrated development focus branch to have the same name as your old pre-migration branch, you need to do a few extra things before you establish the new development focus. 1. Rename your old pre-migration branch; use something like **foo-obsolete-do-not-use**. You will really not want to delete this because there will be artifacts (bugs, merge proposals, etc.) associated with it. 2. Rename the new migrated branch to the pre-migration branch's old name. 3. Re-establish the development focus branch using the new migrated branch's new name (i.e. the old pre-migration branch's original name). Migrating local branches after a central trunk has migrated ----------------------------------------------------------- To migrate a standalone branch: 1. Grab the latest branch from the central location into a new directory. 2. Pull or merge any changes you've made in your existing branch into the new branch. To migrate branches in a shared repository: 1. Create a fresh shared repository in the new format (2a or later). 2. Grab the latest branch from the central location into a new directory inside the shared repository. 3. Decide which of your local branches you want to migrate. (If you haven't already, now's a good time for `Finding obsolete branches`_ and purging them, after backing up first of course.) 4. To migrate each local branch of interest, there are 2 options: * **init** an empty branch in the new repository and **pull** the revisions from the branch in the old repository across. * In the new repository, **branch** from trunk to the new branch name then **merge** your changes from the matching branch in the old repository. The first method will give you a branch which is identical (in terms of revision history) to the old branch, but it's parent branch will be set to the old branch, not your new trunk. If you use this method, you'll probably update the ``parent_location`` configuration variable in the ``branch.conf`` file with:: bzr config parent_location=XXX ``XXX`` being the URL to your new trunk. In contrast, the second approach sets up the parent branch correctly. However, it isn't ideal if you're not ready to include all the latest revisions from trunk into that branch yet.