xenial (7) dgit.7.gz

Provided by: dgit_1.4_all bug

NAME

       dgit - principles of operation

SUMMARY

       dgit  treats  the  Debian  archive  as a version control system, and bidirectionally gateways between the
       archive and git.  The git view of the package can contain the usual upstream git  history,  and  will  be
       augmented  by  commits representing uploads done by other developers not using dgit.  This git history is
       stored in a canonical location known as dgit-repos which lives on a dedicated git server.

MODEL

       You may use any suitable git workflow with dgit, provided you satisfy dgit's requirements:

       dgit maintains a pseudo-remote called dgit, with one branch per suite.  This remote cannot be  used  with
       plain git.

       The  dgit-repos  repository  for  each  package  contains one ref per suite named refs/dgit/suite.  These
       should be pushed to only by dgit.  They are fast forwarding.  Each push on this branch corresponds to  an
       upload (or attempted upload).

       However,  it is perfectly fine to have other branches in dgit-repos; normally the dgit-repos repo for the
       package will be accessible via the remote name `origin'.

       dgit push will also make signed tags called debian/version (a la DEP-14) and  push  them  to  dgit-repos.
       These are used at the server to authenticate pushes.

       dgit push can operate on any commit which is a descendant of the current dgit/suite tip in dgit-repos.

       Uploads made by dgit contain an additional field Dgit in the source package .dsc.  (This is added by dgit
       push.)  This specifies a commit (an ancestor of the dgit/suite branch) whose tree  is  identical  to  the
       unpacked source upload.

       Uploads  not  made  by dgit are represented in git by commits which are synthesised by dgit.  The tree of
       each such commit corresponds to the unpacked source; there is an origin commit with the contents,  and  a
       psuedo-merge from last known upload - that is, from the contents of the dgit/suite branch.

       dgit  expects  repos  that it works with to have a dgit remote.  This refers to the well-known dgit-repos
       location (on a dedicated Debian VM).  dgit fetch updates the remote tracking branch for dgit/suite.

       dgit does not (currently) represent the orig tarball(s) in git.  The orig  tarballs  are  downloaded  (by
       dgit clone) into the parent directory, as with a traditional (non-gitish) dpkg-source workflow.  You need
       to retain these tarballs in the parent directory for dgit build and dgit push.

       dgit repositories could be cloned with standard (git) methods. The only exception is that  for  sourceful
       builds / uploads the orig tarball(s) need to be present in the parent directory.

       To  a  user looking at the archive, changes pushed using dgit look like changes made in an NMU: in a `3.0
       (quilt)' package the delta from the previous upload is recorded in  a  new  patch  constructed  by  dpkg-
       source.

READ-ONLY DISTROS

       Distros  which  do  not  maintain a set of dgit history git repositories can still be used in a read-only
       mode with dgit.  Currently Ubuntu is configured this way.

PACKAGE SOURCE FORMATS

       If you are not the maintainer, you do not need to worry about the source format of the package.  You  can
       just  make  changes  as you like in git.  If the package is a `3.0 (quilt)' package, the patch stack will
       usually not be represented in the git history.

FORMAT 3.0 (QUILT)

       For a format `3.0 (quilt)' source package, dgit may have to make a  commit  on  your  current  branch  to
       contain metadata used by quilt and dpkg-source.

       This  is  because  `3.0  (quilt)'  source  format  represents the patch stack as files in debian/patches/
       actually inside the source tree.  This means that, taking the whole tree (as seen by git or ls) (i) dpkg-
       source  cannot represent certain trees, and (ii) packing up a tree in `3.0 (quilt)' and then unpacking it
       does not always yield the same tree.

       dgit will automatically work around this for you when building and pushing.  The only thing you  need  to
       know  is  that  dgit  build, sbuild, etc., may make new commits on your HEAD.  If you're not a quilt user
       this commit won't contain any changes to files you care about.

       You can explicitly request that dgit do just this fixup, by running dgit quilt-fixup.

       If you are a quilt user you need to know that dgit's git trees are `patches applied  packaging  branches'
       and  do  not  contain the .pc directory (which is used by quilt to record which patches are applied).  If
       you want to manipulate the patch stack you probably want to be looking at tools like git-dpm.

FILES IN THE SOURCE PACKAGE BUT NOT IN GIT - AUTOTOOLS ETC.

       This section is mainly of interest to maintainers who want to use dgit with their  existing  git  history
       for the Debian package.

       Some developers like to have an extra-clean git tree which lacks files which are normally found in source
       tarballs and therefore in Debian source packages.  For example, it is conventional to ship ./configure in
       the source tarball, but some people prefer not to have it present in the git view of their project.

       dgit requires that the source package unpacks to exactly the same files as are in the git commit on which
       dgit push operates.  So if you just try to dgit push directly from one of these extra-clean git branches,
       it will fail.

       As the maintainer you therefore have the following options:

       •      Persuade  upstream  that the source code in their git history and the source they ship as tarballs
              should be identical.  Of course simply removing the files from the tarball may  make  the  tarball
              hard for people to use.

              One  answer  is  to commit the (maybe autogenerated) files, perhaps with some simple automation to
              deal with conflicts and spurious changes.  This has the advantage that someone who clones the  git
              repository finds the program just as easy to build as someone who uses the tarball.

       •      Have  separate  git  branches  which  do contain the extra files, and after regenerating the extra
              files (whenever you would have to anyway), commit the result onto those branches.

       •      Provide source packages which lack the files you don't want in git, and arrange for  your  package
              build  to  create  them as needed.  This may mean not using upstream source tarballs and makes the
              Debian source package less useful for people without Debian build infrastructure.

       Of course it may also be that the differences are due to build system bugs, which cause unintended  files
       to  end  up  in  the source package.  dgit will notice this and complain.  You may have to fix these bugs
       before you can unify your existing git history with dgit's.

FILES IN THE SOURCE PACKAGE BUT NOT IN GIT - DOCS, BINARIES ETC.

       Some upstream tarballs contain build artifacts which upstream expects some users not to want  to  rebuild
       (or indeed to find hard to rebuild), but which in Debian we always rebuild.

       Examples  sometimes  include  crossbuild  firmware  binaries  and  documentation.  To avoid problems when
       building updated source packages (in particular, to avoid trying to represent as changes  in  the  source
       package  uninteresting or perhaps unrepresentable changes to such files) many maintainers arrange for the
       package clean target to delete these files.

       dpkg-source does not (with any of the commonly used source formats) represent deletion of files  (outside
       debian/)  present  in upstream.  Thus deleting such files in a dpkg-source working tree does not actually
       result in them being deleted from the source package.  Thus deleting the files in rules clean sweeps this
       problem under the rug.

       However, git does always properly record file deletion.  Since dgit's principle is that the dgit git tree
       is the same of dpkg-source -x, that means that a dgit-compatible git tree always contains these files.

       For the non-maintainer, this can be observed in the following suboptimal occurrences:

       •      The package clean target often deletes these files, making the git tree dirty trying to build  the
              source  package,  etc.   This  can be fixed by using dgit -wg aka --clean=git, so that the package
              clean target is never run.

       •      The package build modifies these files, so that builds make the  git  tree  dirty.   This  can  be
              worked  around  by  using  `git  reset --hard' after each build (or at least before each commit or
              push).

       From the maintainer's point of view, the main consequence is that to make a dgit-compatible git branch it
       is  necessary  to commit these files to git.  The maintainer has a few additional options for mitigation:
       for example, it may be possible for the rules file to arrange to do the build in a temporary area,  which
       avoids updating the troublesome files; they can then be left in the git tree without seeing trouble.

PROBLEMS WITH PACKAGE CLEAN TARGETS ETC.

       A related problem is other unexpected behaviour by a package's clean target.  If a package's rules modify
       files which are distributed in the package, or simply forget to remove certain files, dgit will  complain
       that the tree is dirty.

       Again,  the solution is to use dgit -wg aka --clean=git, which instructs dgit to use git clean instead of
       the package's build target, along with perhaps git reset --hard before each build.

       This is 100% reliable, but has the downside that if you forget to git add or to commit, and then use dgit
       -wg or git reset --hard, your changes may be lost.

SEE ALSO

       dgit(1).