15 KiB
Develop ParaView with Git
This page documents how to develop ParaView through Git. See the README for more information.
Git is an extremely powerful version control tool that supports many different "workflows" for individual development and collaboration. Here we document procedures used by the ParaView development community. In the interest of simplicity and brevity we do not provide an explanation of why we use this approach.
Setup
Before you begin, perform initial setup:
-
Register GitLab Access to create an account and select a user name.
-
Fork ParaView into your user's namespace on GitLab.
-
Follow the download instructions to create a local clone of the main ParaView repository. Optionally configure Git to use SSH instead of HTTPS. Then clone:
$ git clone --recursive https://gitlab.kitware.com/paraview/paraview.git ParaView $ cd ParaViewThe main repository will be configured as your
originremote. -
Run the developer setup script to prepare your ParaView work tree and create Git command aliases used below:
$ ./Utilities/SetupForDevelopment.shThis will prompt for your GitLab user name and configure a remote called
gitlabto refer to it. -
(Optional but highly recommended.) Register with the ParaView project on Kitware's CDash instance to better know how your code performs in regression tests. After registering and signing in, click on "All Dashboards" link in the upper left corner, scroll down and click "Subscribe to this project" on the right of ParaView.
Workflow
ParaView development uses a branchy workflow based on topic branches. Our collaboration workflow consists of three main steps:
-
Local Development:
-
Code Review (requires GitLab Access):
-
Integrate Changes:
- Merge a Topic (requires permission in GitLab)
- Delete a Topic
Update
-
Update your local
masterbranch:$ git checkout master $ git pullall -
Optionally push
masterto your fork in GitLab:$ git push gitlab masterto keep it in sync. The
git gitlab-pushscript used to Share a Topic below will also do this.
Create a Topic
All new work must be committed on topic branches. Name topics like you might name functions: concise but precise. A reader should have a general idea of the feature or fix to be developed given just the branch name.
-
To start a new topic branch:
$ git fetch origin -
For new development, start the topic from
origin/master:$ git checkout -b my-topic origin/masterFor release branch fixes, start the topic from
origin/release, and by convention use a topic name starting inrelease-:$ git checkout -b release-my-topic origin/releaseIf subdmodules may have changed, the run:
$ git submodule update -
Edit files and create commits (repeat as needed):
$ edit file1 file2 file3 $ git add file1 file2 file3 $ git commitCaveats:
- To add data follow these instructions, from VTK.
Commit messages must contain a brief description as the first line and a more detailed description of what the commit contains. If the commit contains a new feature, the detailed message must describe the new feature and why it is needed. If the commit contains a bug fix, the detailed message must describe the bug behavior, its underlying cause, and the approach to fix it. If the bug is described in the bug tracker, the commit message must contain a reference to the bug number.
Share a Topic
When a topic is ready for review and possible inclusion, share it by pushing to a fork of your repository in GitLab. Be sure you have registered and signed in for GitLab Access and created your fork by visiting the main ParaView GitLab repository page and using the "Fork" button in the upper right.
-
Checkout the topic if it is not your current branch:
$ git checkout my-topic -
Check what commits will be pushed to your fork in GitLab:
$ git prepush -
Push commits in your topic branch to your fork in GitLab:
$ git gitlab-pushNotes:
- If you are revising a previously pushed topic and have rewritten the
topic history, add
-for--forceto overwrite the destination. - If the topic adds data see this note.
- The
gitlab-pushscript also pushes themasterbranch to your fork in GitLab to keep it in sync with the upstreammaster.
The output will include a link to the topic branch in your fork in GitLab and a link to a page for creating a Merge Request.
- If you are revising a previously pushed topic and have rewritten the
topic history, add
Create a Merge Request
(If you already created a merge request for a given topic and have reached this step after revising it, skip to the next step.)
Visit your fork in GitLab, browse to the "Merge Requests" link on the left, and use the "New Merge Request" button in the upper right to reach the URL printed at the end of the previous step. It should be of the form:
https://gitlab.kitware.com/<username>/paraview/merge_requests/new
Follow these steps:
-
In the "Source branch" box select the
<username>/paraviewrepository and themy-topicbranch. -
In the "Target branch" box select the
paraview/paraviewrepository and themasterbranch. It should be the default.If your change is a fix for the
releasebranch, you should still select themasterbranch as the target because the change needs to end up there too. -
Use the "Compare branches" button to proceed to the next page and fill out the merge request creation form.
-
In the "Title" field provide a one-line summary of the entire topic. This will become the title of the Merge Request.
Example Merge Request Title:
Wrapping: Add Java 1.x support -
In the "Description" field provide a high-level description of the change the topic makes and any relevant information about how to try it.
- Use
@usernamesyntax to draw attention of specific developers. This syntax may be used anywhere outside literal text and code blocks. Or, wait until the next step and add comments to draw attention of developers. - If your change is a fix for the
releasebranch, indicate this so that a maintainer knows it should be merged torelease. - Optionally use a fenced code block with type
messageto specify text to be included in the generated merge commit message when the topic is merged.
Example Merge Request Description:
This branch requires Java 1.x which is not generally available yet. Get Java 1.x from ... in order to try these changes. ```message Add support for Java 1.x to the wrapping infrastructure. ``` Cc: @user1 @user2 - Use
-
The "Assign to", "Milestone", and "Labels" fields may be left blank.
-
Use the "Submit merge request" button to create the merge request and visit its page.
Review a Merge Request
Add comments mentioning specific developers using @username syntax to
draw their attention and have the topic reviewed. After typing @ and
some text, GitLab will offer completions for developers whose real names
or user names match.
Comments use GitLab Flavored Markdown for formatting. See GitLab documentation on Special GitLab References to add links to things like merge requests and commits in other repositories.
Human Reviews
Reviewers may add comments providing feedback or to acknowledge their approval. Lines of specific forms will be extracted during merging and included as trailing lines of the generated merge commit message:
The leading line of a comment may optionally be exactly one of the following votes followed by nothing but whitespace before the end of the line:
-1or 👎 (:-1:) means "The change is not ready for integration."+1or 👍 (:+1:) means "I like the change but defer to others."+2means "The change is ready for integration."+3means "I have tested the change and verified it works."
The middle lines of a comment may be free-form GitLab Flavored Markdown.
Zero or more trailing lines of a comment may each contain exactly one of the following votes followed by nothing but whitespace before the end of the line:
Rejected-by: memeans "The change is not ready for integration."Acked-by: memeans "I like the change but defer to others."Reviewed-by: memeans "The change is ready for integration."Tested-by: memeans "I have tested the change and verified it works."
Each me reference may instead be an @username reference or a full
Real Name <user@domain> reference to credit someone else for performing
the review. References to me and @username will automatically be
transformed into a real name and email address according to the user's
GitLab account profile.
Fetching Changes
One may fetch the changes associated with a merge request by using
the git fetch command line shown at the top of the Merge Request
page. It is of the form:
$ git fetch https://gitlab.kitware.com/$username/paraview.git $branch
This updates the local FETCH_HEAD to refer to the branch.
There are a few options for checking out the changes in a work tree:
-
One may checkout the branch:
$ git checkout FETCH_HEAD -b $branchor checkout the commit without creating a local branch:
$ git checkout FETCH_HEAD -
Or, one may cherry-pick the commits to minimize rebuild time:
$ git cherry-pick ..FETCH_HEAD
Robot Reviews
The "Kitware Robot" automatically performs basic checks on the commits and adds a comment acknowledging or rejecting the topic. This will be repeated automatically whenever the topic is pushed to your fork again. A re-check may be explicitly requested by adding a comment with the trailing line:
Do: check
A topic cannot be merged until the automatic review succeeds.
Testing
ParaView has a buildbot instance watching for merge requests to test. A developer must issue a command to buildbot to enable builds:
@buildbot test
The buildbot user (@buildbot) will respond with a comment linking to the CDash results when it schedules builds.
Revise a Topic
If a topic is approved during GitLab review, skip to the next step. Otherwise, revise the topic and push it back to GitLab for another review as follows:
-
Checkout the topic if it is not your current branch:
$ git checkout my-topic -
To revise the
3rd commit back on the topic:$ git rebase -i HEAD~3(Substitute the correct number of commits back, as low as
1.) Follow Git's interactive instructions. -
Return to the above step to share the revised topic.
Merge a Topic
After a topic has been reviewed and approved in a GitLab Merge Request, authorized developers may add a comment of the form
Do: merge
to ask that the change be merged into the upstream repository. By
convention, do not request a merge if any -1 or Rejected-by:
review comments have not been resolved and superseded by at least
+1 or Acked-by: review comments from the same user.
Caveats:
- Currently, developers authorized to do a merge request will be limited to those who have Master privileges on the ParaView Gitlab repository. This preserves the spirit of Gatekeeper Review in the previous development workflow. This decision may be reevaluated in the future and lifted to encourage a more open development community.
Merge Success
If the merge succeeds the topic will appear in the upstream repository
master branch and the Merge Request will be closed automatically.
Merge Failure
If the merge fails (likely due to a conflict), a comment will be added describing the failure. In the case of a conflict, fetch the latest upstream history and rebase on it:
$ git fetch origin
$ git rebase origin/master
(If you are fixing a bug in the latest release then substitute
origin/release for origin/master.)
Return to the above step to share the revised topic.
Delete a Topic
After a topic has been merged upstream the Merge Request will be closed. Now you may delete your copies of the branch.
-
In the GitLab Merge Request page a "Remove Source Branch" button will appear. Use it to delete the
my-topicbranch from your fork in GitLab. -
In your work tree checkout and update the
masterbranch:$ git checkout master $ git pull -
Delete the local topic branch:
$ git branch -d my-topicThe
branch -dcommand works only when the topic branch has been correctly merged. Use-Dinstead of-dto force the deletion of an unmerged topic branch (warning - you could lose commits).
Contribute VTK Changes
If you have any VTK changes, then you are required to get your changes incorporated into VTK using VTK's development workflow. Once your VTK topic has been approved and merged into VTK, add your VTK topic head (or the latest VTK origin/master which includes your VTK topic head) to commit in a ParaView topic and follow the process documented earlier.