Provided by: lava-tool_0.14-2_all bug

NAME

       lava-tool - LAVA Tool Command Line Support

SUMMARY

       lava-tool is a command-line tool to interact with LAVA.

USAGE

       lava-tool [-h] <subcommand> [args]

OPTIONAL ARGUMENTS

          -h, --help
                 show this help message and exit

SUBCOMMANDS

       Type lava-tool <subcommand> -h for help on a specific subcommand.

AVAILABLE SUBCOMMANDS

       data-views
              Show data views defined on the server

                 Usage: lava-tool   data-views   [-h]   --dashboard-url  URL  [--verbose-xml-rpc]
                        [--experimental-notice]

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

                 Experimental commands:

                        --experimental-notice
                               Explain the nature of experimental commands

       job-output
              Get job output from the scheduler

                 Usage: lava-tool job-output [-h] [--overwrite] [--output OUTPUT] SERVER JOB_ID

                 Positional arguments:

                        SERVER Host to download job output from

                        JOB_ID Job ID to download output file

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                        --overwrite
                               Overwrite files on the local disk

                        --output OUTPUT, -o OUTPUT
                               Alternate name of the output file

       devices-list

              Get list of devices from the scheduler.

                     Usage: lava-tool devices-list [-h] SERVER

                     Positional arguments:

                            SERVER Host to query for the list of devices

                     Optional arguments:

                            -h, --help
                                   show this help message and exit

       help   Show a summary of all available commands

       deserialize
              Deserialize a bundle on the server

                 Usage: lava-tool deserialize [-h] --dashboard-url URL [--verbose-xml-rpc] SHA1

                 Positional arguments:

                        SHA1   SHA1 of the bundle to deserialize

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       get    Download a bundle from the server

                 Usage: lava-tool get [-h] --dashboard-url URL [--verbose-xml-rpc]  [--overwrite]
                        [--output OUTPUT] SHA1

                 Positional arguments:

                        SHA1   SHA1 of the bundle to download

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                        --overwrite
                               Overwrite files on the local disk

                        --output OUTPUT, -o OUTPUT
                               Alternate name of the output file

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       auth-add
              Add an authentication token

                 Usage: lava-tool auth-add [-h] [--token-file TOKEN_FILE] [--no-check] HOST

                 Positional arguments:

                        HOST   Endpoint to add token for, in the form scheme://username@host. The
                               username will default to the currently logged in user.

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                        --token-file TOKEN_FILE
                               Read the secret from here rather than prompting for it.

                        --no-check
                               By default, a call to the remote server is made to check that  the
                               added  token  works  before  remembering  it.  Passing this option
                               prevents this check.

       put    Upload a bundle on the server

                 Usage: lava-tool put [-h] --dashboard-url URL [--verbose-xml-rpc] LOCAL [REMOTE]

                 Positional arguments:

                        LOCAL  pathname on the local file system

                        REMOTE pathname on the server

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       bundles
              Show bundles in the specified stream

                 Usage: lava-tool bundles [-h] --dashboard-url URL [--verbose-xml-rpc] [PATHNAME]

                 Positional arguments:

                        PATHNAME
                               pathname on the server (defaults to /anonymous/)

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       server-version
              Display dashboard server version

                 Usage: lava-tool server-version [-h] --dashboard-url URL [--verbose-xml-rpc]

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       cancel-job
              Cancel job

                 Usage: lava-tool cancel-job [-h] SERVER JOB_ID

                 Positional arguments:

                        SERVER Host to cancel job on

                        JOB_ID Job ID to cancel

                 Optional arguments:

                        -h, --help
                               show this help message and exit

       resubmit-job
              Resubmit job

                 Usage: lava-tool resubmit-job [-h] SERVER JOB_ID

                 Positional arguments:

                        SERVER Host to resubmit job on

                        JOB_ID Job ID to resubmit

                 Optional arguments:

                        -h, --help
                               show this help message and exit

       version
              Show dashboard client version

                 Usage: lava-tool version [-h]

                 Optional arguments:

                        -h, --help
                               show this help message and exit

       query-data-view
              Invoke a specified data view

                 Usage: lava-tool   restore   [-h]   --dashboard-url   URL    [--verbose-xml-rpc]
                        [--experimental-notice] QUERY

                 Positional arguments:

                        QUERY  Data view name and any optional and required arguments

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

                 Experimental commands:

                        --experimental-notice
                               Explain the nature of experimental commands

       submit-job
              Submit a job to lava-scheduler

                 Usage: lava-tool submit-job [-h] SERVER JSON_FILE

                 Positional arguments:

                        SERVER Host to resubmit job on

                        JSON_FILE
                               JSON file with test defenition to submit

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Experimental commands:

                        --experimental-notice
                               Explain the nature of experimental commands

       streams
              Show streams you have access to

                 Usage: lava-tool streams [-h] --dashboard-url URL [--verbose-xml-rpc]

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       make-stream
              Create a bundle stream on the server

                 Usage: lava-tool   make-stream   [-h]  --dashboard-url  URL  [--verbose-xml-rpc]
                        [--name NAME] pathname

                 Positional arguments:

                        pathname
                               Pathname of the bundle stream to create

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                        --name NAME
                               Name of the bundle stream (description)

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

       compare-device-conf
              Compare device configurations and output a diff.

                 Usage: lava-tool compare-device-conf [-h]  [--wdiff]  [--use-stored  USE_STORED]
                        [--dispatcher-config-dir DISPATCHER_CONFIG_DIR] [CONFIGS [CONFIGS ...]]

                 Positional arguments:

                        CONFIGS
                               List of device config paths, at least one, max two.

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                        --wdiff, -w
                               Use wdiff for parsing output

                        --use-stored USE_STORED, -u USE_STORED
                               Use stored device config with specified device

                        --dispatcher-config-dir DISPATCHER_CONFIG_DIR
                               Where to find the device_type templates.

       pull   Copy bundles and bundle streams from one dashboard to another

                 Usage: lava-tool    pull    [-h]    --dashboard-url    URL   [--verbose-xml-rpc]
                        [--experimental-notice] FROM [STREAM [STREAM ...]]

                 Positional arguments:

                        FROM   URL of the remote validation dashboard

                 Optional arguments:

                        -h, --help
                               show this help message and exit

                 Dashboard specific arguments:

                        --dashboard-url URL
                               URL of your validation dashboard

                        STREAM Streams to pull from (all by default)

                 Debugging arguments:

                        --verbose-xml-rpc
                               Show XML-RPC data

                 Experimental commands:

                        --experimental-notice
                               Explain the nature of experimental commands

                 This command checks for two environment varialbes: The value of DASHBOARD_URL is
                 used as a replacement for --dashbard-url. The value of REMOTE_DASHBOARD_URL as a
                 replacement for FROM.  Their  presence  automatically  makes  the  corresponding
                 argument optional.

       get-pipeline-device-config
              Get pipeline device configuration to a local file or stdout.

              Usage: lava-tool  get-pipeline-device-config  [-h]  [--overwrite] [--output OUTPUT]
                     [--output-to-stdout] SERVER DEVICE_HOSTNAME

              Positional arguments:

                     SERVER Host to download pipeline device configuration from

                     DEVICE_HOSTNAME
                            HOSTNAME of the pipeline device for which configuration is required

              Optional arguments:

                     -h, --help
                            show this help message and exit

                     --overwrite
                            Overwrite files on the local disk

                     --output OUTPUT, -o OUTPUT
                            Alternate name of the output file

                     --stdout
                            Write output to stdout

       device-dictionary
              Update or export device dictionary data as jinja2 data. [Superusers only.]   Either
              [--update    |    -u]   or   [--export   |   -e]   must   be   used.    Wraps   the
              import-device-dictionary and  export-device-dictionary  XMLRPC  API  calls  on  the
              specified server.

              Usage: lava-tool device-dictionary [-h] [--update UPDATE] [--export]
                     SERVER DEVICE_HOSTNAME

              Positional arguments:
                     SERVER                 Host  to  query  or  update  the device dictionary on
                     DEVICE_HOSTNAME       DEVICE_HOSTNAME to query or update

              Optional arguments:

                     -h, --help
                            show this help message and exit

                     --update UPDATE, -u UPDATE
                            Load a jinja2 file to update the device dictionary

                     --export, -e
                            Export the device dictionary for this device as jinja2

LAVA TEST DEFINITIONS

       A LAVA Test Definition comprises of two parts:

       • the data to setup the test, expressed as a JSON file.

       • the instructions to run inside the test, expressed as a YAML file.

       This allows the same tests to  be  easily  migrated  to  a  range  of  different  devices,
       environments  and  purposes  by  using the same YAML files in multiple JSON files. It also
       allows tests to be built from a range of components by aggregating  YAML  files  inside  a
       single JSON file.

CONTENTS OF THE JSON FILE

       The JSON file is submitted to the LAVA server and contains:

       • Demarcation as a health check or a user test.

       • The default timeout of each action within the test.

       • The logging level for the test, DEBUG or INFO.

       • The name of the test, shown in the list of jobs.

       • The location of all support files.

       • All parameters necessary to use the support files.

       • The declaration of which device(s) to use for the test.

       • The location to which the results should be uploaded.

       • The JSON determines how the test is deployed onto the device and where to find the tests
         to be run.

BASIC JSON FILE

       Your first LAVA test should use the DEBUG logging level so that it is easier to  see  what
       is happening.

       A suitable timeout for your first tests is 900 seconds.

       Make  the job_name descriptive and explanatory, you will want to be able to tell which job
       is which when reviewing the results.

       Make sure the device_type matches exactly with one of the suitable device types listed  on
       the server to which you want to submit this job.

       Change  the  stream  to  one  to  which  you are allowed to upload results, on your chosen
       server.

          {
            "health_check": false,
            "logging_level": "DEBUG",
            "timeout": 900,
            "job_name": "kvm-basic-test",
            "device_type": "kvm",
            "actions": [
                {
                    "command": "deploy_linaro_image",
                    "parameters": {
                        "image": "http://images.validation.linaro.org/kvm-debian-wheezy.img.gz"
                    }
                },
                {
                    "command": "lava_test_shell",
                    "parameters": {
                        "testdef_repos": [
                            {
                                "git-repo": "git://git.linaro.org/qa/test-definitions.git",
                                "testdef": "ubuntu/smoke-tests-basic.yaml"
                            }
                        ],
                        "timeout": 900
                    }
                },
                {
                    "command": "submit_results_on_host",
                    "parameters": {
                        "stream": "/anonymous/example/",
                        "server": "http://localhost/RPC2/"
                    }
                }
            ]
          }

NOTE

       Always check your JSON syntax. A useful site for this is http://jsonlint.com.  YAML syntax
       can be checked at http://yaml-online-parser.appspot.com/?yaml=

BUGS AND ISSUES

       General  hints  and  tips  on  lava-tool  and  LAVA  are  available  on  the  Linaro wiki:
       https://wiki.linaro.org/Platform/LAVA/LAVA_Tips.  (Login is  not  required  to  read  this
       page, only to edit.)

       NOTE:
          lava-tool   is   intended  for  user  command  line  interaction.   For  all  scripting
          requirements use XMLRPC support directly. Help on using XMLRPC with python  is  in  the
          API     |    Available    Methods    section    of    the    LAVA    instance.     e.g.
          https://validation.linaro.org/api/help/ Other languages also have XMLRPC support.

       lava-tool uses python-keyring for the authentication and this can cause some issues.  When
       a desktop UI is installed, python-keyring attempts to communicate with the desktop keyring
       support, e.g. gnome-keyring for a clean desktop  interface.   If  the  particular  desktop
       lacks such support, there can be issues using lava-tool.

       There are several steps which can be useful in this situation (which results from a design
       choice within the python-keyring package and is beyond the control of lava-tool itself):

       https://wiki.linaro.org/Platform/LAVA/LAVA_Tips#gnomekeyring.IOError

       These suggestions are in no particular order and users need to choose whichever method has
       the  least  impact  on  the  rest  of the workflow. If any of these steps allow successful
       authentication using lava-tool, the original problem is not a bug in lava-tool itself.

       • Use a server version of Ubuntu (or a remove the Gnome Keyring) [1]

       • unset the DISPLAY environment variable in your shell (this will make the keyring library
         not use the GNOME keyring)

       • Setup and use a file-based key ring:

            mkdir ~/.cache/keyring
            echo '
            [backend]
            default-keyring=keyring.backend.CryptedFileKeyring
            keyring-path=~/.cache/keyring/
            ' > ~/keyringrc.cfg

       • Use a remote xmlrpclib call:

            import xmlrpclib
            import json

            config = json.dumps({ ... })
            server=xmlrpclib.ServerProxy("http://username:API-Key@localhost/RPC2/")
            jobid=server.scheduler.submit_job(config)

       • Disable DBUS links to the keyring backend [2]:

            $ unset DBUS_SESSION_BUS_ADDRESS

       [1]  removing  gnome-keyring  may  have  unwanted consequences and may still generate DBUS
            issues, see [2]

       [2]  the DBUS change can be required even if gnome-keyring is not installed but a  desktop
            UI  is  present.  Depending  on the use case, this can be unset locally, in a wrapper
            script or in the entire session, e.g. in ~/.bashrc.

TESTING CHANGES TO LAVA-TOOL

       Adding new commands to lava-tool requires changes to the entrypoints.ini  file  and  these
       changes  need  to  be picked up by setuptools. The local test directory can use any name -
       just remember to remove the directory before committing your local changes for review.

       The locally changed lava-tool will still use the same keyring support.

          python setup.py install --root=./_dev/lava-tool/ --install-layout=deb
          PYTHONPATH=. python ./_dev/lava-tool/usr/bin/lava-tool --help
          rm -rf ./_dev/

AUTHOR

       Linaro Validation Team

COPYRIGHT

       2010-2015, Linaro Limited