Skip to content

elek/ogh

Repository files navigation

Ozone Github Helper

Ozone GH is a simple script to make it easier the development of Apache Hadoop Ozone

Install

OSX:

brew install elek/brew/ogh

Linux

go get github.com/elek/ogh

Configuration

If you have ever used hub or gh, you don't need to set the GITHUB_TOKEN:

Github token can be set by

  • setting GITHUB_TOKEN environment variable
  • Setting it in .config/hub used by hub
  • Setting it in .config/gh/config.yaml

Interactive

You can use it as an interactive command with fzf

ogh review | fzf --reverse | awk '{print $2}' | xargs -n1 ogh

Caching

Github calls are cached for 3-5 minutes, by default. (Cache stored in stander ~/.cache/ogh locations).

Results of finished builds are cached forever.

Usage

Print out READY pull requests

> ogh review

+-----+--------------+----------------------------------------------------+------------------------+----------------+
| ID  |    AUTHOR    |                      SUMMARY                       |      PARTICIPANTS      |     CHECK      |
+-----+--------------+----------------------------------------------------+------------------------+----------------+
| 648 | >avijayanhwx | HDDS-3117. Recon throws InterruptedException while | ✓swagl                 | _______ ______ |
| 578 | >elek        | HDDS-3053. Decrease the number of the chunk writer | ✓adoro                 | _______ ______ |
| 622 | >adoroszlai  | HDDS-3113. Add new Freon test for putBlock         | ✓elek                  | _______ ______ |
| 551 | >adoroszlai  | HDDS-2717. Handle chunk increments in datanode     | bshas,adoro,arp7,lokes | _______ ______ |
| 618 | >captainzmc  | HDDS-2911. Fix lastUsed and stateEnterTime value i |                        | _______ ______ |
| 555 | >elek        | HDDS-3023. Create Freon test to test isolated Rati |                        | _______ ______ |
| 582 | >smengcl     | HDDS-3047. ObjectStore#listVolumesByUser and Creat | xiaoy                  | _______ ______ |
| 399 | >cxorm       | HDDS-2424. Add the recover-trash command server si | cxorm,bhara,maoba      | _______ ...... |
+-----+--------------+----------------------------------------------------+------------------------+----------------+

Legend (IMPORTANT):

  • [C] means a conflict
  • Participants can be prefixed with a review flag (✓ approved, ✕ change requested)
  • Upper case login name means a real review, lower case is a comment
  • The last column (CHECK) shows the results of the checks
    • _ means a passed
    • . means a missing build
    • % means an in-progress builds
    • any letter (eg. b,c) means a failing test (b -> build, u -> unit test ,etc).
    • The second part (after the space) of the checks display all the integrations tests.

Print out all the available pull requests (including failiing / conflicted ones)

ogh pr

+-----+---------------+----------------------------------------------------+---------------------------------+----------------+
| ID  |    AUTHOR     |                      SUMMARY                       |          PARTICIPANTS           |     CHECK      |
+-----+---------------+----------------------------------------------------+---------------------------------+----------------+
| 430 | >cxorm        | HDDS-2817. Fix listing buckets for setting --prefi | ✕githu,cxorm,smeng              | _______ ______ |
| 649 | >bharatviswa5 | [WIP]HDDS-3120. Freon work with OM HA.             |                                 | ______a _____o |
| 623 | >supratimdeka | HDDS-2941. file create : create key table entries  | mukul                           | _____u_ f_____ |
| 524 | >iamabug      | HDDS-2797. beyond/RunningWithHDFS.md translation   | ✕cxorm                          | _______ ______ |
| 520 | >iamabug      | HDDS-2793. concept/Datanodes.md translation        | iamab,xiaoy                     | ______a ______ |
| 525 | >iamabug      | HDDS-2798. beyond/Containers.md translation        | ✕cxorm,iamab                    | ______a f__h__ |
| 648 | >avijayanhwx  | HDDS-3117. Recon throws InterruptedException while | ✓swagl                          | _______ ______ |
| 608 | >sodonnel     | HDDS-3084 - Extended Network Topology Robot tests  | ✕adoro,✕githu,elek,sodon       | _______ ______ |
| 645 | >runzhiwang   | HDDS-3130. Add jaeger trace span in s3gateway      |                                 | _____u_ ______ |
| 578 | >elek         | HDDS-3053. Decrease the number of the chunk writer | ✓adoro                          | _______ ______ |
| 622 | >adoroszlai   | HDDS-3113. Add new Freon test for putBlock         | ✓elek                           | _______ ______ |
| 551 | >adoroszlai   | HDDS-2717. Handle chunk increments in datanode     | lokes,bshas,adoro,arp7          | _______ ______ |
| 643 | >hanishakoner | HDDS-2339. Add OzoneManager to MiniOzoneChaosClust |                                 | _____u_ ______ |

Print out latest builds on master

ogh builds master

+-----+----------------------+--------------+---------------------+--------+----------------------------------------------------+----------------+
| ID  |       CREATED        |   WORKFLOW   |        REPO         | BRANCH |                       COMMIT                       |     CHECKS     |
+-----+----------------------+--------------+---------------------+--------+----------------------------------------------------+----------------+
| 579 | 2020-03-08T04:04:13Z | build-branch | apache/hadoop-ozone | master | HDDS-3089. TestSCMNodeManager intermittent crash ( | _______ ______ |
| 578 | 2020-03-07T07:35:10Z | build-branch | apache/hadoop-ozone | master | HDDS-3075. Fix ScmCli exception message when conta | _______ ______ |
| 576 | 2020-03-06T22:17:09Z | build-branch | apache/hadoop-ozone | master | HDDS-3071. Datanodes unable to connect to recon in | _______ ______ |
| 574 | 2020-03-06T17:37:19Z | build-branch | apache/hadoop-ozone | master | HDDS-3132. NPE when create RPC client. (#646)      | _____u_ f__h__ |
| 571 | 2020-03-06T15:53:19Z | build-branch | apache/hadoop-ozone | master | HDDS-3072. SCM scrub pipeline should be started af | _______ ______ |
| 570 | 2020-03-06T14:45:47Z | build-branch | apache/hadoop-ozone | master | HDDS-3131. Disable TestMiniChaosOzoneCluster (#644 | _______ ______ |

Download an artifacts

Use ogh artifacts pr/717 (to download the last build of a PR) or ogh artifacts 579 to download results of a specific line (see previous) table.

Without the --all flag, only the failing tests are downloaded.

Rerun build

Usually it's better to do with an empty commit, but you can trigger rerun from the API (use PR number):

ogh rerun 123

For some reason Github usually returns with 500 and starts the rerun.

About

Helper script for Apache Hadoop Ozone development

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors