Initial Implementation

[iamogbz]

CLI

• options: in config file format
  • command to warm up project before running benchmark command. defaut: null
  • named map of benchmark commands. default: {}
  • name of benchmark output file. default: "result.benchmark".
  • location of benchmark output. default: "artifacts".
  • repo branch to store benchmark output. default: "benchmarks" (set to null to disable)
  • failure threshold of target branch comparison. default: null
  • failure threshold of parent sha comparison. default: null
• init: create and push orphan branch for benchmarks
• compare: run comparison between two commits
• run: run benchmarks on a commit hash
• batch: repo run benchmarks on a list of commits
• publish: push benchmark results to repo branch