Comments (4)
For individual test suite or sequential list of test suites runs, its possible.
This might get tricky with parallel execution to get results for all tests. I recommend to output to xml, then merge all xml reports into one with node package junit-report-merger
from venom.
Thank you your response.
For individual test suite or sequential list of test suites runs, its possible
sorry. I still don't understand what it means.
I am running the test suite in the README.
$ cat cases/01.yml
---
name: Title of TestSuite
testcases:
- name: TestCase with default value, exec cmd. Check if exit code != 1
steps:
- script: echo 'foo'
type: exec
- name: Title of First TestCase
steps:
- script: echo 'foo'
assertions:
- result.code ShouldEqual 0
- script: echo 'bar'
assertions:
- result.systemout ShouldNotContainSubstring foo
- result.timeseconds ShouldBeLessThan 1
- name: GET http testcase, with 5 seconds timeout
steps:
- type: http
method: GET
url: https://eu.api.ovh.com/1.0/
timeout: 5
assertions:
- result.body ShouldContainSubstring /dedicated/server
- result.body ShouldContainSubstring /ipLoadbalancing
- result.statuscode ShouldEqual 200
- result.timeseconds ShouldBeLessThan 1
- name: Test with retries and delay in seconds between each try
steps:
- type: http
method: GET
url: https://eu.api.ovh.com/1.0/
retry: 3
retry_if: # (optional, lets you early break unrecoverable errors)
- result.statuscode ShouldNotEqual 403
delay: 2
assertions:
- result.statuscode ShouldEqual 200
$ venom run cases/01.yml
[trac] writing venom.3.log
• Title of TestSuite (cases/01.yml)
• TestCase-with-default-value-exec-cmd-Check-if-exit-code-1 PASS
• Title-of-First-TestCase PASS
• GET-http-testcase-with-5-seconds-timeout FAIL
Testcase "GET http testcase, with 5 seconds timeout", step #0-0: Assertion "result.timeseconds ShouldBeLessThan 1" failed. expected: 1.036383959 less than 1 but it wasn't (01.yml:0)
• Test-with-retries-and-delay-in-seconds-between-each-try PASS
final status: FAIL
# I would like summary of tests in here.
This doesn't seem to fall within that description.
Could you show examples?
Sorry for my poor English.
from venom.
@blame2020 Hello, I meant it is possible to add into venom as an enhancement. Currently not supported.
from venom.
I understood.
Thank you.
from venom.
Related Issues (20)
- Create a new assertion ShouldJsonContain for arrays HOT 1
- Need uuid support just randAlphaNum HOT 4
- bug: Running venom on windows using git bash shell
- (bug) Test case mark as failed even if succeeded
- (bug) Subassertions are not rendered in reports HOT 2
- (suggestion) Allow delay in non-retryable tasks
- (suggestion) Customize test result filename HOT 1
- (bug) Unable to assert test case on venom.datetime HOT 5
- (enhancement) extend range to cover a test case with multiple steps
- Add --var-env [prefix] feature HOT 2
- Documentation update for beta4 HOT 4
- (suggestion) Homebrew formula
- (suggestion) replace "{{ }}" with "$( )", "${ }" or any yaml-friendly marker
- Setting vars value with result of a step does not seem to evaluate HOT 6
- [bug] `skip` doesn't work with variables from previous steps
- [bug] `http` executor can't load TLS certs using absolute path
- [bug] logs name autoincrement doesn't work when `output-dir` is set
- invalid session id with web executor HOT 5
- [Question] Is there a way to make authenticated integration tests ? HOT 1
- [bug] `__type__` seems to not be available anymore HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from venom.