Git Product home page Git Product logo

Comments (4)

ivan-velasco avatar ivan-velasco commented on June 12, 2024

For individual test suite or sequential list of test suites runs, its possible.

This might get tricky with parallel execution to get results for all tests. I recommend to output to xml, then merge all xml reports into one with node package junit-report-merger

from venom.

blame2020 avatar blame2020 commented on June 12, 2024

Thank you your response.

For individual test suite or sequential list of test suites runs, its possible

sorry. I still don't understand what it means.

I am running the test suite in the README.

$ cat cases/01.yml 
---
name: Title of TestSuite
testcases:
- name: TestCase with default value, exec cmd. Check if exit code != 1
  steps:
  - script: echo 'foo'
    type: exec

- name: Title of First TestCase
  steps:
  - script: echo 'foo'
    assertions:
    - result.code ShouldEqual 0
  - script: echo 'bar'
    assertions:
    - result.systemout ShouldNotContainSubstring foo
    - result.timeseconds ShouldBeLessThan 1

- name: GET http testcase, with 5 seconds timeout
  steps:
  - type: http
    method: GET
    url: https://eu.api.ovh.com/1.0/
    timeout: 5
    assertions:
    - result.body ShouldContainSubstring /dedicated/server
    - result.body ShouldContainSubstring /ipLoadbalancing
    - result.statuscode ShouldEqual 200
    - result.timeseconds ShouldBeLessThan 1

- name: Test with retries and delay in seconds between each try
  steps:
  - type: http
    method: GET
    url: https://eu.api.ovh.com/1.0/
    retry: 3
    retry_if: # (optional, lets you early break unrecoverable errors)
    - result.statuscode ShouldNotEqual 403
    delay: 2
    assertions:
    - result.statuscode ShouldEqual 200

$ venom run cases/01.yml 
          [trac] writing venom.3.log
 • Title of TestSuite (cases/01.yml)
        • TestCase-with-default-value-exec-cmd-Check-if-exit-code-1 PASS
        • Title-of-First-TestCase PASS
        • GET-http-testcase-with-5-seconds-timeout FAIL
Testcase "GET http testcase, with 5 seconds timeout", step #0-0: Assertion "result.timeseconds ShouldBeLessThan 1" failed. expected: 1.036383959 less than 1 but it wasn't (01.yml:0)
        • Test-with-retries-and-delay-in-seconds-between-each-try PASS
final status: FAIL 

# I would like summary of tests in here.

This doesn't seem to fall within that description.

Could you show examples?

Sorry for my poor English.

from venom.

ivan-velasco avatar ivan-velasco commented on June 12, 2024

@blame2020 Hello, I meant it is possible to add into venom as an enhancement. Currently not supported.

from venom.

blame2020 avatar blame2020 commented on June 12, 2024

@ivan-velasco

I understood.

Thank you.

from venom.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.