rmbishop / tinycover Goto Github PK

View Code? Open in Web Editor NEW

8.0 8.0 1.0 775 KB

C source MCDC instrumentation and coverage report generation tool

License: Other

Batchfile 0.15% Shell 0.07% C 59.57% Lua 12.30% Makefile 0.73% HTML 26.58% CSS 0.18% Roff 0.42% C++ 0.01%

tinycover's People

Contributors

Stargazers

Watchers

Forkers

mrx23dot

tinycover's Issues

Add support for restrict and restrict__ in array declarations

  int f(int n, int a[restrict n]) works fine.
  int f(int n, int a[__restrict n]) fails to parse.
  int f(int n, int a[__restrict__ n]) fails to parse.

Create a report file that links coverage with the .dat file(s) that achieved it.

#pragma DISABLE_COVERAGE should prevent parsing of code

#pragma DISABLE_COVERAGE should prevent parsing of code, which could future-proof the tool against code that doesn't parse well

Add support for __builtin_types_compatible_p

"!" followed by relational expressions not instrumented properly

  if (!(idx == 1))
  {
    
  }

Should be instrumented to this:

  if ((INST_SINGLE(0,1,!(idx == 1))))
  {
    
  }

but is currently instrumented to this:

  if (!(INST_SINGLE(0,1,(idx == 1))))
  {
    
  }

a + (b && c) && d does causes tool crash

When the following code is parsed, the tool crashes:

int f(int a, int b, int c, int d)
{
    a + (b && c) && d;
}

The error that the tool generates is:

libtinycover.lua:1181: attempt to concatenate a nil value (local 'offset')

Compare performance to professional tool

http://www.testcocoon.org/download.html

TestCocoon usage.txt

for

#include <stdio.h>

#define DDDD 3
#define DD1DD 2
#define DDD3D 1




int main(int argc, char *argv[])
{

t0tttt(DD1DD);
t0tttt(DDD3D);
return 0;
}

void t0tttt(int i){

if (i == DD1DD || i == DDD3D )
{
i++;
printf("DD1DD\n");
}
}

void ttt1tt(void){

}

void ttt2tt(void){

}

void t3tttt(void){

}

it should report

c:\users\bence\desktop\testcocoon\test\hello.c:29:1 NOT EXECUTED:never executed: '}' 
c:\users\bence\desktop\testcocoon\test\hello.c:33:1 NOT EXECUTED:never executed: '}' 
c:\users\bence\desktop\testcocoon\test\hello.c:37:1 NOT EXECUTED:never executed: '}' 
c:\users\bence\desktop\testcocoon\test\hello.c:20:15 NOT EXECUTED:partially executed: 'i == 1' was not false

Missing support for _Static_assert

Add support for _Static_assert.

Prevent instrumentation of expressions within some builtins, which require constant expressions.

Missing support for size_t

size_t fails to parse correctly. Add support for size_t.

Generate html reports

Html reports should be generated, either optionally or by default.

Add support for alignas

Need support for:

_Alignas 
alignas

Make the original source code easily traceable to instrumented source code.

Add support for msvc extension __pragma within expressions

typeof does not parse (whereas typeof__ works ok)

The parser fails when it sees "__typeof".

"typeof" works fine.

Support for "__typeof" should be added.

Add support for __bf16

Add support for __bf16.

Add an example project that shows more examples of how code should be instrumented

Add support for msvc extension try/except

Optimize coverage store for smaller decisions. Coverage can be stored in single 32 bit words instead of arrays.

Issue handling \ in single statement blocks

The following valid program will be incorrectly instrumented:

int f1()
{
  int x = 0;
  if(1)
    x++;
\
}

This will become

#include <tc_inst_decl.h>
int doit()
{
  unsigned int tc_cov_offset_0, tc_temp_cond_0, tc_temp_dec_0;
  int x = 0;
  COV_STATEMENT(0);
  if(INST_SINGLE(0,1,(1)))
    {COV_STATEMENT(2);
    x++;
\}
}

Notice "\}". The \ is stray, and causes a parser error. Need to a newline before the inserted closing "}"

Add example of using libtinycover outside of tinycover

Parser cannot handle multiple comma-separated label identifiers after label keyword.

The following code will fail to parse:
__label__ l1, l2;

x = ((a || b) >> (c || d)) fails to parse propertly

The >> operator is not properly handled, due to missing

found = true

within the shift_expression function.

Boolean expression with cast expression fails to parse.

The following code fails to parse:

    if (a && ((int) (a && b)))
    {
    }

This generates the following error: libtinycover.lua:1181: attempt to concatenate a nil value (local 'offset')

Whereas the following code parses fine:

    if (a && ((a && b)))
    {
    }

Auto-generate a function for saving structural coverage

Basic function for saving structural coverage on a host target:

void dump_coverage(char *data_file_name)
{
    unsigned int i;

    FILE *out_file = fopen(data_file_name,"w");

    for(i = 0; i < TC_COVERAGE_ARRAY_LENGTH; i++)
    {
        fprintf(out_file,"%d\n",tc_coverage[i]);
    }

    fclose(out_file);
}

This will need to change for an embedded target that doesn't using the stdio.

Add support for _Decimal32, _Decimal64, and _Decimal128

Close files after opening them.

In tinycover_utils.lua, add

f:close()

after

local c_text = f:read("*all")

Line numbers of multi-line decisions are too high by +1.

In the following example, the Line_Number in the report file is reported as 4, even though the decision starts on line 3.

int f(int a, int b)
{    
    if(a 
       &&
       b)
    {
       return 1;
    }
}