Is your feature request related to a problem? Please describe.
tests dealing with NeoFS via CLI expect particular text sometimes. For example, recently i accidentally changed neofs-cli container get output from container not found to not found, and corresponding test FAIL
this seems good in terms of testing for changes in behavior, and in this particular case. But globally I thought that strict text checking is not always convenient: any improvement of the text makes the test FAIL. For example, if command output will be changed to Container not found - test will FAIL. I wanna two things at the same time:
- do not recv FAIL on test if only text output has been changed
- still get a behavior change report from the test
Describe the solution you'd like
- check resulting codes instead. There are two of them available: NeoFS status and exit code. Checking the NeoFS code would still be a text check, but:
- rest of the cmd output can be changed freely
- code correctness is more important than debug message (do we check codes btw? @evgeniiz321)
NeoFS status codes are also mapped into CLI exit ones one way or another. We can develop this behavior reduce text checks even more
- report about text change in warning. As i can see, they are available in current toolchain
=== 95 passed, 1 warning in 2239.92s (0:37:19) ===
Is your feature request related to a problem? Please describe.
tests dealing with NeoFS via CLI expect particular text sometimes. For example, recently i accidentally changed
neofs-cli container getoutput fromcontainer not foundtonot found, and corresponding test FAILthis seems good in terms of testing for changes in behavior, and in this particular case. But globally I thought that strict text checking is not always convenient: any improvement of the text makes the test FAIL. For example, if command output will be changed to
Container not found- test will FAIL. I wanna two things at the same time:Describe the solution you'd like
NeoFS status codes are also mapped into CLI exit ones one way or another. We can develop this behavior reduce text checks even more
=== 95 passed, 1 warning in 2239.92s (0:37:19) ===