Skip to content

[meta] Improve system tests robustness #1537

@marc-gr

Description

@marc-gr

Several integrations that rely on external APIs use stream as their test services to build mocks and run system tests.

There are some blind spots when it comes to detecting config errors that could lead to wrong pagination, infinite pagination loops, etc. mainly caused by the inability of elastic-package to detect anything else than is there any data? in the data stream or is there the expected number of events? if assert.hit_count is set, which makes things better but is not enough.

As part of an effort to improve system tests robustness some things could be improved:

Once this is done we can leverage these new behavior for system tests that require it.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions