Skip to content

Add TAP reporter#1305

Merged
jgebal merged 25 commits intoutPLSQL:developfrom
WayneNani:feature/add-tap-reporter
Mar 19, 2026
Merged

Add TAP reporter#1305
jgebal merged 25 commits intoutPLSQL:developfrom
WayneNani:feature/add-tap-reporter

Conversation

@WayneNani
Copy link
Copy Markdown
Contributor

I added a reporter for the Test Anything Protocol . It is easy to read for humans and machines alike and supported by a wide variety of consumers. These consumers can then aggregate test results from different projects or programming languages.

I tried to include all features from the latest TAP Specification as far as utPLSQL supports them (i.e., TODO tests are not supported in utPLSQL as far as I know).

I also added some test cases that should provide a decent coverage.

Please feel free to let me know if I can add anything else.

@lwasylow
Copy link
Copy Markdown
Member

lwasylow commented Aug 1, 2025

Hi @WayneNani,
Thank you very much for creating this.
I'm on holiday currently so will look when I'm back, possibly @jgebal will be able earlier.

One thing could you please update the documentation reporters section with screens etc.?

Kind regards Lukasz

@WayneNani
Copy link
Copy Markdown
Contributor Author

Hey @lwasylow ,
thanks for the quick reply! I changed the documentation as well, thanks for the heads-up.

@WayneNani
Copy link
Copy Markdown
Contributor Author

Hey @lwasylow and @jgebal ,

is there anything else I can do to streamline the process for you?

@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Mar 8, 2026

@jgebal
Copy link
Copy Markdown
Member

jgebal commented Mar 9, 2026

Hello @WayneNani

As you have probably noticed, the project was on pause for quite some time.
I am planning to give it a small refresh and so will aim to integrate your pull-request.

Will you be available to address the review comments (if any)?

@WayneNani
Copy link
Copy Markdown
Contributor Author

Hey @jgebal,

I am happy to address any remarks you have.

@jgebal jgebal self-assigned this Mar 15, 2026
@jgebal
Copy link
Copy Markdown
Member

jgebal commented Mar 15, 2026

@WayneNani
One of widely used elements of utPLSQL is nested suites (with suitepaths) and contexts within suite.

How would the TAP reporter show results of nested suites or suite with contexts?

I would expect the report to show it as a subtest according to the TAP specification.

Even it it is already implemented in this PR, it is not mentioned in documentation of reporter and it is not expressed in the tests.

I would expect reporter to support the Commented Subtests (those are recommended).

image

self.lvl := 0;
end;
end;
/ No newline at end of file
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, it's probably better to leave an empty newline at the end of each file.

@jgebal
Copy link
Copy Markdown
Member

jgebal commented Mar 15, 2026

@WayneNani
The PR is clean and implementation is really nice.
Thank you for the contribution.
The only concerns is around support for nested suites and contexts.
It is be required to have that tested and documented.

Once this is done. We will include this change in next release (coming soon).

@WayneNani
Copy link
Copy Markdown
Contributor Author

@jgebal Thanks for the review! You are right, I forgot to include tests regarding suites and contexts and have fixed that. I decided to use the existing reporters test package which comes with a suitepath and context and left the escaping test package nearly untouched.
I also included a test to still include the subtest even when it only consists of disabled tests.

@jgebal
Copy link
Copy Markdown
Member

jgebal commented Mar 19, 2026

Because our pipeline doesn't seem to work with external PRs anymore, I will pull and deploy your changes locally to take a look.

@jgebal
Copy link
Copy Markdown
Member

jgebal commented Mar 19, 2026

@WayneNani
The PR looks really good.
Beautiful contribution tot he framework.

Thank you 👍

Starting with next release we will be only suppoorting DB 19c and above.

Hopefully you don't need the reporter for any unsupported version of Oracle.

@jgebal jgebal merged commit 7ce1909 into utPLSQL:develop Mar 19, 2026
2 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants