tag:github.com,2008:https://github.com/data-apis/array-api-tests/releases
Release notes from array-api-tests
2026-02-26T12:19:15Z
tag:github.com,2008:Repository/291148032/2026.02.26
2026-02-26T12:19:15Z
2026.02.26
<p>array-api-tests 2026.02.26: target the Array API 2025.12 revision</p>
ev-br
tag:github.com,2008:Repository/291148032/2025.05.23
2025-05-22T07:48:50Z
2025.05.23: Merge pull request #373 from ev-br/skip_xfails
<p>ENH: add ARRAY_API_TESTS_XFAIL_MARK to turn xfails into skips</p>
ev-br
tag:github.com,2008:Repository/291148032/2022.09.30
2022-09-30T11:58:09Z
2022.09.30
<h2>What's Changed</h2>
<ul>
<li>Prevent string dtypes from being split into chars in pytest_helpers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/djl11/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/djl11">@djl11</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1244040481" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/123" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/123/hovercard" href="https://github.com/data-apis/array-api-tests/pull/123">#123</a></li>
<li>Index testing improvements by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1245278008" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/124" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/124/hovercard" href="https://github.com/data-apis/array-api-tests/pull/124">#124</a></li>
<li>test_iop fix: assign <code>res</code> to in-place operator function <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1283975697" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/130" data-hovercard-type="issue" data-hovercard-url="/data-apis/array-api-tests/issues/130/hovercard" href="https://github.com/data-apis/array-api-tests/issues/130">#130</a> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simonetgordon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simonetgordon">@simonetgordon</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1285764268" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/133" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/133/hovercard" href="https://github.com/data-apis/array-api-tests/pull/133">#133</a></li>
<li>MAINT: mapping f-strings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tylerjereddy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tylerjereddy">@tylerjereddy</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1333794503" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/136" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/136/hovercard" href="https://github.com/data-apis/array-api-tests/pull/136">#136</a></li>
<li>JSON reporting by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmeurer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmeurer">@asmeurer</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1284243240" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/131" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/131/hovercard" href="https://github.com/data-apis/array-api-tests/pull/131">#131</a></li>
<li>Fix the tests when --json-report is not used by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmeurer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmeurer">@asmeurer</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1352641905" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/139" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/139/hovercard" href="https://github.com/data-apis/array-api-tests/pull/139">#139</a></li>
<li>Bump Hypothesis, specify <code>api_version</code> in <code>make_strategies_namespace()</code> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1392304069" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/144" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/144/hovercard" href="https://github.com/data-apis/array-api-tests/pull/144">#144</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simonetgordon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simonetgordon">@simonetgordon</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1285764268" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/133" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/133/hovercard" href="https://github.com/data-apis/array-api-tests/pull/133">#133</a></li>
<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tylerjereddy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tylerjereddy">@tylerjereddy</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1333794503" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/136" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/136/hovercard" href="https://github.com/data-apis/array-api-tests/pull/136">#136</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.05.18...2022.09.30"><tt>2022.05.18...2022.09.30</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.05.18
2022-05-18T10:25:06Z
2022.05.18
<p>For this release you'll want to bump your Hypothesis versions, e.g. run <code>pip install -r requirements.txt</code> again.</p>
<h2>What's Changed</h2>
<ul>
<li>Test special cases in statistical functions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1235532690" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/119" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/119/hovercard" href="https://github.com/data-apis/array-api-tests/pull/119">#119</a></li>
<li><code>pytest_helpers.py</code> documentation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1238358816" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/120" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/120/hovercard" href="https://github.com/data-apis/array-api-tests/pull/120">#120</a></li>
<li>Test newaxis in <code>test_getitem</code> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1238484536" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/121" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/121/hovercard" href="https://github.com/data-apis/array-api-tests/pull/121">#121</a></li>
<li>Ignore asserting out dtype for undefined dtypes in <code>test_prod</code> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1238554236" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/122" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/122/hovercard" href="https://github.com/data-apis/array-api-tests/pull/122">#122</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.04.28...2022.05.18"><tt>2022.04.28...2022.05.18</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.04.28
2022-04-28T10:41:12Z
2022.04.28
<p>You'll want to review your skipped signature tests for this one!</p>
<h2>What's Changed</h2>
<ul>
<li>Remove <code>generate_stubs.py</code> + hard-coded stubs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1178069850" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/109" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/109/hovercard" href="https://github.com/data-apis/array-api-tests/pull/109">#109</a></li>
<li>Implement <code>EqualityMapping</code> and use for relevant dtype helpers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1203227771" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/112" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/112/hovercard" href="https://github.com/data-apis/array-api-tests/pull/112">#112</a></li>
<li>Minor fixes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1211171655" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/116" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/116/hovercard" href="https://github.com/data-apis/array-api-tests/pull/116">#116</a></li>
<li>Revamped signature tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1202049754" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/110" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/110/hovercard" href="https://github.com/data-apis/array-api-tests/pull/110">#110</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.03.22...2022.04.28"><tt>2022.03.22...2022.04.28</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.03.22
2022-03-22T11:46:09Z
2022.03.22
<h2>What's Changed</h2>
<ul>
<li>Utilise RST conversion of spec, generate runtime special cases tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1154248494" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/104" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/104/hovercard" href="https://github.com/data-apis/array-api-tests/pull/104">#104</a></li>
</ul>
<p>Note that we now use a git submodule for the test suite, so be sure to <code>git submodule update --init</code>. We know it's not ideal for vendor use cases: let us know your thoughts in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1176620838" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/107" data-hovercard-type="issue" data-hovercard-url="/data-apis/array-api-tests/issues/107/hovercard" href="https://github.com/data-apis/array-api-tests/issues/107">#107</a></p>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.02.24...2022.03.22"><tt>2022.02.24...2022.03.22</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.02.24
2022-02-24T15:25:30Z
2022.02.24
<h2>What's Changed</h2>
<ul>
<li>Mark test_array_object.py::test_getitem_masking as having data dependent shapes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tomwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tomwhite">@tomwhite</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1149337865" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/103" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/103/hovercard" href="https://github.com/data-apis/array-api-tests/pull/103">#103</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tomwhite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tomwhite">@tomwhite</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1149337865" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/103" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/103/hovercard" href="https://github.com/data-apis/array-api-tests/pull/103">#103</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.02.11...2022.02.24"><tt>2022.02.11...2022.02.24</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.02.11
2022-02-11T14:51:40Z
2022.02.11
<h2>What's Changed</h2>
<ul>
<li>Minor elwise+op fixes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1127053882" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/97" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/97/hovercard" href="https://github.com/data-apis/array-api-tests/pull/97">#97</a></li>
<li>Implementing the remaining linalg tests w/ additional fixes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1127041262" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/96" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/96/hovercard" href="https://github.com/data-apis/array-api-tests/pull/96">#96</a></li>
<li>Fixes related to Dask by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1132556634" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/98" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/98/hovercard" href="https://github.com/data-apis/array-api-tests/pull/98">#98</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.02.03...2022.02.11"><tt>2022.02.03...2022.02.11</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.02.03
2022-02-03T09:43:52Z
2022.02.03
<h2>What's Changed</h2>
<ul>
<li>Increase coverage and other niceties for the operator/elementwise tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1115345111" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/89" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/89/hovercard" href="https://github.com/data-apis/array-api-tests/pull/89">#89</a></li>
<li>Inplace shapes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1122320659" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/91" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/91/hovercard" href="https://github.com/data-apis/array-api-tests/pull/91">#91</a></li>
<li>Skip rather than xfail on CI by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/honno/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/honno">@honno</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1122849601" data-permission-text="Title is private" data-url="https://github.com/data-apis/array-api-tests/issues/92" data-hovercard-type="pull_request" data-hovercard-url="/data-apis/array-api-tests/pull/92/hovercard" href="https://github.com/data-apis/array-api-tests/pull/92">#92</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/data-apis/array-api-tests/compare/2022.1...2022.02.03"><tt>2022.1...2022.02.03</tt></a></p>
honno
tag:github.com,2008:Repository/291148032/2022.1
2022-01-26T21:07:54Z
array-api-tests 2022.1
<p>First release of the test suite</p>
asmeurer