tag:github.com,2008:https://github.com/dotnet/machinelearning/releases Release notes from machinelearning 2026-01-12T08:07:25Z tag:github.com,2008:Repository/132021166/v6.0.0-preview1 2026-03-12T16:18:00Z v6.0.0-preview1 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 6.0.0-preview1</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>Support gpt-5.1 model in Tiktoken tokenizer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7556" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7556/hovercard">#7556</a>)</li> <li><strong>Support Gpt-5.2 in Tokenizer library</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7571" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7571/hovercard">#7571</a>)</li> <li><strong>Add gpt-5.3 model support to TiktokenTokenizer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7579" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7579/hovercard">#7579</a>)</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Remove Google.Protobuf dependency from Microsoft.ML.Tokenizers</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7587" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7587/hovercard">#7587</a>)</li> <li><strong>Add heap-based BPE merge path for large inputs (&gt;128 bytes)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7580" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7580/hovercard">#7580</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix bug that causes Merge to fail with empty DataFrames</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7573" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7573/hovercard">#7573</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sevenzees/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sevenzees">@sevenzees</a>!</li> <li><strong>Fix bug in PACKAGE.md examples</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7561" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7561/hovercard">#7561</a>)</li> <li><strong>Fix local build on linux that was omitting arch argument</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7549" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7549/hovercard">#7549</a>)</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Update MajorVersion to 6</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7543" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7543/hovercard">#7543</a>)</li> <li><strong>Update mac build machines</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7558" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7558/hovercard">#7558</a>)</li> <li><strong>Add .azuredevops/dependabot.yml</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7553" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7553/hovercard">#7553</a>)</li> <li><strong>Add repo health check workflows (orchestrator, investigator, groomer) and known baseline</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7583" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7583/hovercard">#7583</a>)</li> <li><strong>Add targets for repo health aw</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7588" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7588/hovercard">#7588</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7540" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7540/hovercard">#7540</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7559" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7559/hovercard">#7559</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7562" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7562/hovercard">#7562</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7563" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7563/hovercard">#7563</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>Add 5.0.0 release notes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7544" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7544/hovercard">#7544</a>)</li> </ul> rokonec tag:github.com,2008:Repository/132021166/v5.0.0 2025-11-11T08:40:27Z ML.NET 5.0.0 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 5.0.0</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>[GenAI] Introduce CausalLMPipelineChatClient for MEAI.IChatClient</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7270" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7270/hovercard">#7270</a>)</li> <li><strong>Introducing SentencePiece Unigram Tokenizer Model</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7390" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7390/hovercard">#7390</a>)</li> <li><strong>Phi-4 Tokenizer Support</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7396" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7396/hovercard">#7396</a>)</li> <li><strong>Support O3 OpenAI model mapping</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7394" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7394/hovercard">#7394</a>)</li> <li><strong>Support ByteLevel encoding in Bpe tokenizer to support DeepSeek model</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7425" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7425/hovercard">#7425</a>)</li> <li><strong>Support Tiktoken Gpt-4.1 Model</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7453" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7453/hovercard">#7453</a>)</li> <li><strong>Support OpenAI OSS Models with Tiktoken tokenizer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7494" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7494/hovercard">#7494</a>)</li> <li><strong>Add deterministic option for LightGBM</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7415" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7415/hovercard">#7415</a>)</li> <li><strong>Added NumberOfLeaves to FastForestRegression and FastForestOva options</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7499" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7499/hovercard">#7499</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JoshuaSloan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JoshuaSloan">@JoshuaSloan</a>!</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Add Timeout to Regex used in the tokenizers</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7284" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7284/hovercard">#7284</a>)</li> <li><strong>Final tokenizer's cleanup</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7291" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7291/hovercard">#7291</a>)</li> <li><strong>Update System.Numerics.Tensors version</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7322" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7322/hovercard">#7322</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>[GenAI] SFT Example</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7316" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7316/hovercard">#7316</a>)</li> <li><strong>Update M.E.AI version used by Microsoft.ML.GenAI.Core</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7329" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7329/hovercard">#7329</a>)</li> <li><strong>Update DependencyModel</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7338" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7338/hovercard">#7338</a>)</li> <li><strong>Some tweaks to the Microsoft.ML.Tokenizers PACKAGE.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7360" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7360/hovercard">#7360</a>)</li> <li><strong>Consolidate System.Numerics.Tensors dependency</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7356" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7356/hovercard">#7356</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Update Microsoft.Extensions.AI to 9.3.0-preview.1.25114.11</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7388" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7388/hovercard">#7388</a>)</li> <li><strong>Create SentencePieceTokenizer from options object</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7403" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7403/hovercard">#7403</a>)</li> <li><strong>Unigram tokenizer fixes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7409" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7409/hovercard">#7409</a>)</li> <li><strong>Update to M.E.AI 9.3.0-preview.1.25161.3</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7414" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7414/hovercard">#7414</a>)</li> <li><strong>Reduce usage of unsafe constructs throughout codebase</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7426" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7426/hovercard">#7426</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/GrabYourPitchforks/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/GrabYourPitchforks">@GrabYourPitchforks</a>!</li> <li><strong>Cleanup SentencePiece tokenizer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7427" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7427/hovercard">#7427</a>)</li> <li><strong>Update to M.E.AI 9.4.0-preview.1.25207.5</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7439" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7439/hovercard">#7439</a>)</li> <li><strong>Update to M.E.AI 9.4.3-preview.1.25230.7</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7459" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7459/hovercard">#7459</a>)</li> <li><strong>Update to stable Microsoft.Extensions.AI.Abstractions</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7466" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7466/hovercard">#7466</a>)</li> <li><strong>Convert repository to NuGet Central Package Management</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7482" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7482/hovercard">#7482</a>)</li> <li><strong>Rename Casual to Causal</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7484" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7484/hovercard">#7484</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/feiyun0112/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/feiyun0112">@feiyun0112</a>!</li> <li><strong>Updated Tensorflow.Net to 0.70.2 with Tensorflow 2.7.0.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7472" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7472/hovercard">#7472</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Crichen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Crichen">@Crichen</a>!</li> <li><strong>Mark internal classes as internal</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7511" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7511/hovercard">#7511</a>)</li> <li><strong>Address the design review feedback</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7513" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7513/hovercard">#7513</a>)</li> <li><strong>BpeTokenizer Cleanup</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7514" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7514/hovercard">#7514</a>)</li> <li><strong>Improve native build and mark our official build as CFS Clean</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7516" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7516/hovercard">#7516</a>)</li> <li><strong>Improve unique directory generation for temp files</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7520" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7520/hovercard">#7520</a>)</li> <li><strong>Updating OnnxRuntime</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7469" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7469/hovercard">#7469</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix broken inheritance from DataFrameColumn class</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7324" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7324/hovercard">#7324</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Moved SpecialTokens assignment after the modification to avoid "Collection Modified" error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7328" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7328/hovercard">#7328</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shaltielshmid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shaltielshmid">@shaltielshmid</a>!</li> <li><strong>Fix DateTime export to csv with culture info</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7358" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7358/hovercard">#7358</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Increase cancelling waiting time for AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7424" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7424/hovercard">#7424</a>)</li> <li><strong>Fixed light gbm update</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7431" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7431/hovercard">#7431</a>)</li> <li><strong>Fix incorrect IntPtr null check in FftUtils</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7434" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7434/hovercard">#7434</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/GrabYourPitchforks/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/GrabYourPitchforks">@GrabYourPitchforks</a>!</li> <li><strong>ImageClassificationTrainer PredictedLabelColumnName bug when the name is not default</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7458" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7458/hovercard">#7458</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/feiyun0112/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/feiyun0112">@feiyun0112</a>!</li> <li><strong>Fix ElementwiseGreaterThanOrEqual to use &gt;= instead of ==</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7475" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7475/hovercard">#7475</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vsarakhan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vsarakhan">@vsarakhan</a>!</li> <li><strong>Fix minor typo in BinFinder.cs</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7496" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7496/hovercard">#7496</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KM5075/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KM5075">@KM5075</a>!</li> <li><strong>Fix PositiveRecall optimization in AutoMLExperiment</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7493" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7493/hovercard">#7493</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JoshuaSloan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JoshuaSloan">@JoshuaSloan</a>!</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Add the components governance file <code>cgmanifest.json</code> for tokenizer's vocab files</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7283" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7283/hovercard">#7283</a>)</li> <li><strong>Update To MacOS 13</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7285" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7285/hovercard">#7285</a>)</li> <li><strong>Updated remote executor</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7295" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7295/hovercard">#7295</a>)</li> <li><strong>Fixing native lookup</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7282" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7282/hovercard">#7282</a>)</li> <li><strong>Update dependencies from maintenance-packages to latest versions</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7301" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7301/hovercard">#7301</a>)</li> <li><strong>Maintenance package version updates.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7304" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7304/hovercard">#7304</a>)</li> <li><strong>Fixing tokenizers version</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7309" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7309/hovercard">#7309</a>)</li> <li><strong>Update version for 5.0</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7311" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7311/hovercard">#7311</a>)</li> <li><strong>Update dynamic loading report reference</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7321" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7321/hovercard">#7321</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/emmanuel-ferdman/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/emmanuel-ferdman">@emmanuel-ferdman</a>!</li> <li><strong>Net8 tests</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7319" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7319/hovercard">#7319</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7266" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7266/hovercard">#7266</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7352" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7352/hovercard">#7352</a>)</li> <li><strong>Update MSTest to latest</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7349" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7349/hovercard">#7349</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Youssef1313/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Youssef1313">@Youssef1313</a>!</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7368" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7368/hovercard">#7368</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7374" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7374/hovercard">#7374</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7376" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7376/hovercard">#7376</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7382" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7382/hovercard">#7382</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7387" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7387/hovercard">#7387</a>)</li> <li><strong>Update Helix ubuntu arm32 container</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7410" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7410/hovercard">#7410</a>)</li> <li><strong>Update dependencies from maintenance-packages</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7412" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7412/hovercard">#7412</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7397" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7397/hovercard">#7397</a>)</li> <li><strong>Switch to AwesomeAssertions</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7421" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7421/hovercard">#7421</a>)</li> <li><strong>Update maintenance-dependencies</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7433" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7433/hovercard">#7433</a>)</li> <li><strong>update cmake mac</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7443" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7443/hovercard">#7443</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7423" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7423/hovercard">#7423</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7455" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7455/hovercard">#7455</a>)</li> <li><strong>Dependency version updates</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7457" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7457/hovercard">#7457</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7463" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7463/hovercard">#7463</a>)</li> <li><strong>Create copilot-setup-steps.yml</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7478" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7478/hovercard">#7478</a>)</li> <li><strong>Add copilot-setup-steps.yml</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7481" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7481/hovercard">#7481</a>)</li> <li><strong>Enable dependabot.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7486" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7486/hovercard">#7486</a>)</li> <li><strong>macOS x64 CI: fix dependency install and OpenMP runtime copy (use Homebrew libomp, adjust Helix payload)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7510" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7510/hovercard">#7510</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asp2286/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asp2286">@asp2286</a>!</li> <li><strong>Initialize es-metadata.yml for inventory</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7504" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7504/hovercard">#7504</a>)</li> <li><strong>Update Windows image, fix mac build</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7515" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7515/hovercard">#7515</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7473" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7473/hovercard">#7473</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7519" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7519/hovercard">#7519</a>)</li> <li><strong>Remove baselines</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7526" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7526/hovercard">#7526</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7521" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7521/hovercard">#7521</a>)</li> <li><strong>Use arcade script for installing MacOS dependencies</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7533" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7533/hovercard">#7533</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7532" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7532/hovercard">#7532</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>4.0 release notes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7302" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7302/hovercard">#7302</a>)</li> <li><strong>Fix up docs for MLContext</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7334" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7334/hovercard">#7334</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gewarren/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gewarren">@gewarren</a>!</li> <li><strong>Added in 5.0 preview 1 release notes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7400" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7400/hovercard">#7400</a>)</li> <li><strong>[main] Added 4.0.2 servicing release notes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7401" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7401/hovercard">#7401</a>)</li> <li><strong>Updated preview release notes.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7405" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7405/hovercard">#7405</a>)</li> <li><strong>Update Tokenizer conceptual doc link in package docs</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7445" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7445/hovercard">#7445</a>)</li> <li><strong>Random doc updates</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7476" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7476/hovercard">#7476</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gewarren/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gewarren">@gewarren</a>!</li> <li><strong>Add release notes for 4.0.3</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7530" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7530/hovercard">#7530</a>)</li> <li><strong>Update release-4.0.3.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7535" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7535/hovercard">#7535</a>)</li> <li><strong>Add a doc with information about components and dependencies</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7537" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7537/hovercard">#7537</a>)</li> </ul> ericstj tag:github.com,2008:Repository/132021166/v4.0.3 2025-10-28T21:04:45Z ML.NET 4.0.3 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 4.0.3</h1> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>[release/4.0] Improve unique directory generation for temp files</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7528" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7528/hovercard">#7528</a>) <ul> <li> <p>Compatibility note: This change resolves a performance problem where past versions of ML.NET would leave behind folders with the pattern <code>ml_dotnet\d+</code> in the temp directory, which would cause model opening performance to degrade. This fixes the problem. You may also wish to delete these empty folders once after updating.</p> <p>Using powershell:</p> <div class="highlight highlight-source-powershell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="Get-ChildItem &quot;$env:TEMP&quot; -Directory -Filter &quot;ml_dotnet*&quot; | Remove-Item -Recurse -Force"><pre><span class="pl-c1">Get-ChildItem</span> <span class="pl-s"><span class="pl-pds">"</span><span class="pl-smi">$<span class="pl-c1">env:</span>TEMP</span><span class="pl-pds">"</span></span> <span class="pl-k">-</span>Directory <span class="pl-k">-</span>Filter <span class="pl-s"><span class="pl-pds">"</span>ml_dotnet*<span class="pl-pds">"</span></span> <span class="pl-k">|</span> <span class="pl-c1">Remove-Item</span> <span class="pl-k">-</span>Recurse <span class="pl-k">-</span>Force</pre></div> <p>Using Bash:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="find &quot;$TEMP&quot; -type d -name &quot;ml_dotnet*&quot; -exec rm -rf {} +"><pre>find <span class="pl-s"><span class="pl-pds">"</span><span class="pl-smi">$TEMP</span><span class="pl-pds">"</span></span> -type d -name <span class="pl-s"><span class="pl-pds">"</span>ml_dotnet*<span class="pl-pds">"</span></span> -exec rm -rf {} +</pre></div> </li> </ul> </li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>[release/4.0] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7470" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7470/hovercard">#7470</a>)</li> <li><strong>[release/4.0] Use arcade script for installing MacOS dependencies</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7534" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7534/hovercard">#7534</a>)</li> </ul> ericstj tag:github.com,2008:Repository/132021166/v5.0.0-preview1 2025-02-26T00:52:25Z ML.NET 5.0.0-preview1 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 5.0-preview.1</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>Introducing SentencePiece Unigram Tokenizer Model</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7390" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7390/hovercard">#7390</a>)</li> <li><strong>Phi-4 Tokenizer Support</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7396" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7396/hovercard">#7396</a>)</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Support O3 OpenAI model mapping</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7394" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7394/hovercard">#7394</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix DateTime export to csv with culture info</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7358" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7358/hovercard">#7358</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Moved SpecialTokens assignment after the modification to avoid "Collection Modified" error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7328" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7328/hovercard">#7328</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shaltielshmid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shaltielshmid">@shaltielshmid</a>!</li> <li><strong>Fix broken inheritance from DataFrameColumn class</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7324" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7324/hovercard">#7324</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7387" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7387/hovercard">#7387</a>)</li> <li><strong>Update Microsoft.Extensions.AI to 9.3.0-preview.1.25114.11</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7388" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7388/hovercard">#7388</a>)</li> <li><strong>Update MSTest to latest</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7349" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7349/hovercard">#7349</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7352" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7352/hovercard">#7352</a>)</li> <li><strong>Consolidate System.Numerics.Tensors dependency</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7356" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7356/hovercard">#7356</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7382" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7382/hovercard">#7382</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7376" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7376/hovercard">#7376</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7374" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7374/hovercard">#7374</a>)</li> <li><strong>Net8 tests</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7319" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7319/hovercard">#7319</a>)</li> <li><strong>[main] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7266" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7266/hovercard">#7266</a>)</li> <li><strong>Update DependencyModel</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7338" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7338/hovercard">#7338</a>)</li> <li><strong>Update M.E.AI version used by Microsoft.ML.GenAI.Core</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7329" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7329/hovercard">#7329</a>)</li> <li><strong>Update System.Numerics.Tensors version</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7322" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7322/hovercard">#7322</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>Fix up docs for MLContext</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7334" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7334/hovercard">#7334</a>)</li> <li><strong>Some tweaks to the Microsoft.ML.Tokenizers PACKAGE.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7360" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7360/hovercard">#7360</a>)</li> <li><strong>[GenAI] SFT Example</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7316" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7316/hovercard">#7316</a>)</li> <li><strong>Update dynamic loading report reference</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7321" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7321/hovercard">#7321</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/emmanuel-ferdman/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/emmanuel-ferdman">@emmanuel-ferdman</a>!</li> </ul> michaelgsharp tag:github.com,2008:Repository/132021166/v4.0.2 2025-02-26T00:51:04Z ML.NET 4.0.2 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 4.0.2</h1> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>[release/4.0] Support O3 OpenAI model mapping <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2867661329" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7395" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7395/hovercard" href="https://github.com/dotnet/machinelearning/pull/7395">#7395</a></strong> (<a href="https://github.com/dotnet/machinelearning/pull/7395" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7395/hovercard">#7395</a>)</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>[release/4.0] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7369" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7369/hovercard">#7369</a>)</li> <li><strong>[release/4.0] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7377" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7377/hovercard">#7377</a>)</li> <li><strong>[release/4.0] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7386" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7386/hovercard">#7386</a>)</li> </ul> michaelgsharp tag:github.com,2008:Repository/132021166/v4.0.1 2025-01-14T23:35:02Z ML.NET 4.0.1 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> Servicing Release 4.0.1</h1> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix the BERT tokenizer to handle special tokens correctly.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7330" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7330/hovercard">#7330</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shaltielshmid/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shaltielshmid">@shaltielshmid</a></li> <li><strong>Fix broken inheritance from DataFrameColumn class (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2677293452" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7324" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7324/hovercard" href="https://github.com/dotnet/machinelearning/pull/7324">#7324</a>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7331" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7331/hovercard">#7331</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Update System.Numerics.Tensors version (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2675815381" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7322" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7322/hovercard" href="https://github.com/dotnet/machinelearning/pull/7322">#7322</a>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7355" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7355/hovercard">#7355</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>[release/4.0] Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7327" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7327/hovercard">#7327</a>)</li> <li><strong>Update MicrosoftExtensionsDependencyModelVersion</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7342" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7342/hovercard">#7342</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>[release/4.0] Some tweaks to the Microsoft.ML.Tokenizers PACKAGE.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7364" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7364/hovercard">#7364</a>)</li> <li><strong>[release/4.0] Fix up docs for MLContext</strong> (<a href="https://github.com/dotnet/machinelearning/pull/7363" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7363/hovercard">#7363</a>)</li> </ul> michaelgsharp tag:github.com,2008:Repository/132021166/v4.0.0-preview1 2024-03-13T06:06:52Z v4.0.0-preview1 <h2>What's Changed</h2> <ul> <li>Migrate to the 'locker' GitHub action for locking closed/stale issues/PRs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jeffhandley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jeffhandley">@jeffhandley</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2017658732" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6896" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6896/hovercard" href="https://github.com/dotnet/machinelearning/pull/6896">#6896</a></li> <li>Update release-3.0.0.md by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taeerhebend/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taeerhebend">@taeerhebend</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2017016289" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6895" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6895/hovercard" href="https://github.com/dotnet/machinelearning/pull/6895">#6895</a></li> <li>Add support for Apache.Arrow.Types.TimestampType to DataFrame by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1955973599" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6871" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6871/hovercard" href="https://github.com/dotnet/machinelearning/pull/6871">#6871</a></li> <li>Update developer-guide.md by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/computerscienceiscool/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/computerscienceiscool">@computerscienceiscool</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1953689312" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6870" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6870/hovercard" href="https://github.com/dotnet/machinelearning/pull/6870">#6870</a></li> <li>Issue <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1636631483" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6606" data-hovercard-type="issue" data-hovercard-url="/dotnet/machinelearning/issues/6606/hovercard" href="https://github.com/dotnet/machinelearning/issues/6606">#6606</a> - Add sample variance and standard deviation to NormalizeMeanVariance by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tearlant/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tearlant">@tearlant</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1991865031" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6885" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6885/hovercard" href="https://github.com/dotnet/machinelearning/pull/6885">#6885</a></li> <li>Reorganize dataframe files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1956931949" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6872" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6872/hovercard" href="https://github.com/dotnet/machinelearning/pull/6872">#6872</a></li> <li>Updated ml.net versioning by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2038210076" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6907" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6907/hovercard" href="https://github.com/dotnet/machinelearning/pull/6907">#6907</a></li> <li>Don't include the SDK in our helix payload by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2051215010" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6918" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6918/hovercard" href="https://github.com/dotnet/machinelearning/pull/6918">#6918</a></li> <li>Rename NameEntity to NamedEntity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2051138890" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6917" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6917/hovercard" href="https://github.com/dotnet/machinelearning/pull/6917">#6917</a></li> <li>Fix assert by only accessing idx by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2053169608" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6924" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6924/hovercard" href="https://github.com/dotnet/machinelearning/pull/6924">#6924</a></li> <li>Make double assertions compare with tolerance instead of precision by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2053166433" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6923" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6923/hovercard" href="https://github.com/dotnet/machinelearning/pull/6923">#6923</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1719604083" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6703" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6703/hovercard" href="https://github.com/dotnet/machinelearning/pull/6703">#6703</a></li> <li>Only use semi-colons for NoWarn - fixes build break by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2063112706" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6935" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6935/hovercard" href="https://github.com/dotnet/machinelearning/pull/6935">#6935</a></li> <li>Fixes NER to correctly expand/shrink the labels by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2054999934" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6928" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6928/hovercard" href="https://github.com/dotnet/machinelearning/pull/6928">#6928</a></li> <li>Split out non concurrent test collections. by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2064519085" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6937" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6937/hovercard" href="https://github.com/dotnet/machinelearning/pull/6937">#6937</a></li> <li>Add Backport github workflow by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2071232372" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6944" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6944/hovercard" href="https://github.com/dotnet/machinelearning/pull/6944">#6944</a></li> <li>fix <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2072809789" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6949" data-hovercard-type="issue" data-hovercard-url="/dotnet/machinelearning/issues/6949/hovercard" href="https://github.com/dotnet/machinelearning/issues/6949">#6949</a> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LittleLittleCloud/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LittleLittleCloud">@LittleLittleCloud</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2073393450" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6951" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6951/hovercard" href="https://github.com/dotnet/machinelearning/pull/6951">#6951</a></li> <li>Torch sharp version updates and test fixes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2080059395" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6954" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6954/hovercard" href="https://github.com/dotnet/machinelearning/pull/6954">#6954</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2082058236" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6957" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6957/hovercard" href="https://github.com/dotnet/machinelearning/pull/6957">#6957</a></li> <li>Added in release notes for 3.0.1 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2088761085" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6962" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6962/hovercard" href="https://github.com/dotnet/machinelearning/pull/6962">#6962</a></li> <li>Update .NET Runtimes to latest version by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2089338079" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6964" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6964/hovercard" href="https://github.com/dotnet/machinelearning/pull/6964">#6964</a></li> <li>Add sweepable estimator to NER by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zewditu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zewditu">@zewditu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2089855947" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6965" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6965/hovercard" href="https://github.com/dotnet/machinelearning/pull/6965">#6965</a></li> <li>Testing light gbm bad allocation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2091233934" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6968" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6968/hovercard" href="https://github.com/dotnet/machinelearning/pull/6968">#6968</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2093939435" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6969" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6969/hovercard" href="https://github.com/dotnet/machinelearning/pull/6969">#6969</a></li> <li>Add new type to key-value converter by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zewditu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zewditu">@zewditu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2098961578" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6973" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6973/hovercard" href="https://github.com/dotnet/machinelearning/pull/6973">#6973</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2105523811" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6976" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6976/hovercard" href="https://github.com/dotnet/machinelearning/pull/6976">#6976</a></li> <li>Introducing Tiktoken Tokenizer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tarekgh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tarekgh">@tarekgh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2113590117" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6981" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6981/hovercard" href="https://github.com/dotnet/machinelearning/pull/6981">#6981</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2118583737" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6985" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6985/hovercard" href="https://github.com/dotnet/machinelearning/pull/6985">#6985</a></li> <li>FabricBot: Onboarding to GitOps.ResourceManagement because of FabricBot decommissioning by @dotnet-policy-service in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2115620232" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6983" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6983/hovercard" href="https://github.com/dotnet/machinelearning/pull/6983">#6983</a></li> <li>Add text normalizer transformer to AutoML by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zewditu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zewditu">@zewditu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2131367865" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6998" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6998/hovercard" href="https://github.com/dotnet/machinelearning/pull/6998">#6998</a></li> <li>Tokenizer's Interfaces Cleanup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tarekgh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tarekgh">@tarekgh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2135458580" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7001" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7001/hovercard" href="https://github.com/dotnet/machinelearning/pull/7001">#7001</a></li> <li>First round of perf improvements for tiktoken by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stephentoub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stephentoub">@stephentoub</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2139776942" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7012" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7012/hovercard" href="https://github.com/dotnet/machinelearning/pull/7012">#7012</a></li> <li>Avoid LruCache in Tiktoken when cacheSize specified is 0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stephentoub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stephentoub">@stephentoub</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2143402003" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7016" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7016/hovercard" href="https://github.com/dotnet/machinelearning/pull/7016">#7016</a></li> <li>Tweak Tiktoken's BytePairEncode for improved perf by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stephentoub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stephentoub">@stephentoub</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2143488085" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7017" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7017/hovercard" href="https://github.com/dotnet/machinelearning/pull/7017">#7017</a></li> <li>Tweak CreateByModelNameAsync by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stephentoub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stephentoub">@stephentoub</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2143381151" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7015" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7015/hovercard" href="https://github.com/dotnet/machinelearning/pull/7015">#7015</a></li> <li>Match SweepableEstimatorFactory name with Ml.net name. by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zewditu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zewditu">@zewditu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2139503732" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7007" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7007/hovercard" href="https://github.com/dotnet/machinelearning/pull/7007">#7007</a></li> <li>Update OnnxRuntime to 1.16.3 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2101319468" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6975" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6975/hovercard" href="https://github.com/dotnet/machinelearning/pull/6975">#6975</a></li> <li>Temp fix for the race condition during the tests. by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2146099505" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7021" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7021/hovercard" href="https://github.com/dotnet/machinelearning/pull/7021">#7021</a></li> <li>Fix formatting that fails in VS by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2147660741" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7023" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7023/hovercard" href="https://github.com/dotnet/machinelearning/pull/7023">#7023</a></li> <li>Optimize regexes used in tiktoken by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stephentoub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stephentoub">@stephentoub</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2145442937" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7020" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7020/hovercard" href="https://github.com/dotnet/machinelearning/pull/7020">#7020</a></li> <li>Address the feedback on the tokenizer's library by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tarekgh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tarekgh">@tarekgh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2150148900" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7024" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7024/hovercard" href="https://github.com/dotnet/machinelearning/pull/7024">#7024</a></li> <li>Make MlImage tests not block file for reading by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2155085067" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7029" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7029/hovercard" href="https://github.com/dotnet/machinelearning/pull/7029">#7029</a></li> <li>Packaging cleanup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2066521025" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6939" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6939/hovercard" href="https://github.com/dotnet/machinelearning/pull/6939">#6939</a></li> <li>Remove SourceLink SDK references by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2159384547" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7037" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7037/hovercard" href="https://github.com/dotnet/machinelearning/pull/7037">#7037</a></li> <li>Add Span support in tokenizer's Model abstraction by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tarekgh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tarekgh">@tarekgh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2157950944" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7035" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7035/hovercard" href="https://github.com/dotnet/machinelearning/pull/7035">#7035</a></li> <li>[main] Update dependencies from dotnet/arcade by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dotnet-maestro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dotnet-maestro">@dotnet-maestro</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2130143115" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6995" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6995/hovercard" href="https://github.com/dotnet/machinelearning/pull/6995">#6995</a></li> <li>Change official build to use 1ES templates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/directhex/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/directhex">@directhex</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2169863400" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7048" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7048/hovercard" href="https://github.com/dotnet/machinelearning/pull/7048">#7048</a></li> <li>Adding needed Tokenizer's APIs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tarekgh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tarekgh">@tarekgh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2167945874" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7047" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7047/hovercard" href="https://github.com/dotnet/machinelearning/pull/7047">#7047</a></li> <li>Auto-generated baselines by 1ES Pipeline Templates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/directhex/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/directhex">@directhex</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2174868705" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7051" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7051/hovercard" href="https://github.com/dotnet/machinelearning/pull/7051">#7051</a></li> <li>testing arm python brew overwite by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/michaelgsharp/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/michaelgsharp">@michaelgsharp</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2180434599" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7058" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7058/hovercard" href="https://github.com/dotnet/machinelearning/pull/7058">#7058</a></li> <li>Update package versions in use by ML.NET tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ericstj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ericstj">@ericstj</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2180042634" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7055" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7055/hovercard" href="https://github.com/dotnet/machinelearning/pull/7055">#7055</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taeerhebend/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taeerhebend">@taeerhebend</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2017016289" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6895" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6895/hovercard" href="https://github.com/dotnet/machinelearning/pull/6895">#6895</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/computerscienceiscool/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/computerscienceiscool">@computerscienceiscool</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1953689312" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6870" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6870/hovercard" href="https://github.com/dotnet/machinelearning/pull/6870">#6870</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tearlant/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tearlant">@tearlant</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1991865031" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6885" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6885/hovercard" href="https://github.com/dotnet/machinelearning/pull/6885">#6885</a></li> <li>@dotnet-policy-service made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2115620232" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6983" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6983/hovercard" href="https://github.com/dotnet/machinelearning/pull/6983">#6983</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/directhex/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/directhex">@directhex</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="2169863400" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/7048" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/7048/hovercard" href="https://github.com/dotnet/machinelearning/pull/7048">#7048</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/dotnet/machinelearning/compare/v3.0.1...v4.0.0-preview1"><tt>v3.0.1...v4.0.0-preview1</tt></a></p> ericstj tag:github.com,2008:Repository/132021166/v3.0.1 2024-03-13T02:52:02Z ML.NET 3.0.1 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 3.0.1</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>Add support for Apache.Arrow.Types.TimestampType to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6871" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6871/hovercard">#6871</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Update TorchSharp to latest version</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6954" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6954/hovercard">#6954</a>)</li> <li><strong>Reorganize dataframe files</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6872" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6872/hovercard">#6872</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Add sample variance and standard deviation to NormalizeMeanVariance</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6885" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6885/hovercard">#6885</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tearlant/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tearlant">@tearlant</a>!</li> <li><strong>Fixes NER to correctly expand/shrink the labels</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6928" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6928/hovercard">#6928</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix SearchSpace reference not being included</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6951" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6951/hovercard">#6951</a>)</li> <li><strong>Rename NameEntity to NamedEntity</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6917" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6917/hovercard">#6917</a>)</li> <li><strong>Fix assert by only accessing idx</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6924" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6924/hovercard">#6924</a>)</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Add Backport github workflow</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6944" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6944/hovercard">#6944</a>)</li> <li><strong>Branding for 3.0.1</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6943" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6943/hovercard">#6943</a>)</li> <li><strong>Only use semi-colons for NoWarn - fixes build break</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6935" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6935/hovercard">#6935</a>)</li> <li><strong>Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6703" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6703/hovercard">#6703</a>)</li> <li><strong>Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6957" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6957/hovercard">#6957</a>)</li> <li><strong>Migrate to the 'locker' GitHub action for locking closed/stale issues/PRs</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6896" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6896/hovercard">#6896</a>)</li> <li><strong>Make double assertions compare with tolerance instead of precision</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6923" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6923/hovercard">#6923</a>)</li> <li><strong>Don't include the SDK in our helix payload</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6918" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6918/hovercard">#6918</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>Updated ml.net versioning</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6907" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6907/hovercard">#6907</a>)</li> <li><strong>Update developer-guide.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6870" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6870/hovercard">#6870</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/computerscienceiscool/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/computerscienceiscool">@computerscienceiscool</a>!</li> <li><strong>Update release-3.0.0.md</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6895" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6895/hovercard">#6895</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taeerhebend/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taeerhebend">@taeerhebend</a>!</li> </ul> <h2><strong>Breaking changes</strong></h2> <ul> <li><strong>Rename NameEntity to NamedEntity</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6917" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6917/hovercard">#6917</a>)</li> </ul> ericstj tag:github.com,2008:Repository/132021166/v3.0.0 2023-11-22T19:45:29Z ML.NET 3.0.0 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 3.0.0</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>Add the ability to use Object Detection using TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6605" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6605/hovercard">#6605</a>) - We have added a new deep learning model back by TorchSharp that lets you fine tune your own Object Detection model!</li> <li><strong>Add SamplingKeyColumnName to AutoMLExperiment API</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6649" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6649/hovercard">#6649</a>) - You can now set the SamplingKeyColumnName when you are using AutoML. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/torronen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/torronen">@torronen</a>!</li> <li><strong>Add Object Detection to AutoML Sweeper</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6633" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6633/hovercard">#6633</a>) - Added Object Detection to the AutoML Sweeper so now they can be used together.</li> <li><strong>Add String Vector support to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6628" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6628/hovercard">#6628</a>) - Adds support for String Vectors in DataFrame. This also allows for Better IDataView &lt;-&gt; DataFrame conversions.</li> <li><strong>Add AutoZero tuner to BinaryClassification</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6615" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6615/hovercard">#6615</a>) - Can now use AutoZero tuner in AutoML Binary Classification experiments.</li> <li><strong>Added in fairness assessment and mitigation</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6539" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6539/hovercard">#6539</a>) - Support for fairness assessment and mitigation tool</li> <li><strong>Added in Support for some Intel OneDal Algorithms</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6521" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6521/hovercard">#6521</a>) - You can now use Intel's OneDal for some algorithms. This gives you access to some accelerated versions of these algorithms. The models are fully interoperable between ML.NET's normal models and these, so you can train with OneDal and then still run on machines where OneDal is not supported. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rgesteve/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rgesteve">@rgesteve</a>!</li> <li><strong>Add in ability to have pre-defined weights for ngrams</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6458" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6458/hovercard">#6458</a>) - If you know the weights of your NGrams already you can now directly provide that.</li> <li><strong>Add SentenceSimilarity sweepable estimator in AutoML</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6445" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6445/hovercard">#6445</a>) - Can now use SentenceSimilarity with the sweepable estimator.</li> <li><strong>Add VBufferDataFrameCoumn to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6409" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6409/hovercard">#6409</a>) - Now DataFrame can support the VBuffer from ML.NET so the IDataView &lt;-&gt; DataFrame conversion can work with those types.</li> <li><strong>Added ADO.NET importing/exporting functionality to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/5975" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/5975/hovercard">#5975</a>) - Can now use ADO.NET import/export with DataFrames. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andrei-faber/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andrei-faber">@andrei-faber</a>!</li> <li><strong>Added native binaries for Windows Arm64</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6813" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6813/hovercard">#6813</a>) - This allows certain native transforms to be run on Widows Arm that were disabled before.</li> <li><strong>Switches some computational code to use the new Tensor Primitives package</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6875" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6875/hovercard">#6875</a>)</li> <li><strong>Add QA sweepable estimator in AutoML</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6781" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6781/hovercard">#6781</a>)</li> <li><strong>Add NameEntityRecognition and Q&amp;A deep learning tasks.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6760" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6760/hovercard">#6760</a>)</li> <li><strong>Adds the ability to load a pre-trained LightGBM file and import it into ML.Net.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6569" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6569/hovercard">#6569</a>)</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Expose ExperimentSettings.MaxModel as public</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6663" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6663/hovercard">#6663</a>) - Exposes ExperimentSettings.MaxModel as public so now you can set the number of Max Models you want for an AutoML experiment.</li> <li><strong>Update to latest version of TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6636" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6636/hovercard">#6636</a>) - Updated to the latest version of TorchSharp and fixed any breaking changes so we can take advantage of their new features and bug fixes.</li> <li><strong>Update to latest version of Onnx Runtime</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6624" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6624/hovercard">#6624</a>) - Updated to the latest version of Onnx Runtime and fixed any breaking changes so we can take advantage of their new features and bug fixes.</li> <li><strong>Update ML.NET to compile with .NET8</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6641" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6641/hovercard">#6641</a>) - Removed some deprecated code now throws errors on .NET8 as well as other minor fixes to allow working/building with .NET8.</li> <li><strong>Added more logging to Object Detection</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6646" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6646/hovercard">#6646</a>) - Added more logging while Object Detection is training so even if epochs take a long time you can be sure things are still moving.</li> <li><strong>Update timeout error message in AutoMLExperiment</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6613" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6613/hovercard">#6613</a>) - Updated the error message so it is more clear what happened.</li> <li><strong>Add batchsize and arch to imageClassification SweepableTrainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6597" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6597/hovercard">#6597</a>) - Added batchsize and arch to the ImageClassification SweepableTrainer so those can now be trained on.</li> <li><strong>Update max_model when trial fails</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6596" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6596/hovercard">#6596</a>)</li> <li><strong>Add default search space for standard trainers</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6576" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6576/hovercard">#6576</a>) - Added a default search space for all standard trainers so users have reasonable default values.</li> <li><strong>Adding more metrics to BinaryClassification Experiment</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6571" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6571/hovercard">#6571</a>)</li> <li><strong>Add checkAlive in NasBertTrainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6546" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6546/hovercard">#6546</a>) - Now we check between batches if cancellation was requested and stop processing if so.</li> <li><strong>OneDAL - Fallback to default implementation</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6538" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6538/hovercard">#6538</a>) - If you specify you want to use OneDal but something happens that prevents you from using it, like it can't find the binaries/etc, it will auto default back to the normal implementation instead of crashing.</li> <li><strong>Add addKeyValueAnnotationsAsText flag in AutoML</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6535" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6535/hovercard">#6535</a>)</li> <li><strong>Add continuous resource monitoring to AutoML.IMonitor</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6520" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6520/hovercard">#6520</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andrasfuchs/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andrasfuchs">@andrasfuchs</a>!</li> <li><strong>Update WebClient to HttpClient implementations</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6476" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6476/hovercard">#6476</a>) - Update the usage of WebClient to HttpClient since WebClient is now deprecated. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rgesteve/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rgesteve">@rgesteve</a>!</li> <li><strong>Set AutoML trial to unsuccess if trial loss is nan/inf</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6430" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6430/hovercard">#6430</a>) - Now trial will be marked as unsuccesssful if the loss is an invalid number.</li> <li><strong>Add diskConvert option in fast tree search space</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6316" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6316/hovercard">#6316</a>)</li> <li><strong>Avoid Boxing/Unboxing on accessing elements of VBufferDataFrameColumn</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6867" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6867/hovercard">#6867</a>) and (<a href="https://github.com/dotnet/machinelearning/pull/6865" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6865/hovercard">#6865</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Update LightGBM to version 3.X.X from 2.X.X</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6880" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6880/hovercard">#6880</a>)</li> <li><strong>Implement vectorized binary arithmetic operations for DataFrames</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6854" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6854/hovercard">#6854</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Upgrade .NET Interactive</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6857" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6857/hovercard">#6857</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/colombod/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/colombod">@colombod</a>!</li> <li><strong>Improve performance of column cloning inside DataFrame arithmetics</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6814" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6814/hovercard">#6814</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Add performance benchmarks for dataframe arithmetic operations</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6827" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6827/hovercard">#6827</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Simplify tt files for PrimitiveDataFrameColumnAritmetics</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6830" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6830/hovercard">#6830</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Improve performance of DataFrame binary comparison operations</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6869" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6869/hovercard">#6869</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Allow a CultureInfo to be used for parsing CSV values into DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6782" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6782/hovercard">#6782</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>File-scoped namespaces in files under <code>Prediction</code> (<code>Microsoft.ML.Core</code>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6792" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6792/hovercard">#6792</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>File-scoped namespaces in files under <code>ComponentModel</code> (<code>Microsoft.ML.Core</code>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6788" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6788/hovercard">#6788</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>File-scoped namespaces in files under <code>Data</code> (<code>Microsoft.ML.Core</code>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6789" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6789/hovercard">#6789</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>File-scoped namespaces in files under <code>EntryPoints</code> (<code>Microsoft.ML.Core</code>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6790" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6790/hovercard">#6790</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>File-scoped namespaces in files under <code>Environment</code> (<code>Microsoft.ML.Core</code>)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6791" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6791/hovercard">#6791</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>Add TargetType to Type_convert</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6785" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6785/hovercard">#6785</a>)</li> <li><strong>Modernized some argument checks that still used string literals for parameter names</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6766" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6766/hovercard">#6766</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lehonti/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lehonti">@Lehonti</a>!</li> <li><strong>Improve DataFrame Arithmetics implementation</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6763" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6763/hovercard">#6763</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fixed mac build and minor torch sharp changes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6776" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6776/hovercard">#6776</a>)</li> <li><strong>Clean DataFrame meaningless code</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6761" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6761/hovercard">#6761</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Provide ability to filter dataframe column by null via ElementWise Methods</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6723" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6723/hovercard">#6723</a>)</li> <li><strong>Add missing implementation for datetime relevant arrow type into dataframe</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6675" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6675/hovercard">#6675</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix DataFrame to allow to store columns with size more than 2 Gb</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6710" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6710/hovercard">#6710</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Remove redundant column names collection from DataFrameColumnCollection</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6701" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6701/hovercard">#6701</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Clean dataframe math</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6709" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6709/hovercard">#6709</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Continue training on OOM error &amp;&amp; add subsampling support for trainValidationDatasetManager</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6714" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6714/hovercard">#6714</a>)</li> <li><strong>Add epsilon to eci inverse probability</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6668" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6668/hovercard">#6668</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix DataFrame ToString</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6673" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6673/hovercard">#6673</a>) - Use correct alignment for columns to produce readable output when columns have longer names. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix DataFrame null math</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6661" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6661/hovercard">#6661</a>) - Fixes max in DataFrame columns when there are null values to match what Pandas does.</li> <li><strong>Clean up PrimitiveColumnContainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6656" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6656/hovercard">#6656</a>) - Cleaned up the code in PrimitiveColumnContainer so its more correct and easier to use.</li> <li><strong>Fix Apply in PrimitiveColumnContainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6642" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6642/hovercard">#6642</a>) - Fixes the Apply method so it no longer changes the source column. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/janholo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/janholo">@janholo</a>!</li> <li><strong>Fix datetime null error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6627" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6627/hovercard">#6627</a>) - Fixes loading a null datetime from a database so it now returns correctly instead of throwing an error.</li> <li><strong>Fix AggregateTrainingStopManager is trying to cancel disposed tokens</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6612" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6612/hovercard">#6612</a>) - Will no longer try and cancel already disposed tokens.</li> <li><strong>Fix ToString bug for sweepable pipeline</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6610" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6610/hovercard">#6610</a>)</li> <li><strong>Change Test to Validate in Dataset manager</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6599" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6599/hovercard">#6599</a>)</li> <li><strong>Fixed System.OperationCanceledException when calling experimentResult.BestRun.Estimator.Fit</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6572" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6572/hovercard">#6572</a>)</li> <li><strong>Fixed cancellation bug in SweepablePipelineRunner &amp;&amp; Fixed object null exception in AutoML v1.0 regression API</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6560" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6560/hovercard">#6560</a>)</li> <li><strong>Fixed OneDal dispatching issues</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6547" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6547/hovercard">#6547</a>) - OneDal now dispatches correctly.</li> <li><strong>Fixed Multi-threaded access issue</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6537" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6537/hovercard">#6537</a>) - Fixed a multi-threaded access issue for variable length string arrays in ONNX models.</li> <li><strong>Fixed AutoML experiments in non declarative style not working</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6447" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6447/hovercard">#6447</a>)</li> <li><strong>Fix DataFrame Saving csv with VBufferDataFrameColumn</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6860" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6860/hovercard">#6860</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fixes incorrect work of DataFrame with VBufferColumn</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6851" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6851/hovercard">#6851</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Increase performance of DataFrame arithmetic operations by enhancing calculations on nullable values</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6846" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6846/hovercard">#6846</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>DataFrame incorrectly sets column value for index higher than Buffer.MaxCapacity</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6849" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6849/hovercard">#6849</a>) - Thanks 2asmirnov82!</li> <li><strong>PrimitiveDataFrameColumn.Clone method crashes when is used with IEnumerable mapIndices argument</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6822" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6822/hovercard">#6822</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Addresses <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1519561735" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/6533" data-hovercard-type="issue" data-hovercard-url="/dotnet/machinelearning/issues/6533/hovercard" href="https://github.com/dotnet/machinelearning/issues/6533">#6533</a>, OneDal Index was outside the bounds of the array.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6838" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6838/hovercard">#6838</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rgesteve/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rgesteve">@rgesteve</a>!</li> <li><strong>Fix wrong type conversion on PrimitiveDataFrameColumn</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6834" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6834/hovercard">#6834</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/novelhawk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/novelhawk">@novelhawk</a>!</li> <li><strong>Append dataframe rows based on column names</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6808" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6808/hovercard">#6808</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix inconsistent null handling in DataFrame Arithmetics</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6770" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6770/hovercard">#6770</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix DataFrame.LoadCsv can not load CSV with duplicate column names</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6772" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6772/hovercard">#6772</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix issue with addIndexColumn in DataFrame.LoadCsv</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6769" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6769/hovercard">#6769</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix text classification InvocationException during cross-validation, issue <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="414345802" data-permission-text="Title is private" data-url="https://github.com/dotnet/machinelearning/issues/2718" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/2718/hovercard" href="https://github.com/dotnet/machinelearning/pull/2718">#2718</a> from model builder</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6768" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6768/hovercard">#6768</a>)</li> <li><strong>Fix incorrect DataFrame min max computation with NULL</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6734" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6734/hovercard">#6734</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix ML.Fairlean using ToList on Row Collection with Count more than Max.Int</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6678" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6678/hovercard">#6678</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix the behavior of column SetName method</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6676" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6676/hovercard">#6676</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix dataframe arithmetics for columns having several value buffers (column size is more than 2 Gb)</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6724" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6724/hovercard">#6724</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>AutoML.Net avoid empty dataset in trainValidationDatasetManager</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6756" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6756/hovercard">#6756</a>)</li> <li><strong>Fix DataFrame bounds checking on indexing elements</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6681" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6681/hovercard">#6681</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Reset DataFrame.RowCount to zero, when DataFrame is empty</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6698" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6698/hovercard">#6698</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Stop shuffle rows in ITrainValidationDatasetManager</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6742" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6742/hovercard">#6742</a>)</li> <li><strong>SMAC - ignore fail trial during initialize</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6738" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6738/hovercard">#6738</a>)</li> <li><strong>Fix non-thread-safe use of Random in tokenizers</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6695" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6695/hovercard">#6695</a>)</li> <li><strong>Fixing license</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6689" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6689/hovercard">#6689</a>) and (<a href="https://github.com/dotnet/machinelearning/pull/6690" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6690/hovercard">#6690</a>)</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Remove MSIL Check for TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6658" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6658/hovercard">#6658</a>) - Removes the MSIL check for TorchSharp while we figure out how we want to correctly handle this.</li> <li><strong>Change code coverage build pool</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6647" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6647/hovercard">#6647</a>) - Changed codecoverage build pool so the builds are faster and more stable.</li> <li><strong>Update AutoMLExperimentTests.cs to fix timeout error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6638" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6638/hovercard">#6638</a>)</li> <li><strong>update interactive kernel version</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6836" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6836/hovercard">#6836</a>)</li> <li><strong>Update dependencies</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6837" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6837/hovercard">#6837</a>)</li> <li><strong>Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6566" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6566/hovercard">#6566 &amp; #6518 &amp; #6451 &amp; #6439</a>)</li> <li><strong>Mac python fix</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6549" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6549/hovercard">#6549</a>)</li> <li><strong>Moving onedal nuget download from onedal to native where its needed for building</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6527" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6527/hovercard">#6527</a>)</li> <li><strong>New os image for official builds</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6467" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6467/hovercard">#6467</a>)</li> <li><strong>Removed deprecated yosemite brew</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6805" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6805/hovercard">#6805</a>)</li> <li><strong>Run tests that requires more than 2 Gb of memory only on 64-bit env</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6758" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6758/hovercard">#6758</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Reduce coupling of Data.Analysis.Tests project</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6759" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6759/hovercard">#6759</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Update build templates to handle feature branches</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6744" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6744/hovercard">#6744</a>)</li> <li><strong>Fix OSX official build.</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6739" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6739/hovercard">#6739</a>)</li> <li><strong>Helix Fixes</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6721" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6721/hovercard">#6721</a>)</li> <li><strong>Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6691" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6691/hovercard">#6691</a>)</li> <li><strong>Disable flaky test</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6685" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6685/hovercard">#6685</a>)</li> <li><strong>License expression</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6674" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6674/hovercard">#6674</a>)</li> <li><em><em>Use -Svc pool providers in release/</em> branches for billing purposes</em>* (<a href="https://github.com/dotnet/machinelearning/pull/6434" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6434/hovercard">#6434</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>Add doc for CreateSweepableEstimator, Parameter and SearchSpace</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6611" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6611/hovercard">#6611</a>)</li> <li><strong>Add AutoMLExperiment example doc</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6594" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6594/hovercard">#6594</a>)</li> <li><strong>Fix minor doc typos</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6557" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6557/hovercard">#6557</a>)</li> <li><strong>Fix minor roadmap nits</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6480" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6480/hovercard">#6480</a>)</li> <li><strong>2023 roadmap outline</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6444" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6444/hovercard">#6444</a>)</li> <li><strong>Fixed typo for calibrators</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6438" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6438/hovercard">#6438</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KKghub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KKghub">@KKghub</a>!</li> <li><strong>Fix docs for DataViewRowCursor</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6855" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6855/hovercard">#6855</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Akash190104/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Akash190104">@Akash190104</a></li> </ul> <h2><strong>Breaking changes</strong></h2> <ul> <li>None</li> </ul> michaelgsharp tag:github.com,2008:Repository/132021166/v3.0.0-Preview 2023-05-16T16:55:49Z ML.NET 3.0.0 Preview 2 <h1><a href="http://dot.net/ml" rel="nofollow">ML.NET</a> 3.0.0 Preview</h1> <h2><strong>New Features</strong></h2> <ul> <li><strong>Add the ability to use Object Detection using TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6605" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6605/hovercard">#6605</a>) - We have added a new deep learning model back by TorchSharp that lets you fine tune your own Object Detection model!</li> <li><strong>Add SamplingKeyColumnName to AutoMLExperiment API</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6649" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6649/hovercard">#6649</a>) - You can now set the SamplingKeyColumnName when you are using AutoML. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/torronen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/torronen">@torronen</a>!</li> <li><strong>Add Object Detection to AutoML Sweeper</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6633" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6633/hovercard">#6633</a>) - Added Object Detection to the AutoML Sweeper so now they can be used together.</li> <li><strong>Add String Vector support to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6628" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6628/hovercard">#6628</a>) - Adds support for String Vectors in DataFrame. This also allows for Better IDataView &lt;-&gt; DataFrame conversions.</li> <li><strong>Add AutoZero tuner to BinaryClassification</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6615" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6615/hovercard">#6615</a>) - Can now user AutoZero tuner in AutoML Binary Classification experiments.</li> <li><strong>Added in fairness assessment and mitigation</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6539" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6539/hovercard">#6539</a>) - Support for fairness assessment and mitigation tool</li> <li><strong>Added in Support for some Intel OneDal Algorithms</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6521" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6521/hovercard">#6521</a>) - You can now use Intel's OneDal for some algorithms. This gives you access to some accelerated versions of these algorithms. The models are fully interoperable between ML.NET's normal models and these, so you can train with OneDal and then still run on machines where OneDal is not supported. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rgesteve/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rgesteve">@rgesteve</a>!</li> <li><strong>Add in ability to have pre-defined weights for ngrams</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6458" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6458/hovercard">#6458</a>) - If you know the weights of your NGrams already you can now directly provide that.</li> <li><strong>Add SentenceSimilarity sweepable estimator in AutoML</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6445" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6445/hovercard">#6445</a>) - Can now use SentenceSimilarity with the sweepable estimator.</li> <li><strong>Add VBufferDataFrameCoumn to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6445" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6445/hovercard">#6445</a>) - Now DataFrame can support the VBuffer from ML.NET so the IDataView &lt;-&gt; DataFrame conversion can work with those types.</li> <li><strong>Added ADO.NET importing/exporting functionality to DataFrame</strong> (<a href="https://github.com/dotnet/machinelearning/pull/5975" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/5975/hovercard">#5975</a>) - Can now use ADO.NET import/export with DataFrames. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andrei-faber/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andrei-faber">@andrei-faber</a>!</li> </ul> <h2><strong>Enhancements</strong></h2> <ul> <li><strong>Expose ExperimentSettings.MaxModel as public</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6663" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6663/hovercard">#6663</a>) - Exposes ExperimentSettings.MaxModel as public so now you can set the number of Max Models you want for an AutoML experiment.</li> <li><strong>Update to latest version of TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6636" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6636/hovercard">#6636</a>) - Updated to the latest version of TorchSharp and fixed any breaking changes so we can take advantage of their new features and bug fixes.</li> <li><strong>Update to latest version of Onnx Runtime</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6624" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6624/hovercard">#6624</a>) - Updated to the latest version of Onnx Runtime and fixed any breaking changes so we can take advantage of their new features and bug fixes.</li> <li><strong>Update ML.NET to compile with .NET8</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6641" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6641/hovercard">#6641</a>) - Removed some deprecated code now throws errors on .NET8 as well as other minor fixes to allow working/building with .NET8.</li> <li><strong>Added more logging to Object Detection</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6646" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6646/hovercard">#6646</a>) - Added more logging while Object Detection is training so even if epochs take a long time you can be sure things are still moving.</li> <li><strong>Update timeout error message in AutoMLExperiment</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6613" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6613/hovercard">#6613</a>) - Updated the error message so it is more clear what happened.</li> <li><strong>Add batchsize and arch to imageClassification SweepableTrainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6597" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6597/hovercard">#6597</a>) - Added batchsize and arch to the ImageClassification SweepableTrainer so those can now be trained on.</li> <li><strong>Update max_model when trial fails</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6596" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6596/hovercard">#6596</a>)</li> <li><strong>Add default search space for standard trainers</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6576" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6576/hovercard">#6576</a>) - Added a default search space for all standard trainers so users have reasonable default values.</li> <li><strong>Adding more metrics to BinaryClassification Experiment</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6571" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6571/hovercard">#6571</a>)</li> <li><strong>Add checkAlive in NasBertTrainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6546" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6546/hovercard">#6546</a>) - Now we check between batches if cancellation was requested and stop processing if so.</li> <li><strong>OneDAL - Fallback to default implementation</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6538" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6538/hovercard">#6538</a>) - If you specify you want to use OneDal but something happens that prevents you from using it, like it can't find the binaries/etc, it will auto default back to the normal implementation instead of crashing.</li> <li><strong>Add addKeyValueAnnotationsAsText flag in AutoML</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6535" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6535/hovercard">#6535</a>)</li> <li><strong>Add continuous resource monitoring to AutoML.IMonitor</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6520" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6520/hovercard">#6520</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andrasfuchs/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andrasfuchs">@andrasfuchs</a>!</li> <li><strong>Update WebClient to HttpClient implementations</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6476" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6476/hovercard">#6476</a>) - Update a usage of WebClient to HttpClient since WebClient is now deprecated. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rgesteve/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rgesteve">@rgesteve</a>!</li> <li><strong>Set AutoML trial to unsuccess if trial loss is nan/inf</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6430" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6430/hovercard">#6430</a>) - Now trial will be marked as unsuccesssful if the loss is an invalid number.</li> <li><strong>Add diskConvert option in fast tree search space</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6316" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6316/hovercard">#6316</a>)</li> </ul> <h2><strong>Bug Fixes</strong></h2> <ul> <li><strong>Fix DataFrame ToString</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6673" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6673/hovercard">#6673</a>) - Use correct alignment for columns to produce readable output when columns have longer names. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/asmirnov82/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/asmirnov82">@asmirnov82</a>!</li> <li><strong>Fix DataFrame null math</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6661" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6661/hovercard">#6661</a>) - Fixes max in DataFrame columns when there are null values to match what Pandas does.</li> <li><strong>Clean up PrimitiveColumnContainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6656" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6656/hovercard">#6656</a>) - Cleaned up the code in PrimitiveColumnContainer so its more correct and easier to use.</li> <li><strong>Fix Apply in PrimitiveColumnContainer</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6642" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6642/hovercard">#6642</a>) - Fixes the Apply method so it no longer changes the source column. Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/janholo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/janholo">@janholo</a>!</li> <li><strong>Fix datetime null error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6627" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6627/hovercard">#6627</a>) - Fixes loading a null datetime from a database so it now returns correctly instead of throwing an error.</li> <li><strong>Fix AggregateTrainingStopManager is trying to cancel disposed tokens</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6612" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6612/hovercard">#6612</a>) - Will no longer try and cancel already disposed tokens.</li> <li><strong>Fix tostring bug for sweepable pipeline</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6610" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6610/hovercard">#6610</a>)</li> <li><strong>Change Test to Validate in Dataset manager</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6599" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6599/hovercard">#6599</a>)</li> <li><strong>Fixed System.OperationCanceledException when calling experimentResult.BestRun.Estimator.Fit</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6572" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6572/hovercard">#6572</a>)</li> <li><strong>Fixed cancellation bug in SweepablePipelineRunner &amp;&amp; Fixed object null exception in AutoML v1.0 regression API</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6560" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6560/hovercard">#6560</a>)</li> <li><strong>Fixed one dal dispatching issues</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6547" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6547/hovercard">#6547</a>) - OneDal now dispatches correctly.</li> <li><strong>Fixed Multi-threaded access issue</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6537" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6537/hovercard">#6537</a>) - Fixed a multi-threaded access issue for variable length string arrays in ONNX models.</li> <li><strong>Fixed AutoML experiments in non declarative style not working</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6447" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6447/hovercard">#6447</a>)</li> </ul> <h2><strong>Build / Test updates</strong></h2> <ul> <li><strong>Remove MSIL Check for TorchSharp</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6658" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6658/hovercard">#6658</a>) - Removes the MSIL check for TorchSharp while we figure out how we want to correctly handle this.</li> <li><strong>Change code coverage build pool</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6647" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6647/hovercard">#6647</a>) - Changed codecoverage build pool so the builds are faster and more stable.</li> <li><strong>Update AutoMLExperimentTests.cs to fix timeout error</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6638" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6638/hovercard">#6638</a>)</li> <li><strong>Update FabricBot config</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6619" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6619/hovercard">#6619</a>)</li> <li><strong>Libraries area pod updates March 2023</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6607" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6607/hovercard">#6607</a>)</li> <li><strong>Update dependencies from dotnet/arcade</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6566" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6566/hovercard">#6566 &amp; #6518 &amp; #6451 &amp; #6439</a>)</li> <li><strong>Mac python fix</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6549" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6549/hovercard">#6549</a>)</li> <li><strong>Moving onedal nuget download from onedal to native where its needed for building</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6527" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6527/hovercard">#6527</a>)</li> <li><strong>New os image for official builds</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6467" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6467/hovercard">#6467</a>)</li> </ul> <h2><strong>Documentation Updates</strong></h2> <ul> <li><strong>Add doc for CreateSweepableEstimator, Parameter and SearchSpace</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6611" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6611/hovercard">#6611</a>)</li> <li><strong>Add AutoMLExperiment example doc</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6594" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6594/hovercard">#6594</a>)</li> <li><strong>Fix minor doc typos</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6557" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6557/hovercard">#6557</a>)</li> <li><strong>Fix minor roadmap nits</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6480" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6480/hovercard">#6480</a>)</li> <li><strong>2023 roadmap outline</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6444" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6444/hovercard">#6444</a>)</li> <li><strong>Fixed typo for calibrators</strong> (<a href="https://github.com/dotnet/machinelearning/pull/6438" data-hovercard-type="pull_request" data-hovercard-url="/dotnet/machinelearning/pull/6438/hovercard">#6438</a>) - Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KKghub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KKghub">@KKghub</a>!</li> </ul> <h2><strong>Breaking changes</strong></h2> <ul> <li>None</li> </ul> michaelgsharp