Improvements:

• Restrict dependency caching to HTTP/HTTPS URLs only #1485
  • The cache option now only applies to HTTP/HTTPS URLs and pip dependencies
  • Other URL schemes (s3://, file://, etc.) no longer support the cache toggle
  • The advanced cache options UI is now only shown for dependencies that support caching
  • Updated documentation to reflect the caching behavior changes

This release adds support for Apache Spark 3.5 alongside Spark 3.3, upgrades to Java 17 runtime, and includes Python 3.10 compatibility fixes.

Breaking Changes:

• Spark 3.2.x and earlier versions are no longer supported
  • Polynote now only supports Spark 3.3.4 and Spark 3.5.7

Features:

• Spark 3.5 Support #1479
  • Add Spark 3.5.7 support alongside existing Spark 3.3.4 support
  • Users can now choose between Spark 3.3 and Spark 3.5 by setting spark_version in notebook configuration
  • Automatic runtime selection based on configuration
  • Both Scala 2.12 and 2.13 supported with each Spark version

Improvements:

• Upgrade to Apache Spark 3.3.4 #1478
  • Updated from Spark 3.1.2/3.2.1 to 3.3.4
  • Both Scala versions now use the same Spark version
  • Updated to Hadoop 3.x binaries for improved cloud storage support
• Use JDK 17 runtime #1471
  • Upgraded from Java 8 to Java 17 for CI builds and runtime
  • Added JVM compatibility flags for Spark to work with Java 17+
  • Better performance and security with modern Java runtime
• Bump Scala versions #1472
  • Updated Scala 2.12.15 → 2.12.20
  • Updated Scala 2.13.6 → 2.13.11
• Update dependencies
  • Update Jep and Pandas
  • Update plugin config to use new structure
• CI/Build improvements
  • Extract test script for better maintainability #1476
  • Bump OS version #1469
  • Use sbt ++ for consistent Scala version across all projects
  • Add 30-minute timeout to prevent jobs from hanging

Bugfixes:

• Fix sbt warnings for unused circe version keys #1484
• Fix build timeout by downloading Spark packages from GitHub instead of Apache archive #1483
• Fix spark download deadlock in test setup #1475
  • Improved lock file mechanism with robust cleanup
  • Stale lock detection and automatic recovery
  • Version-specific lock files to allow parallel builds
• Fix polynote.py for Python 3.10 compatibility
• Add vscode / metals to gitignore #1480
• Shade Google dependencies in assembly #1477
• Shade shapeless dependency to avoid version conflicts
• Compiler gets boot classpath first without dep isolation
• Remove circe from plugin API boundary
• Add more python-ish stub methods to KernelRuntime.Output
• Add PluginConfig

The biggest change is dropping Scala 2.11 support, which lets us update some dependencies and improve compatibility.

Some bigger changes are waiting to be released, but require a minor version bump due to breaking changes. So this will be the last 0.6.x release.

What's Changed

• Updates to latest SBT to run in modern JDK by @tlazaro in #1443
• Cancelling a comment doesn't work by @paaatrrrick in #1444
• Update DEVELOPING.md by @paaatrrrick in #1446
• Drop Scala 2.11, update circe by @jeremyrsmith in #1448
• Add -release option by @jeremyrsmith in #1452
• Add dependency override for shapeless by @jeremyrsmith in #1453
• Exclude sys.pycache_prefix from search for jep in python startup script by @JanukanS in #1455
• Fix CI sbt missing issue by @jeremyrsmith in #1460

New Contributors

• @paaatrrrick made their first contribution in #1444
• @JanukanS made their first contribution in #1455

Full Changelog: 0.6.0...0.6.1

This release adds Jump To Definition support, along with a number of bug fixes.

Previously, 0.5.2 included this feature, but it introduced a number of regressions.

This will likely be the last release that supports Scala 2.11.

Features:

• Add support for .txt dependencies in Python #1357
• Add log verbosity configuration #1380 (thanks @dhia-gharsallaoui)

Bugfixes:

• Fix an issue preventing the creation of zombie kernels by adding a KeepAlive between kernel <-> server #1319
• Add stylesheet versions to bust the CSS cache on new version deployments #1136
• Fix an issue where panels can be dragged to a negative width and then couldn't be adjusted again #1335
• Add an error message on config paste failure #1375
• Fix a bug where execution info was copied when a new cell was inserted without being explicitly requested #1392

Misc:

• Upgrade Monaco version, adding support for various new Monaco features and fixing some longstanding editor bugs #457 #1382
• Upgrade Webpack version to fix CI failures #1388

A special thanks to first-time contributor @dhia-gharsallaoui in this release!

Features:

• Add a table of contents along with a full left navbar redesign #1301
  • The new table of contents can be accessed under the Summary button in the new left navbar
  • Headings will automatically be added as you write h1-h6 headings in text cells. Click on a code cell to see where it is
    relevant to the closest heading, or click on a heading in the left pane to jump straight to that text cell.
  • For full documentation on the new left navbar redesign, see the docs here.
• Display each kernel's time since last run and since last save in settings pane #812

Bugfixes:

• Fix a few issues where focusing raw markdown cells didn't always render the old markdown cell you left #1315
• Use a workaround to fix occasional compilation issues with shadowjars #1352

Misc:

• Pin Jep back to its default version #1360
• Bump to sbt 1.7.2. and fix slash syntax (thanks @MasseGuillaume) #1350
• Mention that Scala 2.13 is in alpha support in docs (thanks @pan3793) #1368

A special thanks to two first-time contributors in this release - @MasseGuillaume and @pan3793!

Features:

• Added a new design for the notebook list! #1118
  • You can now sort notebooks by recently edited timestamp or by name in ascending or descending order. See docs here.
• Support .txt dependency lists for JARs #1349
  • You can now use .txt files as dependencies, where each JAR is listed on a newline. See docs here.

Bugfixes:

• Use relaxed dependency resolution #1300
• Remove extra dropdown button on advanced options label #1358

Features:

• Add branch-level granularity for notebook drag n' drop #1298
• Add in-app notifications for new updates
• Add run selected cell hotkey + VSCode hotkey link #1313
• Add more documentation around the PythonObject API #1320

Bugfixes:

• Fix a bug where new comments could not be created
• Fix an issue with the size of the search modal sometimes not conforming with the result table #1337
• Fix error cards in the task pane appearing clickable on hover when they shouldn't be #1316
• Fix the Copy & Paste configuration buttons to more accurately reflect the saved kernel state #1314
• Add a note to the documentation about using the ?nocache query string.

Bugfixes:

• Fixes a bug where there was no max width set on the search modal
• Fixes a bug where the kernel pane would not update on notebook switch
• Fixes the link on the Configuration & Dependencies Learn More icon

Features:

• Added support for searching across all your notebooks! #983
  • You can use the new search icon next to the plus in your notebooks list to search across all of your notebooks for a line of text/code
• Clicking on a running task card in your Tasks pane will now jump you to the corresponding cell #1274
• Added help icons throughout various places of the UI #1305
  • These will take you directly to the documentation to explain the section of the UI they represent
• Added support for copying and pasting notebook configurations between notebooks
  • See here for documentation
• Added dropdowns for each sub-section in the Configuration & Dependencies section for easier navigability #1277
• Each error in your Tasks pane has a copy button that will copy the error message + stack trace for easy sharability #1294
  • The stack trace has also been made easier to read.

Bugfixes:

• Fixed a bug where running tasks that got converted to errors couldn't be closed in the Tasks pane
• Added a UI label to explain how to use absolute file paths for JARs #1212