sigmoid.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A social space for people researching, working with, or just interested in AI!

Server stats:

594
active users

Olivier Grisel

cloudpickle 3.0.0 is out!

github.com/cloudpipe/cloudpick

cloudpickle is a library used by PySpark, Dask, Ray and joblib / loky (among others) to make it possible to call dynamically or locally defined function, closures and lambdas on remote Python process workers.

This is typically necessary for running code in parallel on a distributed computing cluster from an interactive developer environment such as a Jupyter or Databricks notebooks.

GitHubGitHub - cloudpipe/cloudpickle: Extended pickling support for Python objectsExtended pickling support for Python objects. Contribute to cloudpipe/cloudpickle development by creating an account on GitHub.
#Python#PyData#HPC

This release drops the support for Python 3.6 and 3.7 and add official support for Python 3.12.

Dropping support for older Python versions made it possible to simplify the code base a lot (more than 500 lines of code deleted).

We also fixed errors when pickling instances of dynamically defined dataclasses.

We also took the opportunity to upgrade our maintenance tools (no more setup.py in favor of pyproject.toml, use black and ruff in a pre-commit setting, ...).

Thanks to contributors!