sigmoid.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A social space for people researching, working with, or just interested in AI!

Server stats:

638
active users

Daniël de Kok :verified:

We recently added support for running spaCy transformer models on Apple Silicon Mac GPUs.

Madeesh Kannan and I have written a blog post with some background and a lot of benchmarks:

explosion.ai/blog/metal-perfor

Teasers: transformer pipelines run 4.7 times faster on the M1 Max GPU cores than on its AMX units and the MacBook Air M2 uses less power for GPU inference than CPU inference.

ExplosionFast transformer inference with Metal Performance Shaders · ExplosionWe are happy to introduce support for Metal Performance Shaders in Thinc PyTorch layers. This makes it possible to run spaCy transformer-based pipelines on GPU on Apple Silicon Macs and improves inference speed up to 4.7 times.