Description
Since 2015 [Software Heritage](https://www.softwareheritage.org/) is archiving all source code available on the Internet, and has collected more than 25 billion files over 400 million repositories. You can mount all this content transparently after a pip install swh-fuse.
In this talk we'll show how to implement such virtual filesystem, thanks to Python bindings to libfuse. swh-fuse aims to unlock a massively parallel access to the archive, so we'll also discuss how to enable a few thousand mounts at the same time on HPC clusters. We'll encounter a ProcessPoolExecutor, pluggable back-ends abstracted by typing.Procotol, a Python module implemented in Rust, and worry about free-threading.