spaCy models in the Hugging Face Hub
Summary
The integration brings spaCy pipelines into the Hub and gives them discoverable metadata. This makes classic NLP pipelines versionable and shareable alongside transformer models. spaCy packages can be distributed and installed via the Hub.
Ideas
- A model hub should connect different runtime ecosystems instead of favouring just one library.
- Besides weights, pipelines need tokenizers, labels and configurations as one unit.
Insights
- Shared distribution becomes valuable when it also preserves configuration, labels and limits.
Facts
- The model cards show tasks, language, licence and other metadata.
Critique
- Central distribution does not solve the licence, quality or maintenance questions of the respective model.
Recommendations
- Pin the exact revision of a pipeline and test its labels against your application.
References
Read the original article on Hugging Face
Links to the original source and the Web Archive open in a new tab.