bk99.de entertain the web since 1997

spaCy models in the Hugging Face Hub

Summary

The integration brings spaCy pipelines into the Hub and gives them discoverable metadata. This makes classic NLP pipelines versionable and shareable alongside transformer models. spaCy packages can be distributed and installed via the Hub.

Ideas

  • A model hub should connect different runtime ecosystems instead of favouring just one library.
  • Besides weights, pipelines need tokenizers, labels and configurations as one unit.

Insights

  • Shared distribution becomes valuable when it also preserves configuration, labels and limits.

Facts

  • The model cards show tasks, language, licence and other metadata.

Critique

  • Central distribution does not solve the licence, quality or maintenance questions of the respective model.

Recommendations

  • Pin the exact revision of a pipeline and test its labels against your application.

References

Read the original article on Hugging Face

Search the Web Archive