sagemaker-huggingface-inference-toolkit


SageMaker Hugging Face Inference Toolkit is an open-source library for serving 🤗 Transformers fashions on Amazon SageMaker. This library offers default pre-processing, predict and postprocessing for sure 🤗 Transformers fashions and duties. It makes use of the SageMaker Inference Toolkit for beginning up the mannequin server, which is accountable for dealing with inference requests. For Training, see Run coaching on Amazon SageMaker.


https://github.com/aws/sagemaker-huggingface-inference-toolkit


Tags
Implementation

Python

License

Apache

Platform

Windows

Linux

   


%d bloggers like this: