Skip to content

Issues: aws/sagemaker-huggingface-inference-toolkit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

42 Open 37 Closed
42 Open 37 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Server reruns same task multiple times
#133 opened Dec 4, 2024 by kurtgdl
Support load_lora_weights in inference API deploy
#131 opened Aug 21, 2024 by haktan-suren
SageMaker fails because Conversation object is not found
#129 opened Jun 28, 2024 by adrihercer
13
Can’t create an inference service for models that depend on packages i.e. espeak
#128 opened Jun 23, 2024 by ghubnerr
Custom Inference Code - model_fn() takes more positional argument
#126 opened Jun 17, 2024 by dil-bhantos
Sagemaker HuggingfaceModel fails on phi3 model deployment
#123 opened May 21, 2024 by manikawnth
2
Sagemaker endpoint inference Fails when following a tutorial
#122 opened May 9, 2024 by IoannisDem
device kernel image is invalid
#119 opened May 7, 2024 by geraldstanje1
Sagemaker endpoint doesn't use GPU (instance ml.g4dn.xlarge)
#117 opened Apr 18, 2024 by jypucca
1
Sagemaker inference not loading model weight from s3
#116 opened Apr 8, 2024 by saichethan-a
2
Make DEFAULT_HF_HUB_MODEL_EXPORT_DIRECTORY configurable
#115 opened Mar 20, 2024 by pcolazurdo
Endpoint creation completes before custom model_fn finishes loading resources
#111 opened Feb 12, 2024 by Tripping-Hazard
HF_TASK Enviournment Variable error
#110 opened Jan 12, 2024 by 316usman
1
Support multiple return sequences
#109 opened Dec 13, 2023 by Elanmarkowitz
Sagemaker endpoint inferencing error with HF model loading from s3bucket with new transformer update
#108 opened Nov 13, 2023 by miteshkotak
5
🏷️ invalid
#107 opened Oct 15, 2023 by pierrishm1987
No support for multi-GPU
#106 opened Oct 13, 2023 by parviste-fortum
3
get_pipeline function passes Path object rather than PretrainedTokenizer
#105 opened Oct 1, 2023 by jpang32
Using custom inference script and models from Hub
#102 opened Sep 21, 2023 by Tarun02
1
How to enable Batch inference on AWS deployed Serverless model from Hub?
#98 opened Sep 6, 2023 by jmparejaz
1
SageMaker deployment errors
#94 opened Jul 10, 2023 by jonrossclaytor
2
Dead Link for Available HF_Tasks
#91 opened Jun 14, 2023 by dcsena
1
How to access CustomAttributes in async inferece request input_fn
#89 opened Jun 5, 2023 by dcdieci
1
Support passing model_kwargs to pipeline enhancement New feature or request
#85 opened May 10, 2023 by lukealexmiller
1
Data format for inference
#83 opened Apr 19, 2023 by alvaropp
1
ProTip! Updated in the last three days: updated:>2024-12-14.