ValueError: sharded is not supported for AutoModel
#5
by
michaelphipps
- opened
Trying to shard/deploy through TGI and getting this error: ValueError: sharded is not supported for AutoModel
Is there some limitation for sharding with this model?
@michaelphipps I think we should followup here: https://github.com/huggingface/text-generation-inference/issues/1679
Closing this as it seems to be working in the TGI thread.
abhi-db
changed discussion status to
closed