Create torch_compile_example

#3
by ydshieh HF staff - opened

This is a (more detailed) python script that shows the usage of torch.compile with generate with comments regarding:

  • compilation time
  • how max_lenghis related to the static cache object
  • changing length and recompilation
  • cache object being (due to longer length specified) recreated and recompilation
osanseviero changed pull request status to closed

Sign up or log in to comment