Package size
Hello,
After the changes, I saw that the package size had increased. What I want to ask is, is this an intentional change that came with the last change or is there a different situation with the side packages? I was working on a Docker image and observed that it had previously not exceeded 10GB, but now does.
the image consists of Python 3.9, spacy and tr core news trf
Best regards.
Hellos, thanks for your visit :wave:
Honestly no ideas, I only changed .whl file name due to setuptools naming conventions change. I only made one commit recently and that's a name change:
What is your setuptools version and OS? I can examine the download directory and check the issue.
hello, thanks for replying 🥰
here is my command outputs:
bash-4.2# pip show setuptools
Name: setuptools
Version: 58.1.0
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email: [email protected]
License: UNKNOWN
Location: /var/lang/lib/python3.9/site-packages
Requires:
Required-by: marisa-trie, spacy, thinc
bash-4.2# echo $OSTYPE
linux-gnu
It is not a mandatory thing but I am just curious about it, I was able to use it in a lambda image 😅
Hellos again, I was not able to reproduce the issue .
This is the package before renaming:
duygu@duygu1:/usr/local/lib/python3.9/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2$ du -csh *
8.0K config.cfg
128K meta.json
4.5M morphologizer
424M ner
1016K parser
116K README.md
328K tagger
48K tokenizer
22M trainable_lemmatizer
424M transformer
6.2M vocab
881M total
I downloaded the package freshly onto Google Colab for reference , setuptools version is 71.04 :
!du -csh /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/*
8.0K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/config.cfg
128K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/meta.json
4.5M /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/morphologizer
424M /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/ner
1016K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/parser
116K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/README.md
328K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/tagger
48K /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/tokenizer
22M /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/trainable_lemmatizer
424M /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/transformer
6.2M /usr/local/lib/python3.10/dist-packages/tr_core_news_trf/tr_core_news_trf-3.4.2/vocab
881M total
How does the file sizes from your side look like?
Hello,
Sorry for my late reply, I totally forgot here. It might be related to the side packages because as far as I remember it was the same with 881m but not sure. I believe additional packages were downloaded during the new update. Thanks for the effort. If I see something in my further work, I'll bring it up. 🥹
No worries, I close the issue for now but if you come up with anything feel free to re-open the issue. Have a nice Wednesday 👋