python dev #20318
Merged
python dev #20318
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
At this point most things should use the py/pip-build-install pipeline and generally look like py3-pyyaml Also: * rename cython.yaml, numpy.yaml to py3-<name> These are python packages and present in pypi, for consistency, name them like other python packages. Co-authored-by: Dimitri John Ledkov <[email protected]>
flit-core has bootstrap_install.py to handle this, so we use it. pip doesn't stricktly depend on wheel, although buidling many projects assumes that it is there.
Signed-off-by: Dimitri John Ledkov <[email protected]>
hahhah just kidding This reverts commit 3a96413.
Requires chainguard-dev/melange#1166 Drop pybins, instead build all packages with commands in /usr/bin. Set replaces, replaces-priority to ensure they are apk installable. Also set provider-priority such that `apk add py3-pip` transparently installs py3.12-pip alone. This is all great, however not at all supported by apko. But imho should be supported. As one simply has to sort packages in replaces priority order prior to streaming. And allow overriding files between packages that have replaces declared. ```console ... (13/25) Installing python-3.10-base (3.10.14-r1) (14/25) Installing py3.10-flit-core (3.9.0-r2) (15/25) Installing py3.10-setuptools (69.5.1-r1) (16/25) Installing py3.10-pip (24.0-r2) (17/25) Installing python-3.11-base (3.11.9-r1) (18/25) Installing py3.11-flit-core (3.9.0-r2) (19/25) Installing py3.11-setuptools (69.5.1-r1) (20/25) Installing py3.11-pip (24.0-r2) (21/25) Installing python-3.12-base (3.12.3-r1) (22/25) Installing py3.12-flit-core (3.9.0-r2) (23/25) Installing py3.12-setuptools (69.5.1-r1) (24/25) Installing py3.12-pip (24.0-r2) (25/25) Installing py3-supported-pip (24.0-r2) OK: 197 MiB in 40 packages -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.12 -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.11 -rwxrwxr-x 1 root root 946 Apr 26 22:22 /usr/bin/pip3.10 -rwxrwxr-x 1 root root 940 Apr 26 22:22 /usr/bin/pip3 -rwxrwxr-x 1 root root 938 Apr 26 22:22 /usr/bin/pip ```
At this point most things should use the py/pip-build-install pipeline and generally look like py3-pyyaml Also: * rename cython.yaml, numpy.yaml to py3-<name> These are python packages and present in pypi, for consistency, name them like other python packages. Co-authored-by: Dimitri John Ledkov <[email protected]>
flit-core has bootstrap_install.py to handle this, so we use it. pip doesn't stricktly depend on wheel, although buidling many projects assumes that it is there.
You can get started with:
make package/pip-zipapp \
package/py3-{supported-python,setuptools,installer,wheel,pip}
Then most of core deps are built.
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Dimitri John Ledkov <[email protected]>
Signed-off-by: Pris Nasrat <[email protected]>
Signed-off-by: Pris Nasrat <[email protected]>
Signed-off-by: Pris Nasrat <[email protected]>
|
Was going to test the cython deps moving to py3-cython however getting depsolving issues. @xnox am I missing something I need locally (melange seems current) to fix this |
|
Ah looks like I was pulling in a transient dep to the old world running this first fixes:
|
pnasrat
reviewed
Jun 17, 2024
Signed-off-by: Pris Nasrat <[email protected]>
Signed-off-by: Pris Nasrat <[email protected]>
This reverts commit 634fa93. Various packages still depend on `cython~0` Signed-off-by: Pris Nasrat <[email protected]>
|
clean before build to ensure versioned cpython libs created for all py versions Signed-off-by: Pris Nasrat <[email protected]>
build-base pulls in wolfi-baselayout and transitively ca-certificates-bundle Signed-off-by: Pris Nasrat <[email protected]>
2 tasks
|
Depends on split out |
Signed-off-by: Pris Nasrat <[email protected]>
Need to use explicit py version in import test See chainguard-dev/melange#1299 Signed-off-by: Pris Nasrat <[email protected]>
Signed-off-by: Pris Nasrat <[email protected]>
|
Scan package for CVES is reporting CVE-2018-20225 which has been previously nak'd |
|
New package name: https://github.com/wolfi-dev/advisories/blob/main/py3.12-pip.advisories.yaml Have draft PR for that here wolfi-dev/advisories#5849 |
This was referenced Jun 17, 2024
vaikas
approved these changes
Jun 18, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Make several core python packages build for mulitple python versions.
At this point most things should use the py/pip-build-install pipeline
and generally look like py3-pyyaml
Also:
rename cython.yaml, numpy.yaml to py3-
These are python packages and present in pypi, for
consistency, name them like other python packages.
Co-authored-by: Dimitri John Ledkov [email protected]
Resolve the dependency loop.
flit-core has bootstrap_install.py to handle this, so we use it.
pip doesn't stricktly depend on wheel, although buidling many projects
assumes that it is there.
Fun stuff
Signed-off-by: Dimitri John Ledkov [email protected]
Revert "Fun stuff"
hahhah just kidding
This reverts commit 3a96413.
Drop pybins and allow to install them all
Requires Replaces priority chainguard-dev/melange#1166
Drop pybins, instead build all packages with commands in /usr/bin.
Set replaces, replaces-priority to ensure they are apk installable.
Also set provider-priority such that
apk add py3-piptransparentlyinstalls py3.12-pip alone.
This is all great, however not at all supported by apko. But imho
should be supported. As one simply has to sort packages in replaces
priority order prior to streaming. And allow overriding files between
packages that have replaces declared.
wip
Make several core python packages build for mulitple python versions.
At this point most things should use the py/pip-build-install pipeline
and generally look like py3-pyyaml
Also:
rename cython.yaml, numpy.yaml to py3-
These are python packages and present in pypi, for
consistency, name them like other python packages.
Co-authored-by: Dimitri John Ledkov [email protected]
Resolve the dependency loop.
flit-core has bootstrap_install.py to handle this, so we use it.
pip doesn't stricktly depend on wheel, although buidling many projects
assumes that it is there.
Some cleanups of things. pip-build-install-bootstrap simplifies.
You can get started with:
make package/pip-zipapp
package/py3-{supported-python,setuptools,installer,wheel,pip}
Then most of core deps are built.
Upgrade setuptools
Signed-off-by: Dimitri John Ledkov [email protected]
Test setuptools
Signed-off-by: Dimitri John Ledkov [email protected]
fixes
tomli
Signed-off-by: Dimitri John Ledkov [email protected]
foo
Add pip-zipapp.yaml file.
Remove no longer needed cython-0
Signed-off-by: Dimitri John Ledkov [email protected]
Split wheel binary into -bin subpackage
Signed-off-by: Dimitri John Ledkov [email protected]
Make py3-pip coinstallable
Signed-off-by: Dimitri John Ledkov [email protected]
py3-supported-cython is not coinstallable, and not needed
Signed-off-by: Dimitri John Ledkov [email protected]
Fix py3-tomli priorities
Signed-off-by: Dimitri John Ledkov [email protected]
py3-six fix up environment
Fix up py3-numpy