Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correct types for setuptools.setup #12791

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

max-muoto
Copy link
Contributor

Fixes #12752

@max-muoto max-muoto marked this pull request as ready for review October 12, 2024 18:42

This comment has been minimized.

@@ -45,6 +45,13 @@ __all__ = [

__version__: str

class _Library(TypedDict):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be marked @type_check_only? There seems to be some precedence for using it on some similar typeddicts, e.g.

@type_check_only
class _LocaleConv(TypedDict):

Also, to bikeshed the name, I see setuptools internally calls this structure a build_info in a few places, so maybe _BuildInfo would be a good fit?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, I wasn't aware of it, but likely what we want here. Thanks for the callout. Agree that's a better name here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment has been minimized.

Comment on lines +49 to +55
@type_check_only
class _BuildInfo(TypedDict):
sources: list[str] | tuple[str]
obj_deps: NotRequired[dict[str, list[str] | tuple[str]]]
macros: NotRequired[list[tuple[str, str] | tuple[str]]]
include_dirs: NotRequired[list[str]]
cflags: NotRequired[list[str]]
Copy link
Sponsor Collaborator

@Avasam Avasam Oct 12, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Normally I'd prefer defining such types close to where their implementation stands (so with the appropriate Command or Distribution) but in this case it'd end up in distutils and/or setuptools/_distutils so I guess in setuptools.__init__.py is fine.

I do have a concern using a type-only TypedDict with required members as a parameter: It makes it annoying to use a non-literal dict. Maybe that's ok in setuptools due to the nature of it looking like a config file, it shouldn't be much more complex than my example below?

It's possible, but requires a private type-only import, which isn't great:

from typing import cast, TYPE_CHECKING
if TYPE_CHECKING:
    from setuptools import _BuildInfo

libs = [
    ("lib1", {"sources": []}),
    ("lib2", {"sources": []}),
]
setup(libraries=libs)  # Type error in both mypy and pyright due to missing "sources"
# Ok, but must quote type to avoid runtime error
setup(libraries=cast(list[tuple[str, "_BuildInfo"]], libs))
# Ok
setup(libraries=[("literal", {"sources": []})])
# Ok
libs_annotated: list[tuple[str, "_BuildInfo"]] = [ # Must quote type or use from __future__ import annotations
    ("lib1", {"sources": []}),
    ("lib2", {"sources": []}),
]
setup(libraries=libs_annotated)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, perhaps it's not ideal but I'm not seeing a great alternative, obviously passing things in-line solves this problem, or just:

libs: "list[tuple[str, _BuildInfo]]" = [
    ("lib1", {"sources": []}),
    ("lib2", {"sources": []}),
]
setup(libraries=libs)

Which would work without quotes given deferred annotations.

Copy link
Sponsor Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At the same time, the kind of people to type-check their setup.py are probably the same going all out on typing (looking at myself here ^^)

Copy link
Contributor

According to mypy_primer, this change has no effect on the checked open source code. 🤖🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

setuptools.setup() libraries parameter is wrong
3 participants