-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Main] Make pipeline ymls work with the SDK repo (#40451)
Co-authored-by: Viktor Hofer <[email protected]>
- Loading branch information
1 parent
e1922e8
commit 41b3287
Showing
31 changed files
with
310 additions
and
170 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,12 @@ | ||
| { | ||
| "version": 1, | ||
| "isRoot": true, | ||
| "tools": { | ||
| "microsoft.dotnet.darc": { | ||
| "version": "1.1.0-beta.24210.2", | ||
| "commands": [ | ||
| "darc" | ||
| ] | ||
| } | ||
| } | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,55 @@ | ||
| <!-- | ||
| ######## ######## ### ######## ######## ## ## #### ###### | ||
| ## ## ## ## ## ## ## ## ## ## ## ## ## | ||
| ## ## ## ## ## ## ## ## ## ## ## ## | ||
| ######## ###### ## ## ## ## ## ######### ## ###### | ||
| ## ## ## ######### ## ## ## ## ## ## ## | ||
| ## ## ## ## ## ## ## ## ## ## ## ## ## | ||
| ## ## ######## ## ## ######## ## ## ## #### ###### | ||
| --> | ||
|
|
||
| This Codespace can help you debug the source build of .NET. In case you have run this from a | ||
| `dotnet/sdk` PR branch, it will contain the VMR (`dotnet/dotnet`) checked out into | ||
| `/workspaces/dotnet` with the PR changes pulled into it. You can then attempt to source-build | ||
| the VMR which is what the VMR leg in the sdk PR build doing. This build takes about 45 | ||
| minutes and, after completion, produces an archived .NET SDK located in | ||
| `/workspaces/dotnet/artifacts/assets/Release`. | ||
|
|
||
| ## Build the SDK | ||
|
|
||
| To build the VMR, run following: | ||
| ```bash | ||
| cd /workspaces/dotnet | ||
| ./build.sh --online | ||
| ``` | ||
|
|
||
| > Please note that, at this time, the build modifies some of the checked-in sources so it might | ||
| be preferential to rebuild the Codespace between attempts (or reset the working tree changes). | ||
|
|
||
| For more details, see the instructions at https://github.com/dotnet/dotnet. | ||
|
|
||
| ## Synchronize your changes in locally | ||
|
|
||
| When debugging the build, you have two options how to test your changes in this environment. | ||
|
|
||
| ### Making changes to the VMR directly | ||
|
|
||
| You can make the changes directly to the local checkout of the VMR at `/workspaces/dotnet`. You | ||
| can then try to build the VMR and see if the change works for you. | ||
|
|
||
| ### Pull changes into the Codespace from your fork | ||
|
|
||
| You can also make a fix in the individual source repository (e.g. `dotnet/runtime`) and push the | ||
| fix into a branch; can be in your fork too. Once you have the commit pushed, you can pull this | ||
| version of the repository into the Codespace by running: | ||
|
|
||
| ``` | ||
| /workspaces/synchronize-vmr.sh \ | ||
| --repository <repo>:<commit, tag or branch> \ | ||
| --remote <repo>:<fork URI> | ||
| ``` | ||
|
|
||
| You can now proceed building the VMR in the Codespace using instructions above. You can repeat | ||
| this process and sync a new commit from your fork. Only note that, at this time, Source-Build | ||
| modifies some of the checked-in sources so you'll need to revert the working tree changes | ||
| between attempts. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| // Container suitable for investigating issues with source build | ||
| // Contains the VMR (dotnet/dotnet) with applied changes from the current PR | ||
| // The container supports source-building the SDK | ||
| { | ||
| "name": "VMR with PR changes", | ||
| "image": "mcr.microsoft.com/dotnet-buildtools/prereqs:fedora-39", | ||
| "hostRequirements": { | ||
| // A completely source built .NET is >64 GB with all the repos/artifacts | ||
| "storage": "128gb" | ||
| }, | ||
| "customizations": { | ||
| "vscode": { | ||
| "extensions": [ | ||
| "ms-dotnettools.csharp" | ||
| ] | ||
| }, | ||
| "codespaces": { | ||
| "openFiles": [ | ||
| "sdk/.devcontainer/vmr/README.md" | ||
| ] | ||
| } | ||
| }, | ||
| "onCreateCommand": "${containerWorkspaceFolder}/sdk/.devcontainer/vmr/init.sh", | ||
| "workspaceFolder": "/workspaces" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,30 @@ | ||
| #!/usr/bin/env bash | ||
|
|
||
| set -ex | ||
|
|
||
| source="${BASH_SOURCE[0]}" | ||
| script_root="$( cd -P "$( dirname "$source" )" && pwd )" | ||
|
|
||
| sdk_dir=$(realpath "$script_root/../..") | ||
| workspace_dir=$(realpath "$sdk_dir/../") | ||
| tmp_dir=$(realpath "$workspace_dir/tmp") | ||
| vmr_dir=$(realpath "$workspace_dir/dotnet") | ||
|
|
||
| cp "$sdk_dir/.devcontainer/vmr/synchronize-vmr.sh" "$workspace_dir" | ||
|
|
||
| mkdir -p "$tmp_dir" | ||
|
|
||
| # Codespaces performs a shallow fetch only | ||
| git -C "$sdk_dir" fetch --all --unshallow | ||
|
|
||
| # We will try to figure out, which branch is the current (PR) branch based off of | ||
| # We need this to figure out, which VMR branch to use | ||
| vmr_branch=$(git -C "$sdk_dir" log --pretty=format:'%D' HEAD^ \ | ||
| | grep 'origin/' \ | ||
| | head -n1 \ | ||
| | sed 's@origin/@@' \ | ||
| | sed 's@,.*@@') | ||
|
|
||
| "$workspace_dir/synchronize-vmr.sh" --branch "$vmr_branch" --debug | ||
|
|
||
| (cd "$vmr_dir" && ./prep-source-build.sh) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| #!/bin/bash | ||
|
|
||
| (cd /workspaces/sdk \ | ||
| && ./eng/vmr-sync.sh --vmr /workspaces/dotnet --tmp /workspaces/tmp $*) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| <Project> | ||
|
|
||
| <!-- VMR bootstrap --> | ||
| <ItemGroup Condition="'$(InitializeVMR)' == 'true'"> | ||
| <ProjectToBuild Include="$(RepoRoot)src/VirtualMonoRepo/Tasks/VirtualMonoRepo.Tasks.csproj" BuildInParallel="false" /> | ||
| <ProjectToBuild Include="$(RepoRoot)src/VirtualMonoRepo/InitializeVMR.proj" BuildInParallel="false" /> | ||
| </ItemGroup> | ||
|
|
||
| </Project> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| #!/bin/bash | ||
|
|
||
| set -euo pipefail | ||
|
|
||
| # Install instructions: https://scancode-toolkit.readthedocs.io/en/latest/getting-started/install.html#installation-as-a-library-via-pip | ||
|
|
||
| # See latest release at https://github.com/nexB/scancode-toolkit/releases | ||
| SCANCODE_VERSION="32.1.0" | ||
|
|
||
| pyEnvPath="/tmp/scancode-env" | ||
| python3 -m venv $pyEnvPath | ||
| source $pyEnvPath/bin/activate | ||
| pip install scancode-toolkit==$SCANCODE_VERSION | ||
| deactivate | ||
|
|
||
| # Setup a script which executes scancode in the virtual environment | ||
| cat > /usr/local/bin/scancode << EOF | ||
| #!/bin/bash | ||
| set -euo pipefail | ||
| source $pyEnvPath/bin/activate | ||
| scancode "\$@" | ||
| deactivate | ||
| EOF | ||
|
|
||
| chmod +x /usr/local/bin/scancode |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| #!/bin/bash | ||
|
|
||
| (cd /workspaces/dotnet/src/installer \ | ||
| (cd /workspaces/dotnet/src/sdk \ | ||
| && ./eng/vmr-sync.sh --vmr /workspaces/dotnet --tmp /workspaces/tmp $*) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.