Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xen-1.1.1: Skip virtual, non-NUMA net/blk,tun/tap and vif OSDevs #5

Open
wants to merge 1 commit into
base: hwloc-2.11.1+xen-1.1.0
Choose a base branch
from

Conversation

bernhardkaindl
Copy link

@bernhardkaindl bernhardkaindl commented Sep 18, 2024

JFYI: This PR is only for showing the change in the version 1.1.1 of the Xen backend.

It fixes that the issue that when running load tests were run on large NUMA systems, several dozens of tap and vif devices may be created and those would "spam" the data captured by lstopo.

As those are not relevant to capture the HW topology, ignore those OSDevs that are purely virtual and are not associated with an actual HW device, and thuse are not relevant to capturing the NUMA topology.

For example, this is the ASCII art output from a 4 socket, 8 NUMA node system that would show several dozens of vif devices and some tap devices when load tests run that are not relevant and should be omitted like shown here.

The output is still not perfect as the NUMA PCI topology is not reported by Xen on this machine (also by xl info -n so it's not a hwloc issue), but this already a lot better than without this improvement.

SVG output:
ssh -t [email protected] lstopo --of svg >08-04.svg
08-04
ASCII art output:

ssh -t root@...-08-04 lstopo --of ascii
/-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------\
| Machine (512GB total)                                                                                                                                                                                                                                             |
|                                                                                                                                                                                                                                                                   |
| /-------------------------------------------------------------------\  /-------------------------------------------------------------------\  ++--+-----++--+-----+---------------------------------------------------\                                           |
| | Package L#0                                                       |  | Package L#1                                                       |      |2.0      |2.0  | Ethernet (Broadcom NetXtreme II BCM5709): 01:00.0 |                                           |
| |                                                                   |  |                                                                   |      |         |     |                                                   |                                           |
| | /---------------------------------------------------------------\ |  | /---------------------------------------------------------------\ |      |         |     | /----------\                                      |                                           |
| | | Die L#0                                                       | |  | | Die L#2                                                       | |      |         |     | | Net eth0 |                                      |                                           |
| | |                                                               | |  | |                                                               | |      |         |     | \----------/                                      |                                           |
| | | /-----------------------------------------------------------\ | |  | | /-----------------------------------------------------------\ | |      |         |     \---------------------------------------------------/                                           |
| | | | NUMANode L#0 P#0 (65GB)                                   | | |  | | | NUMANode L#2 P#2 (64GB)                                   | | |      |         |                                                                                                     |
| | | \-----------------------------------------------------------/ | |  | | \-----------------------------------------------------------/ | |      |         +-----+---------------------------------------------------\                                           |
| | |                                                               | |  | |                                                               | |      |          2.0  | Ethernet (Broadcom NetXtreme II BCM5709): 01:00.1 |                                           |
| | | /-------------\  /-------------\              /-------------\ | |  | | /-------------\  /-------------\              /-------------\ | |      |               |                                                   |                                           |
| | | | Core L#0    |  | Core L#1    |  ++  ++  ++  | Core L#7    | | |  | | | Core L#16   |  | Core L#17   |  ++  ++  ++  | Core L#23   | | |      |               | /----------\                                      |                                           |
| | | |             |  |             |              |             | | |  | | |             |  |             |              |             | | |      |               | | Net eth1 |                                      |                                           |
| | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |  | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |      |               | \----------/                                      |                                           |
| | | | | PU L#0  | |  | | PU L#1  | |              | | PU L#7  | | | |  | | | | PU L#16 | |  | | PU L#17 | |              | | PU L#23 | | | |      |               \---------------------------------------------------/                                           |
| | | | |         | |  | |         | |              | |         | | | |  | | | |         | |  | |         | |              | |         | | | |      |                                                                                                               |
| | | | |   P#0   | |  | |   P#1   | |              | |   P#7   | | | |  | | | |  P#16   | |  | |  P#17   | |              | |  P#23   | | | |      +-----++--+-----+---------------------------------------------------\                                           |
| | | | \---------/ |  | \---------/ |              | \---------/ | | |  | | | \---------/ |  | \---------/ |              | \---------/ | | |      |1.0      |1.0  | Ethernet (Broadcom NetXtreme II BCM5709): 02:00.0 |                                           |
| | | \-------------/  \-------------/              \-------------/ | |  | | \-------------/  \-------------/              \-------------/ | |      |         |     |                                                   |                                           |
| | \---------------------------------------------------------------/ |  | \---------------------------------------------------------------/ |      |         |     | /----------\                                      |                                           |
| |                                                                   |  |                                                                   |      |         |     | | Net eth2 |                                      |                                           |
| | /---------------------------------------------------------------\ |  | /---------------------------------------------------------------\ |      |         |     | \----------/                                      |                                           |
| | | Die L#1                                                       | |  | | Die L#3                                                       | |      |         |     \---------------------------------------------------/                                           |
| | |                                                               | |  | |                                                               | |      |         |                                                                                                     |
| | | /-----------------------------------------------------------\ | |  | | /-----------------------------------------------------------\ | |      |         +-----+---------------------------------------------------\                                           |
| | | | NUMANode L#1 P#1 (64GB)                                   | | |  | | | NUMANode L#3 P#3 (64GB)                                   | | |      |          1.0  | Ethernet (Broadcom NetXtreme II BCM5709): 02:00.1 |                                           |
| | | \-----------------------------------------------------------/ | |  | | \-----------------------------------------------------------/ | |      |               |                                                   |                                           |
| | |                                                               | |  | |                                                               | |      |               | /----------\                                      |                                           |
| | | /-------------\  /-------------\              /-------------\ | |  | | /-------------\  /-------------\              /-------------\ | |      |               | | Net eth3 |                                      |                                           |
| | | | Core L#8    |  | Core L#9    |  ++  ++  ++  | Core L#15   | | |  | | | Core L#24   |  | Core L#25   |  ++  ++  ++  | Core L#31   | | |      |               | \----------/                                      |                                           |
| | | |             |  |             |              |             | | |  | | |             |  |             |              |             | | |      |               \---------------------------------------------------/                                           |
| | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |  | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |      |                                                                                                               |
| | | | | PU L#8  | |  | | PU L#9  | |              | | PU L#15 | | | |  | | | | PU L#24 | |  | | PU L#25 | |              | | PU L#31 | | | |      +-----++--------++--+-----++--------+--------------------------------------------------------\                  |
| | | | |         | |  | |         | |              | |         | | | |  | | | |         | |  | |         | |              | |         | | | |      |4.0       4.0      |2.0       2.0  | RAID (Broadcom MegaRAID SAS 2108 [Liberator]): 05:00.0 |                  |
| | | | |   P#8   | |  | |   P#9   | |              | |  P#15   | | | |  | | | |  P#24   | |  | |  P#25   | |              | |  P#31   | | | |      |                   |               |                                                        |                  |
| | | | \---------/ |  | \---------/ |              | \---------/ | | |  | | | \---------/ |  | \---------/ |              | \---------/ | | |      |                   |               | /-----------\  /-----------\                           |                  |
| | | \-------------/  \-------------/              \-------------/ | |  | | \-------------/  \-------------/              \-------------/ | |      |                   |               | | Block sdb |  | Block sda |                           |                  |
| | \---------------------------------------------------------------/ |  | \---------------------------------------------------------------/ |      |                   |               | |           |  |           |                           |                  |
| \-------------------------------------------------------------------/  \-------------------------------------------------------------------/      |                   |               | | 744 GB    |  | 272 GB    |                           |                  |
|                                                                                                                                                   |                   |               | \-----------/  \-----------/                           |                  |
| /-------------------------------------------------------------------\  /-------------------------------------------------------------------\      |                   |               \--------------------------------------------------------/                  |
| | Package L#2                                                       |  | Package L#3                                                       |      |                   |                                                                                           |
| |                                                                   |  |                                                                   |      |                   +-----++--+-----+-------------------------------------------------------------------------\ |
| | /---------------------------------------------------------------\ |  | /---------------------------------------------------------------\ |      |                    4.0      |4.0  | Ethernet (Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection) 08:00.0 | |
| | | Die L#4                                                       | |  | | Die L#6                                                       | |      |                             |     |                                                                         | |
| | |                                                               | |  | |                                                               | |      |                             |     | /----------\                                                            | |
| | | /-----------------------------------------------------------\ | |  | | /-----------------------------------------------------------\ | |      |                             |     | | Net eth4 |                                                            | |
| | | | NUMANode L#4 P#4 (64GB)                                   | | |  | | | NUMANode L#6 P#6 (64GB)                                   | | |      |                             |     | \----------/                                                            | |
| | | \-----------------------------------------------------------/ | |  | | \-----------------------------------------------------------/ | |      |                             |     \-------------------------------------------------------------------------/ |
| | |                                                               | |  | |                                                               | |      |                             |                                                                                 |
| | | /-------------\  /-------------\              /-------------\ | |  | | /-------------\  /-------------\              /-------------\ | |      |                             +-----+-------------------------------------------------------------------------\ |
| | | | Core L#32   |  | Core L#33   |  ++  ++  ++  | Core L#39   | | |  | | | Core L#48   |  | Core L#49   |  ++  ++  ++  | Core L#55   | | |      |                              4.0  | Ethernet (Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection) 08:00.1 | |
| | | |             |  |             |              |             | | |  | | |             |  |             |              |             | | |      |                                   |                                                                         | |
| | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |  | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |      |                                   | /----------\                                                            | |
| | | | | PU L#32 | |  | | PU L#33 | |              | | PU L#39 | | | |  | | | | PU L#48 | |  | | PU L#49 | |              | | PU L#55 | | | |      |                                   | | Net eth5 |                                                            | |
| | | | |         | |  | |         | |              | |         | | | |  | | | |         | |  | |         | |              | |         | | | |      |                                   | \----------/                                                            | |
| | | | |  P#32   | |  | |  P#33   | |              | |  P#39   | | | |  | | | |  P#48   | |  | |  P#49   | |              | |  P#55   | | | |      |                                   \-------------------------------------------------------------------------/ |
| | | | \---------/ |  | \---------/ |              | \---------/ | | |  | | | \---------/ |  | \---------/ |              | \---------/ | | |      |                                                                                                               |
| | | \-------------/  \-------------/              \-------------/ | |  | | \-------------/  \-------------/              \-------------/ | |      +-----+-----------------------------------------------------------------------\                                 |
| | \---------------------------------------------------------------/ |  | \---------------------------------------------------------------/ |      |     | SATA (Advanced SB7x0/SB8x0/SB9x0 SATA Controller [IDE mode]): 00:11.0 |                                 |
| |                                                                   |  |                                                                   |      |     |                                                                       |                                 |
| | /---------------------------------------------------------------\ |  | /---------------------------------------------------------------\ |      |     | /-----------\                                                         |                                 |
| | | Die L#5                                                       | |  | | Die L#7                                                       | |      |     | | Block sr0 |                                                         |                                 |
| | |                                                               | |  | |                                                               | |      |     | |           |                                                         |                                 |
| | | /-----------------------------------------------------------\ | |  | | /-----------------------------------------------------------\ | |      |     | | 1023 MB   |                                                         |                                 |
| | | | NUMANode L#5 P#5 (64GB)                                   | | |  | | | NUMANode L#7 P#7 (64GB)                                   | | |      |     | \-----------/                                                         |                                 |
| | | \-----------------------------------------------------------/ | |  | | \-----------------------------------------------------------/ | |      |     \-----------------------------------------------------------------------/                                 |
| | |                                                               | |  | |                                                               | |      |                                                                                                               |
| | | /-------------\  /-------------\              /-------------\ | |  | | /-------------\  /-------------\              /-------------\ | |      +-----++--------+------------------------------------------\                                                    |
| | | | Core L#40   |  | Core L#41   |  ++  ++  ++  | Core L#47   | | |  | | | Core L#56   |  | Core L#57   |  ++  ++  ++  | Core L#63   | | |                      | VGA (Matrox MGA G200eW WPCM450): 0a:03.0 |                                                    |
| | | |             |  |             |              |             | | |  | | |             |  |             |              |             | | |                      \------------------------------------------/                                                    |
| | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |  | | | /---------\ |  | /---------\ |   8x total   | /---------\ | | |                                                                                                                      |
| | | | | PU L#40 | |  | | PU L#41 | |              | | PU L#47 | | | |  | | | | PU L#56 | |  | | PU L#57 | |              | | PU L#63 | | | |                                                                                                                      |
| | | | |         | |  | |         | |              | |         | | | |  | | | |         | |  | |         | |              | |         | | | |                                                                                                                      |
| | | | |  P#40   | |  | |  P#41   | |              | |  P#47   | | | |  | | | |  P#56   | |  | |  P#57   | |              | |  P#63   | | | |                                                                                                                      |
| | | | \---------/ |  | \---------/ |              | \---------/ | | |  | | | \---------/ |  | \---------/ |              | \---------/ | | |                                                                                                                      |
| | | \-------------/  \-------------/              \-------------/ | |  | | \-------------/  \-------------/              \-------------/ | |                                                                                                                      |
| | \---------------------------------------------------------------/ |  | \---------------------------------------------------------------/ |                                                                                                                      |
| \-------------------------------------------------------------------/  \-------------------------------------------------------------------/                                                                                                                      |
\-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------/
/-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------\
| Host: ...08-04                                                                                                                                                                                                                                                 \-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant