Bus error when running test XTRX Pro PCIe with a Jetson Xaver NX

[enjector]

I have installed XTRX pro with a Jetson Xaver using PCIe. All looks good but I get a bus error when I try the test. Any ideas?

$ sudo lspci -v -d 10ee:
0004:01:00.0 Memory controller: Xilinx Corporation Device 7012
Subsystem: Xilinx Corporation Device 0007
Flags: bus master, fast devsel, latency 0, IRQ 554
Memory at 1740010000 (32-bit, non-prefetchable) [size=4K]
Memory at 1740000000 (32-bit, non-prefetchable) [size=64K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=4/16 Maskable- 64bit+
Capabilities: [60] Express Endpoint, MSI 04
Capabilities: [100] Device Serial Number 00-00-00-00-12-34-56-78
Kernel driver in use: xtrx
Kernel modules: xtrx

$ sudo ./test_xtrx -t -l2
Master: 32.000 MHz; RX rate: 4.000 MHz; TX rate: 0.000 MHz
RX tunned: 900000000.000000
RX bandwidth: 2000000.000000
RX LNA gain: 15.000000
RX PGA gain: 0.000000
RX TIA gain: 9.000000
RX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1)
Bus error

$ dmesg

[ 750.130714] xtrx: call: REGION=1 VMA=ffffffc1736036e0 vma->vm_pgoff=0
[ 750.130861] xtrx: VMA open, virt 7f9c18f000, phys 0
[ 750.130970] xtrx: call: REGION=0 VMA=ffffffc1736034d0 vma->vm_pgoff=1024
[ 750.131087] xtrx: VMA open, virt 7f9c18e000, phys 400000
[ 750.141340] xtrx: ioctl(12345b, 1) [ffffff800bfad000]
[ 750.141502] xtrx: 3V3 CTRL:1
[ 750.347480] xtrx: ioctl(12345b, 1) [ffffff800bfad000]
[ 750.417835] xtrx: ioctl(12345a, 10000) [ffffff800bfad000]
[ 750.417987] xtrx: call: REGION=3 VMA=ffffffc1554b86e0 vma->vm_pgoff=16384
[ 750.418135] xtrx: ioctl(123459, 10000) [ffffff800bfad000]
[ 750.418299] Unhandled fault: implementation fault (unsupported exclusive) (0x92000035) at 0x0000007f9c18e008
[ 750.895577] xtrx: VMA close.
[ 750.895669] xtrx: VMA close.
[ 750.895777] xtrx: 3V3 CTRL:0

[enjector]

I just tried increasing the coherent_pool, but I still got the same problem:

user@user-desktop:/boot/extlinux$ more extlinux.conf
TIMEOUT 30
DEFAULT primary

MENU TITLE L4T boot options

LABEL primary
MENU LABEL primary kernel
LINUX /boot/Image
INITRD /boot/initrd
APPEND ${cbootargs} quiet vmalloc=512M cma=64M coherent_pool=32M

[enjector]

Looks like I found the problem using gdb ./test_xrtx

In xtrxll_pcie_linux.c:503: this is not supported on the ARM proc:

uint32_t icnt = __atomic_exchange_n((uint32_t*)dev->mmap_stat_buf + XTRX_KERN_MMAP_RX_IRQS,
									0, __ATOMIC_SEQ_CST);

Workaround (a kludge!):

uint32_t* p = (uint32_t*) dev->mmap_stat_buf + XTRX_KERN_MMAP_RX_IRQS;
uint32_t icnt = *p;
*p = 0;

Do this for TX on line 642

And now I get a good result:

RX:

$ ./test_xtrx -t -l2
Master: 32.000 MHz; RX rate: 4.000 MHz; TX rate: 0.000 MHz
RX tunned: 900000000.000000
RX bandwidth: 2000000.000000
RX LNA gain: 15.000000
RX PGA gain: 0.000000
RX TIA gain: 9.000000
RX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1)
PROCESSED RX SLICE 0 /0: res 0 TS: 8192 4182 us DELTA 61 us LATE 2195 us 16384 samples
RX STAT Overruns:0
Success!
Processed 1 devs, each: RX 2 x 1.836 = 3.672 MSPS (WIRE: 14.688163) TX 2 x 0.000 = 0.000 MSPS (WIRE: 0.000000 MB/s)

TX:

$ ./test_xtrx -T -l2
Master: 64.000 MHz; RX rate: 0.000 MHz; TX rate: 4.000 MHz
TX tunned: 450000000.000000
TX bandwidth: 2000000.000000
TX PAD gain: 0.000000
TX CYCLES=1 SAMPLES=16384 SLICE=16384 (PARTS=1)
PROCESSED TX SLICE 0/0: res 0 TS: 0 250 us DELTA 58 us LATE -1739 us 16384 x 1 samples (16384)
TX STAT Underruns:0
Success!
Processed 1 devs, each: RX 2 x 0.000 = 0.000 MSPS (WIRE: 0.000000) TX 2 x 21.623 = 43.247 MSPS (WIRE: 172.987583 MB/s)

TODO: Need too look at the supported atomic exchange primitives.

[WilfredoLora]

Hi, Do we replace the line with your workaround or add below it? and is it line 632?

[WilfredoLora]

Also, does line 503-505 need to be uncommented? I cant tell from the instructions above what it should be. Thanks.

[WilfredoLora]

Bump....Can anyone help with this?

Thank you!!

[WilfredoLora]

@enjector can you help me with this, please? Thanks!!

[enjector]

Hi, just saw your messages. Yes, I had to replace those lines at 503.