Retry chain swap server lockup tx verification

[dangeross]

This PR retries adds monitoring of the incoming server lockup txs. If a server lockup tx is confirmed without a claim (tx failed verification when receiving the Boltz status), then perform the claim.

Fixes #547

[roeierez]

The concern here is that it will block the event status polling loop and may block other payment statuses.

[dangeross]

I think it would take a only couple of attempts to get the confirmation, it testing it was confirmed in the first request. Maybe it's better to add it to the tracking thread to verify and claim if needed

[dangeross]

I was able to catch a failed confirmation and see it picked up in the monitoring thread

[2024-11-10 21:03:35.587 INFO breez_sdk_liquid::chain_swap:323] Handling incoming Chain Swap transition to "transaction.server.confirmed" for swap 4HxGzWthwwaU
[2024-11-10 21:03:38.081 INFO breez_sdk_liquid::chain::liquid:250] Liquid transaction found, verifying transaction content...
[2024-11-10 21:03:38.083 INFO breez_sdk_liquid::chain_swap:732] Transitioning Chain swap 4HxGzWthwwaU to Pending (server_lockup_tx_id = Some("8af223ba1e7ccd05cac077a700cf90fd6f93955e1ea9161bbf9f49c288c33d05"), user_lockup_tx_id = None, claim_tx_id = None), refund_tx_id = None)
[2024-11-10 21:03:38.085 WARN breez_sdk_liquid::chain_swap:413] Server lockup transaction for incoming Chain Swap 4HxGzWthwwaU could not be verified. txid: 8af223ba1e7ccd05cac077a700cf90fd6f93955e1ea9161bbf9f49c288c33d05, err: Liquid transaction was not confirmed, txid=8af223ba1e7ccd05cac077a700cf90fd6f93955e1ea9161bbf9f49c288c33d05 waiting for confirmation

...

[2024-11-10 21:04:33.569 INFO breez_sdk_liquid::chain_swap:227] Rescanning 1 incoming Chain Swap(s) server lockup txs at height 3114131
[2024-11-10 21:04:33.846 INFO breez_sdk_liquid::chain_swap:261] Incoming Chain Swap 4HxGzWthwwaU server lockup tx is confirmed
[2024-11-10 21:04:33.847 DEBUG breez_sdk_liquid::chain_swap:770] Initiating claim for Chain Swap 4HxGzWthwwaU
[2024-11-10 21:04:42.730 INFO breez_sdk_liquid::chain_swap:732] Transitioning Chain swap 4HxGzWthwwaU to Pending (server_lockup_tx_id = None, user_lockup_tx_id = None, claim_tx_id = Some("bbe1b7dda86030489461784ffd70b31ff94531c65190a0607617533523050d55")), refund_tx_id = None)
[2024-11-10 21:04:42.735 INFO breez_liquid_cli:46] Received event: PaymentWaitingConfirmation { details: Payment { destination: Some("lq1qqg6vf68kjwdgalvv3gt58h5fvaz73lmxngq6xnjr62gwhwj6gwrvxmwszry4afz5gka38pys3srkkq22dt9w5tzc8stjm5xy9"), tx_id: Some("bbe1b7dda86030489461784ffd70b31ff94531c65190a0607617533523050d55"), timestamp: 1731269082, amount_sat: 49155, fees_sat: 845, payment_type: Receive, status: Pending, details: Bitcoin { swap_id: "4HxGzWthwwaU", description: "Bitcoin transfer", refund_tx_id: None, refund_tx_amount_sat: None } } }

[roeierez]

LGTM