Lightning: ONCHAIN:Owning subdaemon lightning_onchaind died, cannot close channel.
lightning-cli listpeers 03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 debug
{
"peers" : [
{
"id" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618",
"connected" : false,
"channels" : [
{
"state" : "ONCHAIN",
"scratch_txid" : "722983619428e0759d41c75cc29cd6184b09b335a0a20437964155ecc6382aa0",
"short_channel_id" : "585918x1894x0",
"direction" : 0,
"channel_id" : "ec16f9062498cf20de01267265ebe4558751cb0285b562837f4e097c84818b3e",
"funding_txid" : "3e8b81847c094e7f8362b58502cb518755e4eb65722601de20cf982406f916ec",
"private" : false,
"funding_allocation_msat" : {
"03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618" : 0,
"03baa70886d9200af0ffbd3f9e18d96008331c858456b16e3a9b41e735c6208fef" : 16700000000
},
"funding_msat" : {
"03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618" : "0msat",
"03baa70886d9200af0ffbd3f9e18d96008331c858456b16e3a9b41e735c6208fef" : "16700000000msat"
},
"msatoshi_to_us" : 16700000000,
"to_us_msat" : "16700000000msat",
"msatoshi_to_us_min" : 16700000000,
"min_to_us_msat" : "16700000000msat",
"msatoshi_to_us_max" : 16700000000,
"max_to_us_msat" : "16700000000msat",
"msatoshi_total" : 16700000000,
"total_msat" : "16700000000msat",
"dust_limit_satoshis" : 546,
"dust_limit_msat" : "546000msat",
"max_htlc_value_in_flight_msat" : 18446744073709551615,
"max_total_htlc_in_msat" : "18446744073709551615msat",
"their_channel_reserve_satoshis" : 167000,
"their_reserve_msat" : "167000000msat",
"our_channel_reserve_satoshis" : 167000,
"our_reserve_msat" : "167000000msat",
"spendable_msatoshi" : 4294967295,
"spendable_msat" : "4294967295msat",
"htlc_minimum_msat" : 0,
"minimum_htlc_in_msat" : "0msat",
"their_to_self_delay" : 144,
"our_to_self_delay" : 2006,
"max_accepted_htlcs" : 483,
"status" : [
"ONCHAIN:Owning subdaemon lightning_onchaind died (61952)"
],
"in_payments_offered" : 0,
"in_msatoshi_offered" : 0,
"in_offered_msat" : "0msat",
"in_payments_fulfilled" : 0,
"in_msatoshi_fulfilled" : 0,
"in_fulfilled_msat" : "0msat",
"out_payments_offered" : 3,
"out_msatoshi_offered" : 9647893215,
"out_offered_msat" : "9647893215msat",
"out_payments_fulfilled" : 0,
"out_msatoshi_fulfilled" : 0,
"out_fulfilled_msat" : "0msat",
"htlcs" : [
{
"direction" : "out",
"id" : 2,
"msatoshi" : 3215967215,
"amount_msat" : "3215967215msat",
"expiry" : 586034,
"payment_hash" : "dc14f9a26bbe1d072711e66f29f855b11669522f1538057f81349b59e9325d05",
"state" : "SENT_ADD_ACK_REVOCATION"
}
]
}
],
"log" : [
{
"type" : "UNUSUAL",
"time" : "0.112705614",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Peer permanent failure in ONCHAIN: Funding transaction spent"
},
{
"type" : "INFO",
"time" : "0.113357816",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "State changed from ONCHAIN to FUNDING_SPEND_SEEN"
},
{
"type" : "DEBUG",
"time" : "0.114818022",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "pid 30055, msgfd 42"
},
{
"type" : "DEBUG",
"time" : "0.115405524",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "We want to know if htlc 2 is missing (immediate)"
},
{
"type" : "DEBUG",
"time" : "0.150894454",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "feerate_per_kw = 14785"
},
{
"type" : "DEBUG",
"time" : "0.158542682",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Tracking output 0 of 3e8b81847c094e7f8362b58502cb518755e4eb65722601de20cf982406f916ec: FUNDING_TRANSACTION/FUNDING_OUTPUT"
},
{
"type" : "DEBUG",
"time" : "0.159213485",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Remote per-commit point: 02e2df0dca7138c8de29aa3cef35ec6b9add8b3d637d4a40af65cc1aec70e3ddaf"
},
{
"type" : "DEBUG",
"time" : "0.176258947",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Old remote per-commit point: 02a9e166492915abe214027e5302db841542a10b7b77657316f89bb6063bbf7abe"
},
{
"type" : "DEBUG",
"time" : "0.184121876",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "commitnum = 75, revocations_received = 75"
},
{
"type" : "INFO",
"time" : "0.185090080",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "State changed from FUNDING_SPEND_SEEN to ONCHAIN"
},
{
"type" : "DEBUG",
"time" : "0.209749370",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Resolved FUNDING_TRANSACTION/FUNDING_OUTPUT by OUR_UNILATERAL (722983619428e0759d41c75cc29cd6184b09b335a0a20437964155ecc6382aa0)"
},
{
"type" : "DEBUG",
"time" : "0.210335772",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Deconstructing unilateral tx: 75 using keyset: self_revocation_key: 030fb51f58803399e67f3c763da9aa660dc69e5fa4bbcab64f552fc5d5fecbbfff self_delayed_payment_key: 02bbc30a57071afe815b0aa8868f4f95ac4eaa7b9caa6dd5208980075bef40a334 self_payment_key: 03b4a0ba6058c8ed4a9f920917ec16f001a1fecbda3644872415543c7d812e068f other_payment_key: 031e66b238284d5523c9c3fc2197dfa0d521db9efdb62679d62261171935ac938d self_htlc_key: 026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e7 other_htlc_key: 03f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da6"
},
{
"type" : "DEBUG",
"time" : "0.210920574",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Script to-me: 2006: 00208bfadb3554f41cc06f00de0ec2e2f91e36ee45b5006a1f606146784755356ba5 (6321030fb51f58803399e67f3c763da9aa660dc69e5fa4bbcab64f552fc5d5fecbbfff6702d607b2752102bbc30a57071afe815b0aa8868f4f95ac4eaa7b9caa6dd5208980075bef40a33468ac)"
},
{
"type" : "DEBUG",
"time" : "0.227159334",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Script to-them: 0014d2a6229de49db6c9a64843d165758ac8cd9f4b4d"
},
{
"type" : "DEBUG",
"time" : "0.227904637",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Output 0: 002098f680bb0b08b9e355bf86f935224e73d3c6038b265024d682e9da5cdeba9a0f"
},
{
"type" : "DEBUG",
"time" : "0.228801540",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Output 1: 00208bfadb3554f41cc06f00de0ec2e2f91e36ee45b5006a1f606146784755356ba5"
},
{
"type" : "DEBUG",
"time" : "0.229479242",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Tracking output 0 of 722983619428e0759d41c75cc29cd6184b09b335a0a20437964155ecc6382aa0: OUR_UNILATERAL/OUR_HTLC"
},
{
"type" : "BROKEN",
"time" : "0.696076955",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "No valid signature found for 3 htlc_timeout_txs feerate 10992-15370, last tx 0200000001a02a38c6ec5541963704a2a035b3094b18d69cc25cc7419d75e02894618329720000000000000000000191ea3000000000002200208bfadb3554f41cc06f00de0ec2e2f91e36ee45b5006a1f606146784755356ba532f10800, input 3215967sat, signature 3045022100917efdc8577e8578aef5e513fad25edbb55921466e8ffccb05ce8bb05a54ae6902205c2fded9d7bfc290920821bfc828720bc24287f3dad9a62fb4f806e2404ed0f401, cltvs 585998/585998/586034 wscripts 76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868 (version v0.7.1-57-gb3215a8)"
},
{
"type" : "BROKEN",
"time" : "0.699691068",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: common/daemon.c:45 (send_backtrace) 0x556d874c67c2"
},
{
"type" : "BROKEN",
"time" : "0.700284470",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: common/status.c:192 (status_failed) 0x556d874c96ce"
},
{
"type" : "BROKEN",
"time" : "0.703184881",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: onchaind/onchaind.c:1491 (resolve_our_htlc_ourcommit) 0x556d874c1951"
},
{
"type" : "BROKEN",
"time" : "0.704025884",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: onchaind/onchaind.c:1855 (handle_our_unilateral) 0x556d874c1fd6"
},
{
"type" : "BROKEN",
"time" : "0.714122321",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: onchaind/onchaind.c:2606 (main) 0x556d874c359a"
},
{
"type" : "BROKEN",
"time" : "0.724903160",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: (null):0 ((null)) 0x7f66c7fdb09a"
},
{
"type" : "BROKEN",
"time" : "0.725323062",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: (null):0 ((null)) 0x556d874bec69"
},
{
"type" : "BROKEN",
"time" : "0.726150365",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "backtrace: (null):0 ((null)) 0xffffffffffffffff"
},
{
"type" : "BROKEN",
"time" : "0.726651467",
"source" : "lightning_onchaind-03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "STATUS_FAIL_INTERNAL_ERROR: No valid signature found for 3 htlc_timeout_txs feerate 10992-15370, last tx 0200000001a02a38c6ec5541963704a2a035b3094b18d69cc25cc7419d75e02894618329720000000000000000000191ea3000000000002200208bfadb3554f41cc06f00de0ec2e2f91e36ee45b5006a1f606146784755356ba532f10800, input 3215967sat, signature 3045022100917efdc8577e8578aef5e513fad25edbb55921466e8ffccb05ce8bb05a54ae6902205c2fded9d7bfc290920821bfc828720bc24287f3dad9a62fb4f806e2404ed0f401, cltvs 585998/585998/586034 wscripts 76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868"
},
{
"type" : "BROKEN",
"time" : "0.726816767",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Owning subdaemon lightning_onchaind died (61952)"
},
{
"type" : "DEBUG",
"time" : "3.689169833",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Got depth change 0->204 for 3e8b81847c094e7f8362b58502cb518755e4eb65722601de20cf982406f916ec"
},
{
"type" : "DEBUG",
"time" : "3.689195533",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Funding tx 3e8b81847c094e7f8362b58502cb518755e4eb65722601de20cf982406f916ec depth 204 of 5"
},
{
"type" : "DEBUG",
"time" : "3.689287833",
"source" : "03d37fca0656558de4fd86bbe490a38d84a46228e7ec1361801f54f9437a18d618 chan #22979:",
"log" : "Funding tx 3e8b81847c094e7f8362b58502cb518755e4eb65722601de20cf982406f916ec confirmed, but peer in state ONCHAIN"
}
]
}
]
}
bug
mb300sd
All 6 comments
The important log line is this one:
STATUS_FAIL_INTERNAL_ERROR: No valid signature found for 3 htlc_timeout_txs feerate 10992-15370, last tx 0200000001a02a38c6ec5541963704a2a035b3094b18d69cc25cc7419d75e02894618329720000000000000000000191ea3000000000002200208bfadb3554f41cc06f00de0ec2e2f91e36ee45b5006a1f606146784755356ba532f10800, input 3215967sat, signature 3045022100917efdc8577e8578aef5e513fad25edbb55921466e8ffccb05ce8bb05a54ae6902205c2fded9d7bfc290920821bfc828720bc24287f3dad9a62fb4f806e2404ed0f401, cltvs 585998/585998/586034 wscripts 76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868/76a914f454b1fe5b95428d6beec58ed3131a6ea611b2fa8763ac672103f83ca95b22920e71487736a7284696dd52443fd8f7ce683153ac31d1d1db7da67c820120876475527c21026ebaa1d08757b86110e40e3f4a081803eec694e23ec75ee0bfd753589df896e752ae67a9148dbcec4a5d782dd87588801607ea7dfc8874ffee88ac6868"
cdecker
on 12 Aug 2019
Can I broadcast that tx to recover funds? I can't figure out how to do it.
mb300sd
on 13 Aug 2019
OK, the problem is we can't figure out what the tx they signed looks like. This Shouldn't Happen: we had a valid signature, but now we don't.
~Unfortunately, I can't try it here, since I don't know some important values (in particular, keyset->other_htlc_key). There are two things to do:~
~1. I would like a copy of your lightningd.sqlite3 file. Revealing this will reveal all your activity, so it's a privacy leak (won't let me steal funds from you though; the key is kept separately). Understand if you don't want to do this! You can email me, gpg encrypt, whatever works for you.~
~2. If we can't fix it, I can write an emergency mode for onchaind which will at least let it limp along, though these funds will be lost (you'll get rest of channel though). I'd prefer not to do that obviously!~
~Thanks for your patience...~
Nope, got it. Fix on the way...
rustyrussell
on 13 Aug 2019
👍2
Does this mean I can upgrade to master and it'll resolve itself? My VPN is acting up and I haven't been home to access the node for a few days.
mb300sd
on 14 Aug 2019
Does this mean I can upgrade to master and it'll resolve itself? My VPN is acting up and I haven't been home to access the node for a few days.
That should indeed be the case. Let us know if it works :wink:
cdecker
on 14 Aug 2019
Working now! :)
"ONCHAIN:Tracking our own unilateral close",
"ONCHAIN:3 outputs unresolved: in 2005 blocks will spend DELAYED_OUTPUT_TO_US (4580e8b7acb8ed3f6b4ea0d35c748d41ffb2c394d02a944bd49b9f3f4fe2c8a0:0) using OUR_DELAYED_RETURN_TO_WALLET"
mb300sd
on 15 Aug 2019
🚀1
❤1
Was this page helpful?
0 / 5 - 0 ratings
Related issues
cdecker
路
4Comments
agilob
路
4Comments
brunoaduarte
路
4Comments
SPIRY-RO
路
4Comments
Xian001
路
3Comments
Most helpful comment
Working now! :)
"ONCHAIN:Tracking our own unilateral close",
"ONCHAIN:3 outputs unresolved: in 2005 blocks will spend DELAYED_OUTPUT_TO_US (4580e8b7acb8ed3f6b4ea0d35c748d41ffb2c394d02a944bd49b9f3f4fe2c8a0:0) using OUR_DELAYED_RETURN_TO_WALLET"