mirror of
https://github.com/Ride-The-Lightning/RTL.git
synced 2026-08-13 12:33:07 +02:00
* Add a BTCPay Server SSO harness to the docker fixture
BTCPay bundles RTL and runs it in single-sign-on mode, reached over an entry
path the standalone login never exercises: no password, a rotating cookie file,
an unregistered /rtl/api/authenticate/cookie URL that falls through to the
catch-all in server/utils/app.ts, and a reverse proxy in front. Regressions on
that path have previously gone unnoticed until they reached BTCPay users.
Adds an "sso" compose profile, so a plain `docker compose up -d` is unchanged:
- rtl-sso, a second RTL running with RTL_SSO=1, RTL_COOKIE_PATH and
LOGOUT_REDIRECT_LINK -- the environment block lifted verbatim from BTCPay's
own compose fragment, so this exercises the env-driven SSO path BTCPay
actually uses. A second container is required because RTL selects one
authentication mode at startup, so SSO and password login cannot coexist in
one instance.
- rtl-sso-config-init, staging rtl/RTL-Config.sso.json into a volume -- the
same copy-into-a-volume dance the standalone RTL already needs, because RTL
rewrites its config on startup.
- rtl-sso-proxy, nginx standing in for BTCPay's traefik, routing only /rtl
and /rtl/* exactly as BTCPay's router rule does. There is no prefix
stripping anywhere: RTL is built with <base href="/rtl/"> and mounts every
route under baseHref '/rtl', so the prefix is passed through unmodified.
Everything outside /rtl 404s, so a request escaping the prefix surfaces as
a failure rather than being quietly served.
scripts/verify-sso.sh asserts the whole flow in 11 checks -- prefix routing,
CSRF token minting on the catch-all, the sha256 access-key handshake, an
authenticated node call, cookie rotation on login, and rejection of a wrong key
-- and exits non-zero so it can gate a change. bin/sso-url prints the link
BTCPay renders on its Services page. RTL_IMAGE overrides both RTL containers at
once, so a branch build gets tested through both entry paths.
BTCPay itself (postgres, nbxplorer, btcpayserver) is deliberately not included;
the README documents what that leaves untested and how to run against BTCPay's
own regtest stack when the question is BTCPay's behaviour rather than RTL's.
Also bumps the fixture's default RTL image from v0.15.8 to v0.15.10.
* Document the SSO harness in the rtl-docker-fixture skill
* Point CLAUDE.md at the BTCPay SSO harness
* Note that no CI runs on an open PR
278 lines
12 KiB
Markdown
278 lines
12 KiB
Markdown
# RTL regtest dev fixture
|
||
|
||
### NOT suitable for production. Development only. Every credential here is throwaway.
|
||
|
||
A self-contained regtest network for developing and testing RTL: `bitcoind`, three
|
||
LND nodes, a Core Lightning node, an Eclair node, and RTL wired to all five.
|
||
|
||
```
|
||
alice --[ 5,000,000 sat ]--> bob --[ 3,000,000 sat ]--> carol
|
||
cln --[ 4,000,000 sat ]--> alice
|
||
eclair --[ 3,500,000 sat ]--> bob
|
||
```
|
||
|
||
## Topology
|
||
|
||
```mermaid
|
||
flowchart TB
|
||
subgraph chain["Chain backend"]
|
||
bitcoind["bitcoind (regtest)<br/>RPC · ZMQ rawblock/rawtx · ZMQ hashblock"]
|
||
end
|
||
|
||
subgraph ln["Lightning nodes"]
|
||
alice["alice (LND)"]
|
||
bob["bob (LND)<br/>forwards payments"]
|
||
carol["carol (LND)"]
|
||
cln["cln (Core Lightning)"]
|
||
eclair["eclair (Eclair)"]
|
||
end
|
||
|
||
alice =="5M sat"==> bob
|
||
bob =="3M sat"==> carol
|
||
cln =="4M sat"==> alice
|
||
eclair =="3.5M sat"==> bob
|
||
|
||
alice -.-> bitcoind
|
||
bob -.-> bitcoind
|
||
carol -.-> bitcoind
|
||
cln -.-> bitcoind
|
||
eclair -.->|"dedicated 'eclair' wallet<br/>+ hashblock ZMQ"| bitcoind
|
||
|
||
rtl["RTL<br/>localhost:3000"]
|
||
rtl -->|"REST + macaroon"| alice
|
||
rtl -->|"REST + macaroon"| bob
|
||
rtl -->|"REST + macaroon"| carol
|
||
rtl -->|"clnrest + rune"| cln
|
||
rtl -->|"HTTP API + basic auth"| eclair
|
||
```
|
||
|
||
Thick arrows are channels (opener → peer), dotted arrows the chain backend each node
|
||
uses, and solid arrows how RTL reaches each node.
|
||
|
||
bob sits in the middle so it accrues forwarding history, which is what gives RTL's
|
||
routing screens something to show. Two nodes would leave them empty. The `cln`
|
||
(Core Lightning) node gives RTL's CLN screens a real backend — it talks to RTL over
|
||
clnrest with rune auth. The `eclair` node does the same for RTL's Eclair screens —
|
||
RTL talks to its HTTP API with basic auth.
|
||
|
||
LND, bitcoind and Eclair images come from [Polar](https://lightningpolar.com); the Core
|
||
Lightning image is the official [`elementsproject/lightningd`](https://hub.docker.com/r/elementsproject/lightningd).
|
||
All are multi-arch (amd64 + arm64) and nothing is built locally, so this works on
|
||
Apple Silicon. (The official `acinq/eclair` image is amd64-only and its versioned tags
|
||
are years stale, which is why Polar's build of the same source is used instead.)
|
||
|
||
## Requirements
|
||
|
||
Docker with Compose v2 (`docker compose`, not `docker-compose`).
|
||
|
||
## Quick start
|
||
|
||
From this directory:
|
||
|
||
```bash
|
||
docker compose up -d # bitcoind, alice, bob, carol, cln, eclair, rtl
|
||
./scripts/seed.sh # fund, connect, open channels, make payments
|
||
```
|
||
|
||
To also bring up the BTCPay single-sign-on harness, add `--profile sso` — see
|
||
[BTCPay SSO harness](#btcpay-sso-harness).
|
||
|
||
Then open <http://localhost:3000> — password `rtldev`. All five nodes (alice, bob,
|
||
carol, cln, eclair) appear in the node switcher.
|
||
|
||
Tear down, discarding all state:
|
||
|
||
```bash
|
||
docker compose down -v
|
||
```
|
||
|
||
## What the seed creates
|
||
|
||
| | |
|
||
|---|---|
|
||
| On-chain | 10,000,000 sats per node (LND) + 10,000,000 sats each on cln and eclair, confirmed |
|
||
| Channels | alice→bob 5,000,000 · bob→carol 3,000,000 · eclair→bob 3,500,000 sats (1,000,000 pushed each) · cln→alice 4,000,000 sats (no push) |
|
||
| Routed payments | 5 × alice→carol via bob (10k, 25k, 50k, 75k, 100k sats) |
|
||
| Direct payments | 2 × alice→bob (5k, 15k sats) · 2 × eclair→bob (8k, 18k sats) |
|
||
| Open invoices | 2 unpaid on carol (20k, 40k sats) · 1 unpaid on eclair (30k sats) |
|
||
| Personas | alice + bob + cln + eclair OPERATOR, carol MERCHANT |
|
||
|
||
## Determinism
|
||
|
||
Every amount and payment in `scripts/seed.sh` is fixed. A fresh run always produces
|
||
identical state, so screenshots taken before and after a change differ only by the
|
||
change. **Do not introduce randomness.**
|
||
|
||
The seed is deterministic but deliberately *not* idempotent — running it twice would
|
||
fund every node again and open a second set of channels. It refuses to run against an
|
||
already-seeded network. To start over:
|
||
|
||
```bash
|
||
docker compose down -v && docker compose up -d && ./scripts/seed.sh
|
||
```
|
||
|
||
## Helpers
|
||
|
||
```bash
|
||
bin/b-cli getblockcount # bitcoin-cli
|
||
bin/b-cli -rpcwallet=rtldev getbalance
|
||
bin/ln-cli alice getinfo # lncli, node name required
|
||
bin/ln-cli bob listchannels
|
||
bin/ln-cli bob fwdinghistory # forwarding history
|
||
bin/e-cli getinfo # eclair-cli
|
||
bin/e-cli channels
|
||
bin/sso-url # BTCPay-style SSO link (needs --profile sso)
|
||
docker compose exec cln lightning-cli --network=regtest listpeerchannels # Core Lightning
|
||
```
|
||
|
||
Logs:
|
||
|
||
```bash
|
||
docker compose logs -f rtl
|
||
docker compose logs alice
|
||
```
|
||
|
||
## BTCPay SSO harness
|
||
|
||
BTCPay Server bundles RTL and runs it in single-sign-on mode, reached through a very
|
||
different entry path than the standalone login: no password, a rotating cookie, and a
|
||
reverse proxy in front. That path has broken before without the standalone flow
|
||
noticing, so the fixture can reproduce it.
|
||
|
||
It is behind a compose profile, so a plain `docker compose up -d` does not start it:
|
||
|
||
```bash
|
||
docker compose --profile sso up -d
|
||
./scripts/verify-sso.sh # 11 assertions over the whole entry path
|
||
open "$(bin/sso-url)" # or click through it yourself
|
||
```
|
||
|
||
`bin/sso-url` prints the link BTCPay renders on its Services page. Following it lands
|
||
you in RTL already authenticated, against the `alice` node.
|
||
|
||
### How the flow works
|
||
|
||
```mermaid
|
||
sequenceDiagram
|
||
participant B as Browser
|
||
participant P as rtl-sso-proxy<br/>(stands in for traefik)
|
||
participant R as rtl-sso<br/>(RTL_SSO=1)
|
||
participant C as .cookie<br/>(shared volume)
|
||
|
||
R->>C: writes 64 random bytes at startup
|
||
Note over B: bin/sso-url reads the cookie —<br/>BTCPay reads the same file
|
||
B->>P: GET /rtl/api/authenticate/cookie?access-key=<cookie>
|
||
P->>R: same URI, prefix passed through
|
||
R-->>B: not a registered route → catch-all:<br/>mints XSRF-TOKEN, serves index.html
|
||
B->>P: POST /rtl/api/authenticate<br/>{ PASSWORD, sha256(access-key) }
|
||
P->>R:
|
||
R->>C: matches → rotates the cookie
|
||
R-->>B: JWT
|
||
```
|
||
|
||
The three services are `rtl-sso-config-init` (stages `rtl/RTL-Config.sso.json`, same
|
||
copy-into-a-volume dance as the standalone RTL), `rtl-sso` (RTL with `RTL_SSO=1`,
|
||
`RTL_COOKIE_PATH` and `LOGOUT_REDIRECT_LINK` — the env block is lifted verbatim from
|
||
BTCPay's own compose fragment), and `rtl-sso-proxy` (nginx standing in for BTCPay's
|
||
traefik). `RTL_IMAGE` overrides both RTL containers at once, so a branch build gets
|
||
tested through both entry paths.
|
||
|
||
It is a second RTL container rather than a flag on the first because RTL picks one
|
||
authentication mode at startup — SSO and the password login cannot coexist in one
|
||
instance. Both are up at the same time on different ports.
|
||
|
||
### Things this makes visible
|
||
|
||
**No prefix stripping anywhere.** RTL is built with `<base href="/rtl/">` and mounts
|
||
every route under `baseHref '/rtl'`, so BTCPay's traefik — and the nginx here — pass
|
||
`/rtl/…` through unmodified. The proxy deliberately 404s everything outside `/rtl`, so
|
||
a request escaping the prefix shows up as a failure instead of being quietly served.
|
||
|
||
**The entry URL is not a real route.** `/rtl/api/authenticate/cookie` matches nothing in
|
||
`server/routes/shared/authenticate.ts`; it falls through to the catch-all in
|
||
`server/utils/app.ts`, which is what mints the `XSRF-TOKEN` cookie and serves the SPA.
|
||
The access-key is the raw cookie file content — the frontend sha256s it before posting
|
||
and the backend compares against `sha256(cookieValue)`.
|
||
|
||
**`GET /rtl/` mints no CSRF token.** That path is served by `express.static`, which
|
||
sits *above* the catch-all, so a client entering there has no `XSRF-TOKEN` and its first
|
||
POST gets a 403. Only the catch-all mints one. This is long-standing behaviour, not a
|
||
regression — but it is why `verify-sso.sh` always seeds its cookie jar from the entry
|
||
URL, and worth remembering before concluding that CSRF is broken.
|
||
|
||
**The cookie is effectively single-use.** Authenticating rotates it, so a stale
|
||
`bin/sso-url` link fails. BTCPay re-reads the file on every page render, which is why
|
||
this is invisible in normal use.
|
||
|
||
### What it does not cover
|
||
|
||
BTCPay itself is not here — no postgres, nbxplorer or btcpayserver container. So this
|
||
does not exercise BTCPay *generating* the link, its Services page, or its own upgrades.
|
||
For that, run BTCPay's own regtest stack and point it at a local image:
|
||
|
||
```bash
|
||
# in a btcpayserver-docker checkout, after building an RTL image locally
|
||
docker build -t shahanafarooqui/rtl:dev /path/to/RTL
|
||
# then edit the rtl image tag in the generated docker-compose, or set it in
|
||
# docker-compose-generator/docker-fragments/bitcoin-lnd.yml before generating
|
||
```
|
||
|
||
That tests the real composition rather than this reconstruction of it; the harness here
|
||
is the fast everyday check.
|
||
|
||
## Notes and gotchas
|
||
|
||
**RTL's config.** `rtl/RTL-Config.regtest.json` is the tracked template. RTL rewrites
|
||
its config on startup, so an init container copies it into a volume rather than
|
||
bind-mounting it — a read-only mount makes RTL exit with `EROFS`, and a writable one
|
||
would let RTL modify a version-controlled file. The name is not `RTL-Config.json`
|
||
because `.gitignore` matches that bare filename at any depth.
|
||
|
||
**`lncli` needs `--lnddir=/home/lnd/.lnd`.** `docker compose exec` lands as root,
|
||
whose HOME is `/root`, but lnd's datadir is `/home/lnd/.lnd`. `bin/ln-cli` handles this.
|
||
|
||
**Changing bitcoind credentials.** `docker-compose.yml` carries an `-rpcauth` hash for
|
||
the `BITCOIN_RPC_USER` / `BITCOIN_RPC_PASSWORD` in `.env`. Changing them there is not
|
||
enough; regenerate the hash:
|
||
|
||
```bash
|
||
python3 - <<'EOF'
|
||
import hmac, hashlib
|
||
user, password, salt = "rtldev", "rtldev", "8a1f2c3d4e5b6a7c8d9e0f1a2b3c4d5e"
|
||
print(f"{user}:{salt}${hmac.new(salt.encode(), password.encode(), hashlib.sha256).hexdigest()}")
|
||
EOF
|
||
```
|
||
|
||
In `docker-compose.yml` the `$` must be written `$$` to escape Compose interpolation.
|
||
|
||
**Payments right after channel open will fail.** The channel graph has to reach alice
|
||
before she can route to carol. The seed waits for this; anything you script yourself
|
||
should too.
|
||
|
||
**Core Lightning auth uses a rune.** RTL talks to `cln` over clnrest and authenticates
|
||
with a rune, not a macaroon. `cln/create-rune.sh` — run from the `cln` healthcheck —
|
||
creates a master rune once the RPC is up and writes it as `LIGHTNING_RUNE="…"` to
|
||
`rtl.rune` in the shared `cln_data` volume; RTL reads it via the `runePath` in its config.
|
||
The healthcheck reports unhealthy until that file exists, so RTL (which waits on
|
||
`service_healthy`) starts only once the rune is ready. Because it runs on every
|
||
healthcheck tick (idempotent), a transient RPC-startup race just retries and self-heals
|
||
rather than wedging the stack. `--clnrest-host=0.0.0.0` is required for RTL (another
|
||
container) to reach clnrest; the default `127.0.0.1` would only be reachable from inside
|
||
the node.
|
||
|
||
**Eclair has no wallet of its own.** It drives a bitcoind wallet over RPC. The
|
||
`eclair-wallet-init` service creates a dedicated `eclair` wallet before the node starts;
|
||
without it eclair would attach to "the default loaded wallet" — the `rtldev` mining
|
||
wallet — and report the miner's balance as its own. RTL authenticates to eclair with
|
||
`lnApiPassword` (HTTP basic auth), no file mount needed. Eclair also confirms channels
|
||
at 8 blocks (`channel.min-depth-blocks`), not 6 — the seed mines accordingly. And its
|
||
`bitcoind.zmqblock` must point at a `zmqpubhashblock` endpoint — wired to the rawblock
|
||
one LND uses, eclair never sees new blocks and channels never confirm.
|
||
|
||
## Not included
|
||
|
||
The Boltz swap service.
|
||
|
||
BTCPay Server itself (postgres + nbxplorer + btcpayserver). The `sso` profile
|
||
reproduces the entry path BTCPay uses to reach RTL without running BTCPay — see
|
||
[BTCPay SSO harness](#btcpay-sso-harness) for what that covers and what it does not.
|