Troubleshooting
This page covers the most common issues encountered when deploying and running RAVEN. These are hard-won lessons from real deployments.
BMP Issues
Routers Not Connecting
Symptom: raven peers shows no peers. raven status shows BMP listener
running but no sessions.
Check 1 — Is the BMP listener actually running?
If nothing shows, RAVEN is not listening. Check the logs:
Check 2 — Can the router reach RAVEN?
From the router, test connectivity to RAVEN's BMP port:
Check 3 — Firewall blocking the connection?
Check 4 — BMP config on the router correct?
Verify the destination IP and port match RAVEN's listen address exactly. A common mistake is configuring the router's management IP instead of the IP reachable from the router's BGP interfaces.
Check 5 — Is RAVEN rejecting the router?
If you set bmp.allowed-routers, RAVEN closes connections from any other
source and logs why:
The log line's remote field is the address the router connected from.
Routers often source BMP from a loopback rather than the interface facing
RAVEN; add that address to bmp.allowed-routers. The
raven_bmp_rejected_connections_total{reason="not_allowed"} counter rises
with each rejection.
Routes Not Appearing
Symptom: raven peers shows a peer UP but raven routes returns nothing
or very few routes.
Cause: The BMP table dump is still in progress. After a router connects, it sends a full table dump which can take 30-90 seconds for a full DFZ table.
Check:
The route count next to the peer should be increasing. Wait until it stabilises before expecting complete results.
If routes never appear:
Check whether the router is configured to send Adj-RIB-In Pre-Policy. Some router configurations only send Loc-RIB or post-policy by default: FRR — explicitly configure pre-policy bmp targets raven monitor ipv4 unicast pre-policy monitor ipv6 unicast pre-policy exit
All Routes Showing as Unverified
Symptom: Every route shows posture unverified. ROV state is NotFound
for all routes.
Cause: RAVEN has no VRPs — the RTR session to the validator is not working.
Check:
raven status
curl -s http://localhost:9595/metrics | grep -E 'raven_rtr_(session_state|vrp_count|last_sync_seconds|data_expired)'
raven status shows the VRP count on its RPKI: line. In the metrics,
raven_rtr_session_state of 0 means the session to that cache is down, and
an old raven_rtr_last_sync_seconds (a Unix timestamp) means syncs have
stopped completing.
If Routinator is not running:
Wait for it to sync (up to 4 minutes cold start, ~13 seconds warm start).
Malformed BGP Input
Symptom: RAVEN logs malformed BGP UPDATE from peer, the
raven_bmp_malformed_updates_total counter rises, or raven peers shows a
MALFORMED column.
What it means: a peer of your monitored router sent a BGP UPDATE that breaks the BGP encoding rules. Your router handled it under RFC 7606, and RAVEN, which sees the same UPDATE over BMP, handles it the same way. RAVEN applies RFC 7606 so that its route table holds what your router's Adj-RIB-In holds, which is the table RAVEN reports on. Silently dropping a bad UPDATE, as earlier releases did, left routes in RAVEN that the router had already withdrawn; accepting it would store routes with broken attributes.
RFC 7606 sorts errors into three classes, and RAVEN acts on each:
Class (action label) |
Errors that cause it | What RAVEN does |
|---|---|---|
attribute_discard |
A malformed AS4_PATH or AS4_AGGREGATOR (RFC 6793 §6); an attribute that appears more than once |
Drops the bad attribute and keeps the routes. A discarded AS4_PATH leaves the route with its AS_PATH as sent. Of a repeated attribute, the first copy is kept |
treat_as_withdraw |
A malformed or wrongly flagged ORIGIN, AS_PATH, NEXT_HOP, MULTI_EXIT_DISC, COMMUNITIES or LARGE_COMMUNITIES; from an internal (iBGP) peer, also LOCAL_PREF, ORIGINATOR_ID or CLUSTER_LIST; an attribute whose length runs past the others; a missing ORIGIN, AS_PATH, or NEXT_HOP for prefixes in the NLRI field |
Stores none of the UPDATE's routes and withdraws every prefix it announces, so no route with a half-parsed path reaches the table. A truncated AS_PATH never supplies an ROV origin |
session_reset |
Length fields that overflow the UPDATE or BGP message; a Withdrawn Routes or NLRI field that cannot be parsed; a malformed MP_REACH_NLRI or MP_UNREACH_NLRI, or either one repeated; an MP_REACH_NLRI next hop of the wrong length; an attribute error in an UPDATE that announces no prefixes (RFC 7606 §5.2) |
Withdraws every prefix it can still parse and marks the peer as having sent malformed input. Your router resets the BGP session with that peer, and the router's BMP Peer Down then removes the rest of the peer's routes |
RAVEN treats a peer as internal when its ASN equals the monitored router's own AS on that BMP session; if RAVEN does not know the router's AS, the peer counts as external.
For session_reset, RAVEN does not close anything itself. The BMP session
carries every peer of the router, so closing it would drop all of them
over one peer's bad UPDATE.
Withdrawals always apply. Whatever else is wrong with an UPDATE,
RAVEN applies the prefixes it withdraws: those in the Withdrawn Routes
field whenever RAVEN can find where that field ends, and those in
MP_UNREACH_NLRI whenever it can find where the path attributes end. A
withdrawal is not lost because another part of its UPDATE was bad. Only
when the Withdrawn Routes length itself overflows the UPDATE is there
nothing RAVEN can safely withdraw.
Where to see it:
raven peersshows aMALFORMEDcolumn naming the reason for each peer marked by asession_reseterror; see The MALFORMED column. The mark clears when the router reports the peer up again. A peer that stays marked with no Peer Down means your router did not reset that session, and RAVEN's view of the peer may be missing routes.raven_bmp_malformed_updates_total{action, reason}counts every malformed UPDATE, labeled with the strongest class its errors call for and the error that called for it; see Observability & Metrics.- A WARN log line, at most one per minute for each peer and reason. Each
line's
suppressedfield counts the ones skipped since the last:
{"time":"2026-10-18T23:44:46.600080233-04:00","level":"WARN","msg":"malformed BGP UPDATE from peer","router_name":"edge1","peer":"198.51.100.1","peer_asn":64500,"peer_distinguisher":"","rib":"adj-rib-in-pre","action":"treat_as_withdraw","reason":"origin","detail":"ORIGIN 03","withdrawals":1,"suppressed":0}
Here peer AS64500 sent an ORIGIN value of 3, which is undefined, so RAVEN
treated the UPDATE's one prefix as withdrawn.
What to do: the fault is with the peer, not with RAVEN or your router.
Find the peer from the log line's peer and peer_asn, compare with your
router's own log of the error, and raise it with the peer's operator. To
capture the offending UPDATE for them, run RAVEN with --log-level debug:
each malformed UPDATE is then also logged at DEBUG with the whole message
in hex (update), as RFC 7606 §6 recommends.
RTR / RPKI Issues
Routinator Takes Too Long to Start
Symptom: RAVEN starts but RTR cache shows 0 VRPs for several minutes.
Cause: Routinator is doing a cold start and downloading the full RPKI repository from scratch. This takes approximately 4 minutes.
Solution: Do not kill Routinator between sessions. A warm cache restart takes about 13 seconds. If you must restart, wait for Routinator to fully sync before starting RAVEN.
# Monitor Routinator sync progress
watch -n 5 'curl -s http://127.0.0.1:8323/api/v1/status | python3 -m json.tool'
Wait until vrpsTotal stabilises before proceeding.
ASPA Validation Not Working
Symptom: All routes show ASPA state Unknown, and
raven_rtr_aspa_count is 0 for every cache:
Cause: One of:
- Routinator is not started with
--enable-aspa - RAVEN negotiated RTR v1 instead of v2
- Routinator version does not support ASPA
Check 1 — Routinator ASPA support:
If no ASPA fields appear, restart Routinator with ASPA enabled:
Check 2 — RTR version negotiation:
If the value is 1, RAVEN is speaking RTR v1 to that cache, which carries
no ASPA data. This happens when Routinator was not ready with RTR v2 when
RAVEN first connected.
Fix: Restart RAVEN after Routinator is fully synced and running with
--enable-aspa. RAVEN will renegotiate RTR v2 on reconnect.
Note
When a cache makes RAVEN downgrade (RTR Error Report code 4), RAVEN
re-probes the configured version every rtr.version-reprobe-interval
(default 1 hour), so it returns to RTR v2 on its own once the cache
supports it. Restart RAVEN if you do not want to wait.
RTR Data Keeps Expiring
Symptom: raven_rtr_data_expired goes to 1 repeatedly, or
raven_rtr_session_state keeps dropping to 0 as the RTR session drops and
reconnects.
Check — Routinator memory:
If Routinator is using very high memory or CPU, it may be thrashing during validation. Ensure the host has at least 2GB RAM available for Routinator.
Check — Network connectivity:
If this fails, Routinator's RTR listener is not running. Check Routinator logs and restart.
Validation Issues
Routes Showing as Origin-Invalid Unexpectedly
Symptom: Routes you expect to be valid are showing as origin-invalid.
Cause: Either a misconfigured ROA or a genuine issue.
Investigate:
rov_reason names the origin AS that no covering VRP authorizes, for
example origin AS64502 not authorized by any covering VRP. To see which
VRPs cover the prefix, ask your validator. With Routinator:
Compare the VRPs it lists against the route's origin_asn and prefix
length.
Common causes:
- ROA authorizes the wrong ASN (misconfiguration at the RIR)
- ROA maxLength is too restrictive — the route is a more-specific
- Legitimate route from a secondary origin ASN with no ROA
What-If Results Seem Wrong
Symptom: raven what-if --reject-invalid shows 0 routes when you
expect some.
Cause: The route table may not be fully loaded yet, or ROV validation has not completed.
Check:
Confirm route counts are stable and RTR cache has VRPs loaded. Then re-run the what-if simulation.
Demo Lab Issues
Containerlab Subnet Conflict
Symptom: containerlab deploy fails with subnet conflict error.
Fix: Another Docker network is using 172.20.20.0/24. Find and remove it:
FRR Not Ready After Setup
Symptom: demo-master.sh setup warns that FRR did not become ready.
Fix: The BGP sessions need more time to converge. Wait 30 seconds and check manually:
Look for the Established state on all peers. If sessions are stuck in
Active, check the FRR configs and container connectivity.
Prometheus Not Scraping RAVEN
Symptom: Grafana shows no data. Prometheus targets page shows RAVEN as DOWN.
Cause: Common in WSL2 — Prometheus in Docker cannot reach RAVEN on
localhost because they are in different network namespaces.
Fix: Use the Docker bridge gateway IP instead of localhost:
Update your Prometheus scrape config:
Restart Prometheus after changing the config.
Getting Help
If you encounter an issue not covered here:
- Check the logs:
journalctl -u raven -n 100or run with--log-level debug - Open an issue on GitHub
with your RAVEN version (
raven version), config file (redact IPs if needed), and the relevant log output