Commit Graph

813 Commits

Author SHA1 Message Date
JackDoan 37b924945d unslop some comments 2026-07-14 13:38:39 -05:00
JackDoan 5631346b07 batch: back SendBatch with Arena instead of a hand-rolled slab
SendBatch.Reserve duplicated Arena's grow-on-demand logic byte for byte.
Use an Arena for the slot backing so the borrow/grow/recycle semantics
live in one place.
2026-07-14 12:19:50 -05:00
JackDoan 97eb3c635a batch: move shared-arena Reset ownership from lanes to their owner 2026-07-14 12:19:50 -05:00
JackDoan 05f7923860 re-align to master 2026-07-14 11:38:43 -05:00
JackDoan 49028cb755 some tests 2026-07-14 11:00:55 -05:00
JackDoan adf71d1458 simplify making new Queues 2026-07-14 11:00:55 -05:00
JackDoan cefda6524c make service test less annoying 2026-07-14 11:00:55 -05:00
JackDoan d0f14de739 checkpt 2026-07-14 11:00:55 -05:00
JackDoan 9e7646ee62 checkpt 2026-07-14 11:00:55 -05:00
JackDoan 6e6cfc89db more ram -> more speed 2026-07-14 11:00:55 -05:00
JackDoan 3719f135e3 more fixes! 2026-07-14 11:00:55 -05:00
JackDoan 2724b4a96c more fixes! 2026-07-14 11:00:55 -05:00
JackDoan e386e290ab lint 2026-07-14 11:00:55 -05:00
JackDoan 0a44376403 datapath: fix 12 correctness findings from tun/UDP offload review
Multi-disciplinary correctness review of the batched tun / GSO-GRO / sendmmsg
rework. Each fix has a regression test; the merged tree builds on
linux/darwin/openbsd/windows/freebsd/netbsd, vets clean, passes the unit and
e2e suites, and is -race clean.

Critical:
- C1 zero-length inner UDP datagram no longer panics the process (remote DoS):
  the UDP coalescer routes payLen==0 to passthrough instead of seeding a GSO
  slot, and WriteGSO skips empty payload iovecs as defense in depth.
- C2 segmenter no longer corrupts inner headers when gsoSize < headerLen: the
  L3+L4 header is snapshotted once and each segment stamped from the copy,
  replacing the destructive overlapping in-place slide (SegmentTCP + SegmentUDP).

High:
- H1 applyOuterECN updates the IPv4 header checksum (RFC 1624 incremental) when
  folding outer CE into the inner ToS, so passthrough packets are no longer
  dropped by the peer stack.
- H2 the GRO reject path caps the borrowed RX segment ([:n:n]) so a reject can
  no longer overrun into the next coalesced segment's Nebula header. Note:
  oversized ICMPv6 rejects that need >16B beyond the segment are now refused
  rather than sent under GRO (safe; see TOFIX.md for the scratch-buffer follow-up).
- H3 WriteBatch falls back to per-packet WriteTo for a chunk when writeSockaddr
  fails, so one bad-family destination costs only its own packet, not the batch.
- H4 UserDevice.Readers returns N distinct queue wrappers with private buffers
  (sharing the pipes) so concurrent readers no longer race/overwrite borrowed
  packet bytes.
- H5 Poll.Close / Offload.Close no longer null t.fd (matching master's
  tunFile.Close), removing the data race with a concurrent readOne load.

Medium/Low:
- M1 the UDP GSO 127-segment gate moved from kernel >=5.5 to >=6.9 (the real
  UDP_MAX_SEGMENTS 64->128 threshold), avoiding EINVAL + per-packet fallback on
  5.5-6.8 kernels.
- M2 NewMultiQueueReader replays the offload mask newTun actually negotiated
  instead of the TSO-only mask, so adding a queue no longer disables USO
  device-wide; the advertised USO capability derives from the same mask.
- M3 the shutdown eventfd is closed in pollQueueSet.Close / offloadQueueSet.Close
  (double-close guarded), fixing the per-lifecycle fd leak.
- M4 dual-stack ECN selects the cmsg by address family, not socket family: RX
  parseRecvCmsg reads both IP_TOS and IPV6_TCLASS; TX writeEntryCmsg stamps
  IP_TOS for v4/v4-mapped dests and IPV6_TCLASS for v6 (on-host verified).
- L1 newPoll no longer closes the fd on failure (matching newOffload), removing
  the double-close on QueueSet.Add error.
2026-07-14 11:00:55 -05:00
JackDoan 9e61269935 make mobile happy 2026-07-14 11:00:55 -05:00
JackDoan a0836aa819 correctly shutdown the pprofserver 2026-07-14 11:00:55 -05:00
JackDoan cf2800f7bd SendVia: don't emit a zero-length packet when prepareSendVia fails 2026-07-14 11:00:55 -05:00
JackDoan fc89b9d14c adapt Control lifecycle tests to the batched tio.Queue Device interface 2026-07-14 11:00:55 -05:00
JackDoan 3e5326e60a udp setsockopt correctness fixes 2026-07-14 11:00:55 -05:00
JackDoan 840841a53c use less ram pls 2026-07-14 11:00:55 -05:00
JackDoan cfb4ab24c3 clean up a comment a bit 2026-07-14 11:00:55 -05:00
JackDoan 67f9cfad91 drop in a logger 2026-07-14 11:00:55 -05:00
JackDoan 1c78f5e500 go mod tidy 2026-07-14 11:00:55 -05:00
JackDoan ad8ff2e45e lint 2026-07-14 11:00:55 -05:00
JackDoan c13a1ff4ec fix 2026-07-14 11:00:55 -05:00
JackDoan 8b66ebaf72 faster
grr heap usage!
2026-07-14 11:00:55 -05:00
JackDoan bbdaf5c3f3 no 2026-07-14 11:00:55 -05:00
JackDoan a515aeaf39 use clear() 2026-07-14 11:00:55 -05:00
JackDoan 0f6f14eaf6 remove udp-level RX reorder buf 2026-07-14 11:00:55 -05:00
JackDoan dafdd34af9 make relays take the fast path maybe 2026-07-14 11:00:55 -05:00
JackDoan f6791130df scoot pinning around 2026-07-14 11:00:55 -05:00
JackDoan 145a6267fa scoot stuff around for e2e 2026-07-14 11:00:55 -05:00
JackDoan 7716f1da23 disable sort-on-RX, CPU pinning seems to work for now 2026-07-14 11:00:55 -05:00
JackDoan beb1d7d89f switch to ASM vector checksum 2026-07-14 11:00:55 -05:00
JackDoan fa0d593f28 GSO/GRO offloads, with TCP+ECN and UDP support 2026-07-14 11:00:55 -05:00
JackDoan ff48040c78 better and batched tun interface 2026-07-14 11:00:55 -05:00
Nate Brown 6c3972f464 code-sign: default the S3 key-prefix to the calling repo (#1799) 2026-07-13 11:49:59 -05:00
Jack Doan 861d3aabd7 correct directionality of firewall.inbound_action and firewall.outbound_action (#1798) 2026-07-13 08:40:42 -05:00
Jack Doan 86733864fe don't make new relay state on a just-discarded tunnel (#1796) 2026-07-10 12:02:17 -05:00
Nate Brown ab736e4c6b Make Control safe to stop and wait on from any lifecycle state (#1794) 2026-07-10 10:35:17 -05:00
Nate Brown 5ecdd4eaa9 Fix e2e test races when looking at hostmap counts (#1795) 2026-07-09 18:48:14 -05:00
Nate Brown 1b84bd0050 Remove dev fmt.Println (#1793) 2026-07-09 11:04:25 -05:00
Nate Brown 384610f81a hostmap: replace the shared next/prev hostinfo chain with independent per-address lists so divergent or overlapping vpnAddr sets cannot corrupt the map (#1790) 2026-07-09 09:34:30 -05:00
Nate Brown c1eea118f4 fix firewall port/proto bypass in parseV6 from uint8 extension-header length overflow (#1789) 2026-07-07 20:43:26 -05:00
Nate Brown 1e66c0d3ee hostmap: unlink a multi-vpnAddr hostinfo from the shared chain exactly once on delete (#1788) 2026-07-07 17:32:25 -05:00
Nate Brown e5c0fdad8d Darwin and openbsd in line with the other bsds for tun support (#1703) 2026-07-07 17:05:12 -05:00
Nate Brown 7bd0bc285a sshd: guard trustedKeys/trustedCAs with a mutex to fix a concurrent map crash on reload (#1787) 2026-07-07 15:50:06 -05:00
Nate Brown 942ee522e0 lighthouse: unmap 4-in-6 addresses in protoV6AddrPortToNetAddrPort so remote_allow_list v4 rules apply (#1786) 2026-07-07 15:23:39 -05:00
dependabot[bot] 32149f3a93 Bump github.com/kardianos/service from 1.2.4 to 1.3.0 (#1782)
Bumps [github.com/kardianos/service](https://github.com/kardianos/service) from 1.2.4 to 1.3.0.
- [Commits](https://github.com/kardianos/service/compare/v1.2.4...v1.3.0)

---
updated-dependencies:
- dependency-name: github.com/kardianos/service
  dependency-version: 1.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-07-07 14:42:33 -05:00
Jack Doan 19ad3bb904 correctly discard nil proto addresses (#1785) 2026-07-07 14:41:01 -05:00