2025-04-30 10:19:53,913 Generated random file: nyqswriifo of size: 26214400 2025-04-30 10:19:53,914 Requests: https://server4:443/nyqswriifo 2025-04-30 10:19:53,990 2025-04-30 10:19:53,991 Command: WAITFORSERVER=server:443 CERTS=/tmp/certs_m95lexm2/ TESTCASE_SERVER=transfer TESTCASE_CLIENT=transfer WWW=/tmp/www_brusyyqd/ DOWNLOADS=/tmp/download_xj502h4k/ SERVER_LOGS=/tmp/logs_server_he15uyd9 CLIENT_LOGS=/tmp/logs_client_pd4z_no3 SCENARIO="simple-p2p --delay=15ms --bandwidth=10Mbps --queue=25" CLIENT=ghcr.io/facebook/proxygen/mvfst-interop:latest SERVER=haproxytech/haproxy-qns:latest REQUESTS="https://server4:443/nyqswriifo" IPERF_CONGESTION=cubic docker compose --env-file empty.env up --abort-on-container-exit --timeout 1 sim client server iperf_server iperf_client 2025-04-30 10:20:50,694 Container sim Created Container server Recreate Container iperf_client Created Container iperf_server Created Container client Recreate Container client Recreated Container server Recreated Attaching to client, iperf_client, iperf_server, server, sim sim | waiting 10s for server:443 iperf_server | Setting up routes... iperf_server | Actual changes: iperf_server | tx-checksumming: off iperf_server | tx-checksum-ip-generic: off iperf_server | tx-checksum-sctp: off iperf_server | tcp-segmentation-offload: off iperf_server | tx-tcp-segmentation: off [requested on] iperf_server | tx-tcp-ecn-segmentation: off [requested on] iperf_server | tx-tcp-mangleid-segmentation: off [requested on] iperf_server | tx-tcp6-segmentation: off [requested on] iperf_server | tx-udp-segmentation: off [requested on] iperf_server | Endpoint's IPv4 address is 193.167.100.110 iperf_server | Endpoint's IPv6 address is fd00:cafe:cafe:100::110 iperf_server | wait-for-it.sh: waiting 10 seconds for sim:57832 iperf_client | Setting up routes... iperf_client | Actual changes: iperf_client | tx-checksumming: off iperf_client | tx-checksum-ip-generic: off iperf_client | tx-checksum-sctp: off iperf_client | tcp-segmentation-offload: off iperf_client | tx-tcp-segmentation: off [requested on] iperf_client | tx-tcp-ecn-segmentation: off [requested on] iperf_client | tx-tcp-mangleid-segmentation: off [requested on] iperf_client | tx-tcp6-segmentation: off [requested on] iperf_client | tx-udp-segmentation: off [requested on] iperf_client | Endpoint's IPv4 address is 193.167.0.90 client | + set -o nounset client | + VERSION=1 client | + HQ_CLI=/proxygen/_build/proxygen/bin/hq client | + PORT=443 client | + LOGLEVEL=2 client | + /setup.sh client | Setting up routes... client | Actual changes: client | tx-checksum-ip-generic: off client | tx-tcp-segmentation: off [not requested] client | tx-tcp-ecn-segmentation: off [not requested] client | tx-tcp-mangleid-segmentation: off [not requested] client | tx-tcp6-segmentation: off [not requested] client | tx-udp-segmentation: off [not requested] client | tx-checksum-sctp: off server | Setting up routes... server | Actual changes: server | tx-checksum-ip-generic: off server | tx-tcp-segmentation: off [not requested] server | tx-tcp-ecn-segmentation: off [not requested] server | tx-tcp-mangleid-segmentation: off [not requested] server | tx-tcp6-segmentation: off [not requested] server | tx-udp-segmentation: off [not requested] server | tx-checksum-sctp: off iperf_client | Endpoint's IPv6 address is fd00:cafe:cafe::90 client | Endpoint's IPv4 address is 193.167.0.100 server | Endpoint's IPv4 address is 193.167.100.100 client | Endpoint's IPv6 address is fd00:cafe:cafe::100 server | Endpoint's IPv6 address is fd00:cafe:cafe:100::100 client | + PROTOCOL=hq-interop client | + HTTPVERSION=0.9 client | + CONN_FLOW_CONTROL=107374182 client | + STREAM_FLOW_CONTROL=107374182 server | starting lighttpd server client | ++ tr ' ' '\n' client | ++ echo https://server4:443/nyqswriifo client | ++ awk -F / '{ print "/" $4 }' client | ++ paste -sd, client | + INVOCATIONS=/nyqswriifo client | + EARLYDATA=false client | + PSK_FILE= client | + '[' -n transfer ']' client | + case "${TESTCASE}" in client | + STREAM_FLOW_CONTROL=262144 client | + CONN_FLOW_CONTROL=2621440 client | + '[' client == client ']' client | + /wait-for-it.sh sim:57832 -s -t 10 iperf_client | wait-for-it.sh: waiting 10 seconds for sim:57832 client | wait-for-it.sh: waiting 10 seconds for sim:57832 server | haproxy version HAProxy version 0f9b3daf98a80004f90e9540b0385d419f0e4e16 2025/04/25 - https://haproxy.org/ server | Status: development branch - not safe for use in production. server | Known bugs: https://github.com/haproxy/haproxy/issues?q=is:issue+is:open server | Running on: Linux 6.11.0-1012-azure #12~24.04.1-Ubuntu SMP Mon Mar 10 19:00:39 UTC 2025 x86_64 server | starting haproxy... sim | server:443 is available after 1.003730223s sim | Using scenario: simple-p2p --delay=15ms --bandwidth=10Mbps --queue=25 sim | tcpdump: listening on eth0, link-type EN10MB (Ethernet), snapshot length 262144 bytes sim | tcpdump: listening on eth1, link-type EN10MB (Ethernet), snapshot length 262144 bytes iperf_server | wait-for-it.sh: sim:57832 is available after 1 seconds iperf_server | wait-for-it.sh: waiting 10 seconds for client4:5001 iperf_client | wait-for-it.sh: sim:57832 is available after 1 seconds client | wait-for-it.sh: sim:57832 is available after 1 seconds client | + echo 'Starting QUIC client...' client | Starting QUIC client... client | + '[' -n https://server4:443/nyqswriifo ']' client | + REQS=("${REQUESTS}") client | + REQ=https://server4:443/nyqswriifo client | ++ echo https://server4:443/nyqswriifo client | ++ cut -d/ -f3 client | ++ cut -d: -f1 client | + SERVER=server4 client | + for INVOCATION in ${INVOCATIONS} client | + echo 'requesting files '\''/nyqswriifo'\''' client | requesting files '/nyqswriifo' client | + /proxygen/_build/proxygen/bin/hq --mode=client --host=server4 --port=443 --protocol=hq-interop --httpversion=0.9 --use_version=true --quic-version=1 --path=/nyqswriifo --early_data=false --psk_file= --conn_flow_control=2621440 --stream_flow_control=262144 --outdir=/downloads --logdir=/logs --qlogger_path=/logs --v=2 client | + tee /logs/client.log iperf_client | ------------------------------------------------------------ iperf_client | Server listening on TCP port 5001 iperf_client | TCP window size: 128 KByte (default) iperf_client | ------------------------------------------------------------ client | I20250430 10:19:56.950826 43 HQClient.cpp:47] HQClient connecting to 193.167.100.100:443 client | I20250430 10:19:56.990127 43 CurlClient.cpp:187] Sending request for /nyqswriifo iperf_server | wait-for-it.sh: client4:5001 is available after 1 seconds iperf_client | recvn abort failed: Success iperf_client | [ 4] local 193.167.0.90 port 5001 connected with 193.167.100.110 port 33032 iperf_client | [ ID] Interval Transfer Bandwidth iperf_client | [ 4] 0.0- 0.0 sec 0.00 Bytes 0.00 bits/sec iperf_client | [ 4] MSS size 1448 bytes (MTU 1500 bytes, ethernet) iperf_server | ------------------------------------------------------------ iperf_server | Client connecting to client4, TCP port 5001 with pid 48 iperf_server | Write buffer size: 128 KByte iperf_server | TCP window size: 85.0 KByte (default) iperf_server | ------------------------------------------------------------ iperf_server | [ 3] local 193.167.100.110 port 33042 connected with 193.167.0.90 port 5001 (ct=42.36 ms) iperf_client | [ 5] local 193.167.0.90 port 5001 connected with 193.167.100.110 port 33042 iperf_client | [ 5] 0.0- 1.0 sec 437 KBytes 3.58 Mbits/sec iperf_server | [ ID] Interval Transfer Bandwidth Write/Err Rtry Cwnd/RTT NetPwr iperf_server | [ 3] 0.0000-1.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 8 18K/42221 us 15.52 iperf_client | [ 5] 1.0- 2.0 sec 679 KBytes 5.56 Mbits/sec iperf_server | [ 3] 1.0000-2.0000 sec 768 KBytes 6.29 Mbits/sec 6/0 0 32K/56366 us 13.95 iperf_client | [ 5] 2.0- 3.0 sec 836 KBytes 6.85 Mbits/sec iperf_server | [ 3] 2.0000-3.0000 sec 896 KBytes 7.34 Mbits/sec 7/0 0 45K/51015 us 17.98 iperf_client | [ 5] 3.0- 4.0 sec 660 KBytes 5.41 Mbits/sec iperf_server | [ 3] 3.0000-4.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 3 31K/46341 us 14.14 iperf_client | [ 5] 4.0- 5.0 sec 612 KBytes 5.02 Mbits/sec iperf_server | [ 3] 4.0000-5.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 3 31K/48587 us 13.49 iperf_server | [ 3] 5.0000-6.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 2 35K/55017 us 9.53 iperf_client | [ 5] 5.0- 6.0 sec 595 KBytes 4.88 Mbits/sec iperf_client | [ 5] 6.0- 7.0 sec 574 KBytes 4.70 Mbits/sec iperf_server | [ 3] 6.0000-7.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 33K/55278 us 11.86 iperf_client | [ 5] 7.0- 8.0 sec 436 KBytes 3.57 Mbits/sec iperf_server | [ 3] 7.0000-8.0000 sec 384 KBytes 3.15 Mbits/sec 3/0 4 19K/53083 us 7.41 iperf_client | [ 5] 8.0- 9.0 sec 436 KBytes 3.57 Mbits/sec iperf_server | [ 3] 8.0000-9.0000 sec 384 KBytes 3.15 Mbits/sec 3/0 1 25K/55355 us 7.10 iperf_client | [ 5] 9.0-10.0 sec 474 KBytes 3.88 Mbits/sec iperf_server | [ 3] 9.0000-10.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 1 26K/53107 us 9.87 iperf_client | [ 5] 10.0-11.0 sec 544 KBytes 4.46 Mbits/sec iperf_server | [ 3] 10.0000-11.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 2 31K/49229 us 10.65 iperf_client | [ 5] 11.0-12.0 sec 595 KBytes 4.88 Mbits/sec iperf_server | [ 3] 11.0000-12.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 31K/46901 us 13.97 iperf_server | [ 3] 12.0000-13.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 1 33K/52525 us 9.98 iperf_client | [ 5] 12.0-13.0 sec 617 KBytes 5.05 Mbits/sec iperf_client | [ 5] 13.0-14.0 sec 602 KBytes 4.93 Mbits/sec iperf_server | [ 3] 13.0000-14.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 33K/53670 us 12.21 iperf_client | [ 5] 14.0-15.0 sec 740 KBytes 6.06 Mbits/sec iperf_server | [ 3] 14.0000-15.0000 sec 768 KBytes 6.29 Mbits/sec 6/0 1 36K/49366 us 15.93 iperf_server | [ 3] 15.0000-16.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 3 25K/53491 us 9.80 iperf_client | [ 5] 15.0-16.0 sec 570 KBytes 4.67 Mbits/sec iperf_client | [ 5] 16.0-17.0 sec 557 KBytes 4.56 Mbits/sec iperf_server | [ 3] 16.0000-17.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 26K/46742 us 14.02 iperf_client | [ 5] 17.0-18.0 sec 642 KBytes 5.26 Mbits/sec iperf_server | [ 3] 17.0000-18.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 33K/54867 us 11.94 iperf_server | [ 3] 18.0000-19.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 32K/49174 us 13.33 iperf_client | [ 5] 18.0-19.0 sec 659 KBytes 5.40 Mbits/sec iperf_client | [ 5] 19.0-20.0 sec 682 KBytes 5.58 Mbits/sec iperf_server | [ 3] 19.0000-20.0000 sec 768 KBytes 6.29 Mbits/sec 6/0 1 32K/48980 us 16.06 iperf_server | [ 3] 20.0000-21.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 1 33K/46393 us 11.30 iperf_client | [ 5] 20.0-21.0 sec 650 KBytes 5.33 Mbits/sec iperf_client | [ 5] 21.0-22.0 sec 411 KBytes 3.37 Mbits/sec iperf_server | [ 3] 21.0000-22.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 3 21K/51817 us 10.12 iperf_client | [ 5] 22.0-23.0 sec 461 KBytes 3.78 Mbits/sec iperf_server | [ 3] 22.0000-23.0000 sec 384 KBytes 3.15 Mbits/sec 3/0 3 22K/52037 us 7.56 iperf_client | [ 5] 23.0-24.0 sec 457 KBytes 3.74 Mbits/sec iperf_server | [ 3] 23.0000-24.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 3 22K/51407 us 10.20 iperf_client | [ 5] 24.0-25.0 sec 416 KBytes 3.41 Mbits/sec iperf_server | [ 3] 24.0000-25.0000 sec 384 KBytes 3.15 Mbits/sec 3/0 3 12K/50020 us 7.86 iperf_server | [ 3] 25.0000-26.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 0 26K/46868 us 11.19 iperf_client | [ 5] 25.0-26.0 sec 539 KBytes 4.41 Mbits/sec iperf_client | [ 5] 26.0-27.0 sec 568 KBytes 4.66 Mbits/sec iperf_server | [ 3] 26.0000-27.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 28K/45195 us 14.50 iperf_client | [ 5] 27.0-28.0 sec 568 KBytes 4.66 Mbits/sec iperf_server | [ 3] 27.0000-28.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 1 31K/52747 us 9.94 iperf_client | [ 5] 28.0-29.0 sec 624 KBytes 5.11 Mbits/sec iperf_server | [ 3] 28.0000-29.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 31K/53427 us 12.27 iperf_client | [ 5] 29.0-30.0 sec 576 KBytes 4.71 Mbits/sec iperf_server | [ 3] 29.0000-30.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 22K/55121 us 11.89 iperf_client | [ 5] 30.0-31.0 sec 536 KBytes 4.39 Mbits/sec iperf_server | [ 3] 30.0000-31.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 1 26K/46363 us 11.31 iperf_client | [ 5] 31.0-32.0 sec 550 KBytes 4.51 Mbits/sec iperf_server | [ 3] 31.0000-32.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 2 28K/44390 us 11.81 iperf_client | [ 5] 32.0-33.0 sec 584 KBytes 4.78 Mbits/sec iperf_server | [ 3] 32.0000-33.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 29K/46445 us 14.11 iperf_client | [ 5] 33.0-34.0 sec 571 KBytes 4.68 Mbits/sec iperf_server | [ 3] 33.0000-34.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 2 32K/53393 us 9.82 iperf_client | [ 5] 34.0-35.0 sec 566 KBytes 4.63 Mbits/sec iperf_server | [ 3] 34.0000-35.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 32K/55130 us 11.89 iperf_client | [ 5] 35.0-36.0 sec 527 KBytes 4.32 Mbits/sec iperf_server | [ 3] 35.0000-36.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 3 24K/52229 us 10.04 iperf_client | [ 5] 36.0-37.0 sec 583 KBytes 4.77 Mbits/sec iperf_server | [ 3] 36.0000-37.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 26K/40393 us 16.22 iperf_client | [ 5] 37.0-38.0 sec 574 KBytes 4.70 Mbits/sec iperf_server | [ 3] 37.0000-38.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 2 29K/48324 us 10.85 iperf_client | [ 5] 38.0-39.0 sec 570 KBytes 4.67 Mbits/sec iperf_server | [ 3] 38.0000-39.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 1 29K/51363 us 12.76 iperf_client | [ 5] 39.0-40.0 sec 502 KBytes 4.11 Mbits/sec iperf_server | [ 3] 39.0000-40.0000 sec 512 KBytes 4.19 Mbits/sec 4/0 3 24K/54435 us 9.63 iperf_server | [ 3] 40.0000-41.0000 sec 384 KBytes 3.15 Mbits/sec 3/0 2 28K/55250 us 7.12 iperf_client | [ 5] 40.0-41.0 sec 492 KBytes 4.03 Mbits/sec client | I20250430 10:20:39.981518 43 CurlClient.cpp:276] Got EOM for /nyqswriifo. Txn Time= 42991 ms iperf_client | [ 5] 41.0-42.0 sec 553 KBytes 4.53 Mbits/sec iperf_server | [ 3] 41.0000-42.0000 sec 640 KBytes 5.24 Mbits/sec 5/0 2 28K/51643 us 12.69 client exited with code 0 Aborting on container exit... Container iperf_server Stopping Container server Stopping Container client Stopping Container iperf_client Stopping Container client Stopped Container iperf_client Stopped Container server Stopped Container iperf_server Stopped Container sim Stopping Container sim Stopped 2025-04-30 10:20:51,707 Using the server's key log file. 2025-04-30 10:20:52,063 2025-04-30 10:20:52,729 Using the server's key log file. 2025-04-30 10:20:52,730 Using the server's key log file. 2025-04-30 10:20:52,873 2025-04-30 10:20:52,955 Using the server's key log file. 2025-04-30 10:20:58,328 Check of downloaded files succeeded. 2025-04-30 10:22:23,649 Transfering 25 MB took 42991 ms. Goodput: 4878 kbps