$ okurl --tracing CONSOLE 'https://nghttp2.org/httpbin/redirect-to?url=http://www.twitter.com/robots.txt'
[0 ms] callStart: Request{method=GET, url=https://nghttp2.org/httpbin/redirect-to?url=http://www.twitter.com/robots.txt, tags={class java.lang.Object=TokenSet(name=default)}}
[5 ms] dnsStart: nghttp2.org
[139 ms] dnsEnd: [nghttp2.org/139.162.123.134, nghttp2.org/2400:8902:0:0:f03c:91ff:fe69:a454]
[169 ms] connectStart: nghttp2.org/139.162.123.134:443 DIRECT
[530 ms] secureConnectStart
[894 ms] secureConnectEnd
[908 ms] connectEnd: h2
[908 ms] connectionAcquired: Connection{nghttp2.org:443, proxy=DIRECT hostAddress=nghttp2.org/139.162.123.134:443 cipherSuite=TLS_AES_256_GCM_SHA384 protocol=h2}
[1094 ms] requestHeadersStart
[1114 ms] requestHeadersEnd
[1114 ms] responseHeadersStart
[1409 ms] responseHeadersEnd: Response{protocol=h2, code=302, message=, url=https://nghttp2.org/httpbin/redirect-to?url=http://www.twitter.com/robots.txt}
[1409 ms] responseBodyStart
[1410 ms] responseBodyEnd: byteCount=0
[1410 ms] connectionReleased
[1410 ms] callEnd
[1411 ms] dnsStart: www.twitter.com
[1428 ms] dnsEnd: [www.twitter.com/104.244.42.193, www.twitter.com/104.244.42.65]
[1428 ms] connectStart: www.twitter.com/104.244.42.193:80 DIRECT
[1443 ms] connectEnd: http/1.1
[1443 ms] connectionAcquired: Connection{www.twitter.com:80, proxy=DIRECT hostAddress=www.twitter.com/104.244.42.193:80 cipherSuite=none protocol=http/1.1}
[1519 ms] requestHeadersStart
[1519 ms] requestHeadersEnd
[1519 ms] responseHeadersStart
[1650 ms] responseHeadersEnd: Response{protocol=http/1.1, code=200, message=OK, url=http://www.twitter.com/robots.txt}
[1651 ms] responseBodyStart
[1813 ms] responseBodyEnd: byteCount=52
[1813 ms] connectionReleased
[1813 ms] callEnd
User-agent: *
Disallow: /
Good find!
This is fixed now:
okcurl -v 'https://nghttp2.org/httpbin/redirect-to?url=https://www.twitter.com/robots.txt'
[0 ms] callStart: Request{method=GET, url=https://nghttp2.org/httpbin/redirect-to?url=https://www.twitter.com/robots.txt, tags={}}
[16 ms] dnsStart: nghttp2.org
[190 ms] dnsEnd: [nghttp2.org/139.162.123.134, nghttp2.org/2400:8902:0:0:f03c:91ff:fe69:a454]
[301 ms] connectStart: nghttp2.org/139.162.123.134:443 DIRECT
[557 ms] secureConnectStart
[1474 ms] secureConnectEnd: Handshake{tlsVersion=TLS_1_2 cipherSuite=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 peerCertificates=[CN=nghttp2.org, CN=Let's Encrypt Authority X3, O=Let's Encrypt, C=US] localCertificates=[]}
[1474 ms] connectEnd: http/1.1
[1476 ms] connectionAcquired: Connection{nghttp2.org:443, proxy=DIRECT hostAddress=nghttp2.org/139.162.123.134:443 cipherSuite=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 protocol=http/1.1}
[1477 ms] requestHeadersStart
[1479 ms] requestHeadersEnd
[1480 ms] responseHeadersStart
[1755 ms] responseHeadersEnd: Response{protocol=http/1.1, code=302, message=Found, url=https://nghttp2.org/httpbin/redirect-to?url=https://www.twitter.com/robots.txt}
[1755 ms] responseBodyStart
[1757 ms] responseBodyEnd: byteCount=0
[1759 ms] connectionReleased
[1759 ms] dnsStart: www.twitter.com
[1939 ms] dnsEnd: [www.twitter.com/104.244.42.193, www.twitter.com/104.244.42.129]
[1939 ms] connectStart: www.twitter.com/104.244.42.193:443 DIRECT
[2030 ms] secureConnectStart
[2361 ms] secureConnectEnd: Handshake{tlsVersion=TLS_1_2 cipherSuite=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 peerCertificates=[CN=twitter.com, OU=Twitter Security, O="Twitter, Inc.", L=San Francisco, ST=California, C=US, SERIALNUMBER=4337446, OID.1.3.6.1.4.1.311.60.2.1.2=Delaware, OID.1.3.6.1.4.1.311.60.2.1.3=US, OID.2.5.4.15=Private Organization, CN=DigiCert SHA2 Extended Validation Server CA, OU=www.digicert.com, O=DigiCert Inc, C=US] localCertificates=[]}
[2361 ms] connectEnd: http/1.1
[2362 ms] connectionAcquired: Connection{www.twitter.com:443, proxy=DIRECT hostAddress=www.twitter.com/104.244.42.193:443 cipherSuite=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 protocol=http/1.1}
[2362 ms] requestHeadersStart
[2362 ms] requestHeadersEnd
[2363 ms] responseHeadersStart
[2460 ms] responseHeadersEnd: Response{protocol=http/1.1, code=200, message=OK, url=https://www.twitter.com/robots.txt}
[2460 ms] responseBodyStart
[2466 ms] responseBodyEnd: byteCount=52
[2466 ms] connectionReleased
[2466 ms] callEnd
User-agent: *
Disallow: /
Brilliant! Thanks @amirlivneh!
Most helpful comment
This is fixed now: