Julia: Fix IPv6 getaddrinfo on win/mac, and selftest hang when IPv6 n/a on Blue Waters system

Created on 23 Jan 2015 · 15Comments · Source: JuliaLang/julia

Blue Waters is a large HPC system at the NCSA. This is a Cray system running a standard Linux kernel. When I run Julia's self-tests on the front end, they abort with the following error:

$ /mnt/a/u/sciteam/eschnett/SIMFACTORY/julia-master/src/julia-180a6c5e57f0d03fdce044b9374c3edb8b00f4d6/usr/bin/julia --check-bounds=yes -f ./runtests.jl socket
     * socket              exception on 1: ERROR: LoadError: bind: address family not supported (EAFNOSUPPORT)
 in bind at ./socket.jl:443
 in runtests at /mnt/a/u/sciteam/eschnett/SIMFACTORY/julia-master/src/julia-180a6c5e57f0d03fdce044b9374c3edb8b00f4d6/test/testdefs.jl:67
 in anonymous at ./multi.jl:643
 in run_work_thunk at ./multi.jl:604
 in remotecall_fetch at ./multi.jl:677
 in remotecall_fetch at ./multi.jl:692
 in anonymous at ./task.jl:1621
while loading socket.jl, in expression starting on line 128
ERROR: LoadError: LoadError: bind: address family not supported (EAFNOSUPPORT)
 in bind at ./socket.jl:443
 in runtests at /mnt/a/u/sciteam/eschnett/SIMFACTORY/julia-master/src/julia-180a6c5e57f0d03fdce044b9374c3edb8b00f4d6/test/testdefs.jl:67
 in anonymous at ./multi.jl:643
 in run_work_thunk at ./multi.jl:604
 in remotecall_fetch at ./multi.jl:677
 in remotecall_fetch at ./multi.jl:692
 in anonymous at ./task.jl:1621
while loading socket.jl, in expression starting on line 128
while loading /mnt/a/u/sciteam/eschnett/SIMFACTORY/julia-master/src/julia-180a6c5e57f0d03fdce044b9374c3edb8b00f4d6/test/runtests.jl, in expression starting on line 42

This looks as if the system didn't support IPv6. Indeed if I run ifconfig -a, only IPv4 addresses are listed.

If this is the case, then this test should be disabled on systems that don't support IPv6.

Source

eschnett

Most helpful comment

At JuliaCon2014, I swiped his beer while he wasn't looking and extracted a little bit of DNA. You should see all little Kenos running around their playpens in my lab; so cute.

timholy on 23 Jan 2015

❤1 😄1

All 15 comments

:+1: Having Julia work on Blue Waters is my heart's desire

kshyatt on 23 Jan 2015

❤1

The IPv6 sections of getaddrinfo are currently commented out. Not sure why, but the first step is probably to uncomment those lines and test getaddrinfo("::1"). Then we may be able to enable getaddrinfo for both address types, and use getaddrinfo("::1") as the conditional for the tests.

@Keno

ihnorton on 23 Jan 2015

This fails from the REPL:

julia> bind(UDPSocket(), ip"::1", uint16(2001))
ERROR: bind: address family not supported (EAFNOSUPPORT)
 in bind at ./socket.jl:443

Couldn't this be used to detect IPv6 support?

eschnett on 23 Jan 2015

@Keno is crucial to so many things – I think we may need to spend some time working on cloning technology.

StefanKarpinski on 23 Jan 2015

😄1

At JuliaCon2014, I swiped his beer while he wasn't looking and extracted a little bit of DNA. You should see all little Kenos running around their playpens in my lab; so cute.

timholy on 23 Jan 2015

❤1 😄1

@ihnorton The IPv6 lines in socket.jl's _uv_hook_getaddrinfo are commented out because the would introduce a test failure. On OS X, they lead to a hang while testing socket.

eschnett on 25 Jan 2015

Do we have a way to run tests without running them in parallel (I am sure there must be a way)? On systems with firewalls, it is nice to be able to do so.

ViralBShah on 25 Jan 2015

make testall1 runs the tests on a single core. This sets an environment variable to achieve this; you can also set it manually.

eschnett on 25 Jan 2015

Perhaps @amitmurthy could help here.

ViralBShah on 22 Feb 2015

I can reproduce the hang on windows when the ip6 getaddrinfo lines are uncommented. The hang is here. Maybe we are failing to clean up sufficiently on windows and mac after the getaddrinfo call, because accept does not seem directly related.

ihnorton on 23 Feb 2015

Minimal example (win64 local cygwin build, current master. works fine when those lines are commented out in getaddrinfo):

julia> defaultport = rand(2000:4000)
3441
julia> port, server = listenany(defaultport)
(0x0d71,TCPServer(active))
julia> @async connect("localhost", 3091)
Breakpoint 1, jl_getaddrinfo (loop=0x1b4dac0 <uv_default_loop_>,
    host=0x81c6fe70 "localhost", service=0x0, cb=0x8278b5e0) at jl_uv.c:728
728     {
(gdb) c
Continuing.
Task (queued) @0x0000000081cd8a80
julia> accept(server)
# ... Bueller?

ihnorton on 23 Feb 2015

The issue with the test is that getaddrinfo("localhost") returns ::1, so we end up listening on ip4 and trying to connect on ip6. I can't say I entirely follow the control flow, but we get two callbacks on _uv_hook_getaddrinfo, one for each address available. Fixing the test is easy but fixing the API is harder.

The fact that getaddrinfo enumerates all addresses is problematic right now, because the parent functions can only ever return one IPAddr. I think we should change getaddrinfo to only return the first enumerated address, and add another function getaddresses (e.g.) returning a vector of address(es).

ihnorton on 25 Feb 2015

How about getaddrinfo(host; addr=IPv4)?

By default it only returns the the first ipv4 address. The first IPv6 address, if any, must be explicitly requested.