Adding processes to two different remote hosts.

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Adding processes to two different remote hosts.

Pere


I have several servers that I'm planning to use to run some simulations in Julia. The problem is, I can only add remote processes to a single server. If i try to add the processes to the next server I get an error. This is what I'm trying to do and what I get

addprocs
(["user@host1"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)  
addprocs
(["user@host2"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)
id
: cannot find name for group ID 350
Error [connect: host is unreachable (EHOSTUNREACH)] on 3 while connecting to peer 2. Exiting.
Worker 3 terminated.
ERROR
(unhandled task failure): EOFError: read end of file
 
in read at stream.jl:810
 
in message_handler_loop at multi.jl:844
 
in process_tcp_streams at multi.jl:833
 
in anonymous at task.jl:67
 



The host is reachable and I can connect to it via ssh. I found on Github [1] that the processes on different nodes need to be able to communicate without ssh tunneling. All my serves are behind a firewall, so this is not possible. Is there any alternative for adding multiple processes to different servers? I'm using the latest nightly build of Julia, which is on version 4.0.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Adding processes to two different remote hosts.

Young-Jun Ko
Hello,
I have exactly the same problem.
have you found a work-around for this?

Thanks

On Thursday, August 13, 2015 at 6:16:37 PM UTC+2, Pere wrote:


I have several servers that I'm planning to use to run some simulations in Julia. The problem is, I can only add remote processes to a single server. If i try to add the processes to the next server I get an error. This is what I'm trying to do and what I get

addprocs
(["user@host1"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)  
addprocs
(["user@host2"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)
id
: cannot find name for group ID 350
Error [connect: host is unreachable (EHOSTUNREACH)] on 3 while connecting to peer 2. Exiting.
Worker 3 terminated.
ERROR
(unhandled task failure): EOFError: read end of file
 
in read at stream.jl:810
 
in message_handler_loop at multi.jl:844
 
in process_tcp_streams at multi.jl:833
 
in anonymous at task.jl:67
 



The host is reachable and I can connect to it via ssh. I found on Github [1] that the processes on different nodes need to be able to communicate without ssh tunneling. All my serves are behind a firewall, so this is not possible. Is there any alternative for adding multiple processes to different servers? I'm using the latest nightly build of Julia, which is on version 4.0.

<a href="https://github.com/JuliaLang/julia/issues/6256" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FJuliaLang%2Fjulia%2Fissues%2F6256\46sa\75D\46sntz\0751\46usg\75AFQjCNE6Y4pCFKlF7wMMtj52xbJOJW1r5A&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FJuliaLang%2Fjulia%2Fissues%2F6256\46sa\75D\46sntz\0751\46usg\75AFQjCNE6Y4pCFKlF7wMMtj52xbJOJW1r5A&#39;;return true;">https://github.com/JuliaLang/julia/issues/6256
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Adding processes to two different remote hosts.

Pere
I just tried again on Jula 0.5 and this problem is still unsolved.

On Thursday, 21 January 2016 10:39:27 UTC+1, Young-Jun Ko wrote:
Hello,
I have exactly the same problem.
have you found a work-around for this?

Thanks

On Thursday, August 13, 2015 at 6:16:37 PM UTC+2, Pere wrote:


I have several servers that I'm planning to use to run some simulations in Julia. The problem is, I can only add remote processes to a single server. If i try to add the processes to the next server I get an error. This is what I'm trying to do and what I get

addprocs
(["user@host1"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)  
addprocs
(["user@host2"], tunnel=true, dir="~/julia-483dbf5279/bin/", sshflags=`-p 6969`)
id
: cannot find name for group ID 350
Error [connect: host is unreachable (EHOSTUNREACH)] on 3 while connecting to peer 2. Exiting.
Worker 3 terminated.
ERROR
(unhandled task failure): EOFError: read end of file
 
in read at stream.jl:810
 
in message_handler_loop at multi.jl:844
 
in process_tcp_streams at multi.jl:833
 
in anonymous at task.jl:67
 



The host is reachable and I can connect to it via ssh. I found on Github [1] that the processes on different nodes need to be able to communicate without ssh tunneling. All my serves are behind a firewall, so this is not possible. Is there any alternative for adding multiple processes to different servers? I'm using the latest nightly build of Julia, which is on version 4.0.

<a href="https://github.com/JuliaLang/julia/issues/6256" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FJuliaLang%2Fjulia%2Fissues%2F6256\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNE6Y4pCFKlF7wMMtj52xbJOJW1r5A&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FJuliaLang%2Fjulia%2Fissues%2F6256\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNE6Y4pCFKlF7wMMtj52xbJOJW1r5A&#39;;return true;">https://github.com/JuliaLang/julia/issues/6256
Loading...