Hello,
I have a problem with the recent MPSS 3.3 version. For some reason, the busybox does not seem to be used and bash is not really working. So let me explain what I experienced.
On a fresh booted MIC, the symlinc in /etc/sh points to bash
h_zimm01@sl270-02-mic7:~$ ls -l /bin/sh lrwxrwxrwx 1 root root 9 Jan 1 1970 /bin/sh -> /bin/bash
This leads to the very strange behavior that the directory, a shell is started in is not defined:
[h_zimm01@sl270-02 ~]$ ssh mic7 pwd shell-init: error retrieving current directory: getcwd: cannot access parent directories: Invalid argument pwd: error retrieving current directory: getcwd: cannot access parent directories: Socket operation on non-socket
This has nasty effects when you want to start codes on the MIC from the host. With an interactive login, this works as expected.
[h_zimm01@sl270-02 ~]$ ssh mic7 h_zimm01@sl270-02-mic7:~$ pwd /home/h/h_zimm01
I could solve this problem by setting the symlink /bin/sh to /bin/busybox and changing the /etc/passwd so that the user uses the sh as the default shell.
[h_zimm01@sl270-01 ~]$ ssh mic0 [h_zimm01@sl270-01-mic0 h_zimm01]$ ls -l /bin/sh lrwxrwxrwx 1 root root 7 Sep 11 17:23 /bin/sh -> busybox [h_zimm01@sl270-01-mic0 h_zimm01]$ grep h_zimm01 /etc/passwd h_zimm01:x:154525:200:Holger A:/home/h/h_zimm01:/bin/sh
Ok, until here, I could get it running, but now comes my unsolved problem. When I for example log in to the MIC and try to run a code, the necessary libraries must be in /lib64 and executables like mpirun in /bin. Even setting the LD_LIBRARY_PATH does not have an effect.
I really do not want to copy all my libraries to /lib64. Since we are running a cluster, I cannot predict, which libraries our users will need. So I want to copy all MPI libraries an so on to a path called for example /micfs/lib on the host and export it via NFS to the MICs. But without LD_LIBRARY_PATH being recognized. This won't work.
How can I get LD_LIBRARY_PATH being interpreted (in busybox)? Or find a better solution for the getcwd-problem cited above?
Thank you for your help.