R12.1.1 Apache won't start libopmnoraclenls.so unable to load

After R12.1.1 install, Apache wouldn't start and we had these errors in the log

libopmnoraclenls.so unable to load

One of the metalink notes advised running genclntsh on IAS_ORACLE_HOME.

$ ./genclntsh -32
cat: cannot open $IAS_ORACLE_HOME/lib32/ldflags
Undefined first referenced
symbol in file
nnfhboot $IAS_ORACLE_HOME/lib32/libn10.a(nnfgt.o)
nnflboot $IAS_ORACLE_HOME/lib32/libn10.a(nnfgt.o)
nnflgapc $IAS_ORACLE_HOME/lib32/libnl10.a(nlpa.o)
nnftboot $IAS_ORACLE_HOME/lib32/libn10.a(nnfgt.o)
nnflgav $IAS_ORACLE_HOME/lib32/libnl10.a(nlol.o)
nnflfrm $IAS_ORACLE_HOME/lib32/libnl10.a(nlol.o)
nnflrne $IAS_ORACLE_HOME/lib32/libnl10.a(nlol.o)
ntusini $IAS_ORACLE_HOME/lib32/libn10.a(ntcontab.o)
ntpini $IAS_ORACLE_HOME/lib32/libn10.a(ntcontab.o)
nttini $IAS_ORACLE_HOME/lib32/libn10.a(ntcontab.o)
ntzini $IAS_ORACLE_HOME/lib32/libn10.a(ntcontab.o)
ld: fatal: Symbol referencing errors. No output written to $IAS_ORACLE_HOME/lib32/libclntsh.so.10.1


We went through release notes for 12.1.1 present in Metalink note 798258.1 again and
unzipped the Rapidwiz patch 8626041 in stage and reinstalled, but we still faced the same issue.

One of the metalink notes mentioned recreating softlinks, so I checked the soft links and found that Oracle stage had hardcoded softlinks pointing to a mount name /d4/R12/ab/apps/R1211XB9 most probably on Oracle's test servers.

$ ls -ltr |grep d4
lrwxrwxrwx 1 applmgr dba 56 Sep 29 16:58 ldflags -> /d4/R12/ab/apps /R1211XB9/apps/tech_st/10.1.3/lib/ldflags
lrwxrwxrwx 1 applmgr dba 66 Sep 29 16:59 libocci.so -> /d4/R12/ab/a pps/R1211XB9/apps/tech_st/10.1.3/lib32/libocci.so.10.1


$ ls -ltr |grep d4
lrwxrwxrwx 1 applmgr dba 63 Sep 29 16:58 hsdb_odbc.so -> /d4/R12/ab/apps/R1211XB9/apps/tech_st/10.1.3/lib32/hsdb_odbc.so
lrwxrwxrwx 1 applmgr dba 63 Sep 29 16:58 hsdb_oing.so -> /d4/R12/ab/apps/R1211XB9/apps/tech_st/10.1.3/lib32/hsdb_oing.so
lrwxrwxrwx 1 applmgr dba 62 Sep 29 16:58 hsdb_ora.so -> /d4/R12/ab/apps/R1211XB9/apps/tech_st/10.1.3/lib32/hsdb_ora.so
lrwxrwxrwx 1 applmgr dba 62 Sep 29 16:58 hsdb_syb.so -> /d4/R12/ab/apps/R1211XB9/apps/tech_st/10.1.3/lib32/hsdb_syb.so
lrwxrwxrwx 1 applmgr dba 62 Sep 29 16:59 libnavhoa.a -> /d4/R12/ab/apps/R1211XB9/apps/tech_st/10.1.3/lib32/libnavhoa.a
applmgr@tsgsd2106 $ pwd
$IAS_ORACLE_HOME/lib

Once we removed these soft links and pointed them to the existing mounts, we were able to run relink all on 10.1.2 and 10.1.3 homes.

Apache started without issues after we did relink all on 10.1.3 IAS_ORACLE_HOME.