Solution: set ORACLE_HOME env variable. Oracle says with instantclient you don't need this but, DBD does you can even set it to a invalid path and it will fix your problem I set it to 1 and my Out of memory errors went away.