Posted on 2009-02-05 12:38:05-08 by xmerlin
DBM-Deep takes forever and does not finish
We have a dbm deep "flatfile". When we get this kind of datain the database it seems to work very slow, continuously running (for days) and database keeps growing .... it does not finish either
Details see further below
I did find a workaround in changing those characters to <U+code> before writing them to the dbm deep file, of course after a import I have to change it back again ....
So did anyone else run into this? Will this be solved?
DETAILS
Keys/data having data like \x{...} where ... is a code value
Actual data in keys and values found:
"CN=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS" +=> { 'name' +=> "0002_GS_Mana\x{17e}e\x{159}i B-3", "CN=0002_GS_Krizov\x{e1} komunikace ICT,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SY +S" => { + 'name' => "0002_GS_Krizov\x{e1} komunikace ICT", "CN=0002_GS_Krizov\x{e1} komunikace ICT,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SY +S" => [ "CN=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS" +=> [ '14D9397C-1F43-4EB9-B6A1-9BF1078DB44E' => "GROUP;CN=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Manage +d Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS", '673FCAEA-56B5-488F-B414-0474634102E6' => "GROUP;CN=0002_GS_Krizov\x{e1} komunikace ICT,OU=CMDB Man +aged Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS", "CN +=0002_GS_Krizov\x{e1} komunikace ICT,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS", "CN +=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS", "CN +=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS", "CN=0002_GS_Krizov\x{e1} komunikace ICT,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SY +S" => '673FCAEA-56B5-488F-B414-0474634102E6', "CN=0002_GS_Mana\x{17e}e\x{159}i B-3,OU=CMDB Managed Groups,OU=0002,DC=TDA001,DC=AD,DC=ACC,DC=SYS" +=> '14D9397C-1F43-4EB9-B6A1-9BF1078DB44E',
Direct Responses: 10871 | Write a response
Posted on 2009-06-02 09:00:53-07 by xmerlin in response to 9865
Re: DBM-Deep takes forever and does not finish
We have recently moved from version 1.009 to version 1.014 This has solved our "performance problem" ... a task running 23 hours or more now finishes after 1 +hour ...., we have big hashes with large number of keys (>20000 keys)
Direct Responses: Write a response
Perl Weekly newsletter
A free weekly newsletter for people who are busy to read all the blogs. click here to check it out.