Thursday, April 28, 2016

'confd' process consumes CPU at high level on Gaia OS due to large size of Gaia Database



          Symptoms
  • Gaia machine does not respond to SNMP requests, and /var/log/messages file repeatedly shows:
    snmpd: Error: Timeout waiting for response from database server
  • Gaia Cloning Groups can not be synchronized.
  • Output of "top" command / or "ps auxw" command shows that "confd" process consumes CPU at high level on Gaia OS


    Solution


    This problem was fixed. The fix is included in:
  • Check Point R77.30 and higher
  • Jumbo Hotfix Accumulator for R77.20 - since Take_86
  • Jumbo Hotfix Accumulator for R77.10 - since Take_116
  • Jumbo Hotfix Accumulator for R77 - since Take_41
  • Jumbo Hotfix Accumulator for R76 - since Take_64For lower supported versions, Check Point Support can supply a Hotfix.
However if you don't want to install the hotfix immediately but need to fix this issue, read along.....


Hotfix installation instructions:
  1. Stop the confd process:
    [Expert@HostName]# tellpm process:confd
  2. Backup the current Gaia Database:
    [Expert@HostName]# mkdir /config/db/BKP
    [Expert@HostName]# mv /config/db/initial_db /config/db/BKP/
  3. Recreate the Gaia Database based on the current configuration:
    [Expert@HostName]# conv2db /config/db/initial /config/db/initial_db
  4. Verify that the Gaia Database was recreated:
    [Expert@HostName]# ls -l /config/db/initial_db
  5. Assign the required permissions and ownership for the recreated Gaia OS SQL database:
    [Expert@HostName]# chown -v admin:root /config/db/initial_db
    [Expert@HostName]# chmod -v u=rw,g=r,o=r /config/db/initial_db
    [Expert@HostName]# ls -l /config/db/initial_db
  6. Set the revisions time in Gaia Database:
    [Expert@HostName]# sqlite3 /config/db/initial_db "update revisions set time='1980-01-01 02:00:00';"
  7. Start the confd process:
    [Expert@HostName]# tellpm process:confd t
 
That's it. the issue is temporarily fixed. You can upgrade to a later release without going crazy.

No comments:

Post a Comment