use lve wrapper to reduce I/O for cpbackup
Forum
  1. Forums
  2. CloudLinux and Control Panels
  3. CloudLinux and cPanel
  1. systeem beheerder
  2. Thursday, 09 May 2013
  3.  Subscribe via email
As many cPanel administrators know, the backup process (cpbackup) can be a real resource hog. 
Especially the disk i/o can bring a busy server to a grinding halt.

Would it be possible to use lve_wrapper or lve_suwrapper to wrap the cpbackup process within an LVE, and thus gaining control of the choking I/O usage of the backup process?
If so, how do I change the cron for cpbackup to allow for lve wrapping?

information about the wrappers on http://docs.cloudlinux.com/index.html?lve_wrappers.html
Rate this post:
  1. 10.05.2013 03:05:50
  2. # 1
Igor Seletskiy Accepted Answer
Posts: 1194
Joined: 09.02.2010
0
Votes
Undo
What does cpbackup cron job line looks like?
In most cases it should be possible.
  1. 10.05.2013 03:05:42
  2. # 2
systeem beheerder Accepted Answer
Posts: 6
Joined: 09.05.2013
0
Votes
Undo
cron job is /usr/local/cpanel/scripts/cpbackup


One thing to note: this script calls all kinds of other scripts, including pkgacct which calls

/usr/local/cpanel/3rdparty/bin/pigz -6 --processes 3 --blocksize 128

pigz is a gzip replacement which can utilitize multiple CPU\'s (in my case set to 3), thus speeding up the zip process. So I think I should allow the cpbackup script to use at least 3 CPU\'s at 100%?


<edit>
pigz is a new option in cPanel 11.38, and is meant to speed up the backup (which it certainly does, except that disk I/O stays high, only for a shorter period of time).

</edit>
  1. 10.05.2013 04:05:10
  2. # 3
Igor Seletskiy Accepted Answer
Posts: 1194
Joined: 09.02.2010
0
Votes
Undo
This should be fine, all 'called' scripts will be under same LVE.
Try changing the line to:

lve_suwrapper XX /usr/local/cpanel/scripts/cpbackup 

Where XX is LVE ID. You can use any number you want, like 50. Then use that number to monitor/adjust limits, like:
lvectp set 50 --cpu=50 --ncpu=100 --io=2048
etc..

And tell us if it works for you :)
  1. 10.05.2013 04:05:58
  2. # 4
systeem beheerder Accepted Answer
Posts: 6
Joined: 09.05.2013
0
Votes
Undo
Thanks, will try this.

If this works, it will be a real life save for me and many other cPanel administrators :):):)
  1. 11.05.2013 06:05:47
  2. # 5
systeem beheerder Accepted Answer
Posts: 6
Joined: 09.05.2013
0
Votes
Undo
It's working indeed! :D

I will be watching Munin closely while experimenting with the --io parameter to find the optimal setting for my server. Currently using --io=12000 with  with disk I/O monitor in Munin never exeeding 60% (was peaking at 100% several times a night before during backups)

Will the lvectl settings be lost after server reboot?
  1. 11.05.2013 07:05:38
  2. # 6
Igor Seletskiy Accepted Answer
Posts: 1194
Joined: 09.02.2010
0
Votes
Undo
The settings will persist after reboot.
  1. 20.09.2015 10:09:56
  2. # 7
Benjamin Aharonov Accepted Answer
Posts: 1
Joined: 20.09.2015
0
Votes
Undo
Will this command limit pigz? I have noticed that pigz is not using all resources to kae faster backups I currently have a 16 core processor, is there any way to optimize this? I used the command lve_suwrapper 100 /usr/local/cpanel/bin/backup but do not know if this is right I figured that 400 will be the % of cpu for each core so pigz can use.

Can anyone help?
Regards
  1. 21.08.2018 02:08:10
  2. # 8
Pablo Matias Accepted Answer
Posts: 0
Joined: 20.09.2020
0
Votes
Undo
Hi, is possible use lve_wrapper in cPanel user panel. From cPanel ->backups - create
  1. 21.08.2018 14:08:43
  2. # 9
Vladimir Accepted Answer
Posts: 101
Joined: 04.07.2017
0
Votes
Undo
Hello,

According to our documentation:
/bin/lve_wrapper – can be used by any non-root user, as long as that user is in group lve (see /etc/groups file).

Please note, that LVE Wrappers tool available only from command line interface.
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!
Pablo Matias
Submit Your Response
Upload files or images for this discussion by clicking on the upload button below. Supports gif,jpg,png,zip,rar,pdf
• Insert • Remove Upload Files (Maximum File Size: 2 MB)
Captcha
To protect the site from bots and unauthorized scripts, we require that you enter the captcha codes below before posting your question.