Sponsor:

Server and Web Integrator
Link:
Kloxo-MR logo
6.5.0 or 7.0.0
Click for "How to install"
Donation/Sponsorship:
Kloxo-MR is open-source.
Donate and or Sponsorship always welcome.
Click to:
Click Here
Please login or register. 2017-11-07, 21:53:46

Author Topic: Removing many databases is way too slow !  (Read 779 times)

0 Members and 1 Guest are viewing this topic.

Offline Spacedust

  • Super Grand Master
  • ****
  • Posts: 3,944
  • Karma: +1/-0
    • View Profile
Removing many databases is way too slow !
« on: 2015-07-17, 11:12:17 »
Please see:

Quote
du -sch /var/lib/mysql/sun1984*
29M     /var/lib/mysql/sun1984_1
243M    /var/lib/mysql/sun1984_10
87M     /var/lib/mysql/sun1984_11
15M     /var/lib/mysql/sun1984_12
61M     /var/lib/mysql/sun1984_2
173M    /var/lib/mysql/sun1984_3
342M    /var/lib/mysql/sun1984_4
21M     /var/lib/mysql/sun1984_5
47M     /var/lib/mysql/sun1984_6
76M     /var/lib/mysql/sun1984_7
403M    /var/lib/mysql/sun1984_8
46M     /var/lib/mysql/sun1984_9
1.6G    total

After 5 minutes it removed almost 1 database and load was getting up to 35 so I had to stop the processes ;(

Offline Spacedust

  • Super Grand Master
  • ****
  • Posts: 3,944
  • Karma: +1/-0
    • View Profile
Re: Removing many databases is way too slow !
« Reply #1 on: 2015-07-17, 11:56:47 »
On your server it showed:

Notice : The resource you have requested doesn't exist. The server returned the error message:
No element sun1984_9 in client:admin mysqldb_l

Offline Spacedust

  • Super Grand Master
  • ****
  • Posts: 3,944
  • Karma: +1/-0
    • View Profile
Re: Removing many databases is way too slow !
« Reply #2 on: 2015-07-17, 12:20:52 »
It seems on some database Kloxo removes them then waits for something:

Quote
| 3260095 | kloxo                | localhost       | kloxo              | Sleep          |  127 |                                 | NULL                                                                                                 |    0.000 |
| 3260139 | kloxo                | localhost       | kloxo              | Sleep          |  126 |                                 | NULL                                                                                                 |    0.000 |
| 3260140 | root                 | localhost       | NULL               | Query          |  126 | closing tables                  | drop database sun1984_5                                                                              |    0.000 |

What's wrong with my config ?

Quote
[mysqld]
#skip-networking
#bind-address = 0.0.0.0
#server-id=1
#log-bin = mysql-bin
#skip-name-resolve
#skip-grant-tables
datadir=/var/lib/mysql
tmpdir=/dev/shm
socket=/var/lib/mysql/mysql.sock
user=mysql
#log_warnings=2
skip-external-locking
query_cache_limit=64M
query_cache_size=256M
query_cache_type=1
max_connections=900
max_user_connections=50
max_connect_errors=5000
open_files_limit = 1024000
thread_handling = pool-of-threads
thread_cache_size=6
key_cache_segments=6
key_buffer=2048M
innodb-buffer-pool-instances=6
innodb_buffer_pool_size = 2048M
innodb_thread_concurrency=6
innodb_log_file_size=64M
innodb_log_buffer_size = 8M
innodb_lock_wait_timeout = 100
innodb_flush_log_at_trx_commit = 2
innodb_support_xa=0
innodb_read_io_threads = 2
innodb_write_io_threads = 2
innodb_max_dirty_pages_pct = 90
innodb_file_per_table=1
innodb_use_native_aio=1
innodb_doublewrite=1
innodb_use_fallocate=1
innodb_use_atomic_writes=0
innodb_flush_method = ALL_O_DIRECT
innodb_file_format=barracuda
innodb_lru_scan_depth=2000
innodb_io_capacity=400
innodb_io_capacity_max=1000
sync_binlog=0
join_buffer_size=1M
max_allowed_packet=32M
table_open_cache=2048
sort_buffer_size=1M
read_buffer_size=1M
read_rnd_buffer_size=1M
tmp_table_size=32M
max_heap_table_size=1M
long_query_time=2
myisam_sort_buffer_size=64M
max_write_lock_count = 1
default-storage-engine=MyISAM

[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
plugin-load=archive=ha_archive.so;blackhole=ha_blackhole.so
open_files_limit = 1024000

[mysqldump]
quick
max_allowed_packet=16M
« Last Edit: 2015-07-17, 12:46:39 by Spacedust »

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,381
  • Karma: +112/-9
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Removing many databases is way too slow !
« Reply #3 on: 2015-07-17, 13:02:27 »
All tables using innodb, myisam or mix?.
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline Spacedust

  • Super Grand Master
  • ****
  • Posts: 3,944
  • Karma: +1/-0
    • View Profile
Re: Removing many databases is way too slow !
« Reply #4 on: 2015-07-17, 13:05:51 »
All tables using innodb, myisam or mix?.

Mix but mostly MyISAM - in that case MyISAM only

 


MRatWork Affiliates:    BIGRAF(R) Inc.    House of LMAR    EFARgrafix
Click Here

Page created in 0.038 seconds with 16 queries.

web stats analysis
 
Mirror created by MasterkinG32.CoM