Dual server optimization request

Posted on Wednesday 17 March 2010

  • experiending some NASTY server loads, issues came up majorly today...setup has run great for the past month tho....odd....

    anyways, thanks for the assistance!!

    =================================

    1. Dedicated server, hosts a couple tiny club sites


    2. your server specs. For example:

    Web server:
    Pentium 4, 2.4 GHz (single processor)
    2 gig RAM
    40g IDE
    Red Hat 9

    MySQL server:
    Pentium III Xeon, 900MHz (quad processor)
    2 gig RAM
    four 18g 10k SCSI hot swap drives (RAID-5)
    Fedora Core 4

    apache/IIS version: apache v2.0.40
    PHP version: php 4.4.1
    MySQL version: mysql 4.1.16
    APC Cache


    3. if you use mysql 4.x instead of mysql 3.23.x, do you have any innodb type databases/tables on your

    server ?
    --- none


    4. if possible how mysql was compiled/installed
    --- RPM


    5. your top stats
    --- http://www.ih8mud.com/wwwstat/


    6. your mysql configuration variables located at /etc/my.cnf or c:my.cnf or my.ini so post the contents

    inside of my.cnf (minus any passwords of course).



    back_log 50
    basedir /usr/
    bdb_cache_size 8388600
    bdb_home /var/lib/mysql/
    bdb_log_buffer_size 921600
    bdb_logdir
    bdb_max_lock 10000
    bdb_shared_data OFF
    bdb_tmpdir /tmp/
    binlog_cache_size 32768
    bulk_insert_buffer_size 8388608
    character_set_client latin1
    character_set_connection latin1
    character_set_database latin1
    character_set_results latin1
    character_set_server latin1
    character_set_system utf8
    character_sets_dir /usr/share/mysql/charsets/
    collation_connection latin1_swedish_ci
    collation_database latin1_swedish_ci
    collation_server latin1_swedish_ci
    concurrent_insert ON
    connect_timeout 10
    datadir /var/lib/mysql/
    date_format %Y-%m-%d
    datetime_format %Y-%m-%d %H:%i:%s
    default_week_format 0
    delay_key_write ON
    delayed_insert_limit 100
    delayed_insert_timeout 300
    delayed_queue_size 1000
    expire_logs_days 0
    flush OFF
    flush_time 0
    ft_boolean_syntax + -><()~*:""&
    ft_max_word_len 84
    ft_min_word_len 4
    ft_query_expansion_limit 20
    ft_stopword_file (built-in)
    group_concat_max_len 1024
    have_archive NO
    have_bdb YES
    have_blackhole_engine NO
    have_compress YES
    have_crypt YES
    have_csv NO
    have_example_engine NO
    have_geometry YES
    have_innodb DISABLED
    have_isam YES
    have_ndbcluster NO
    have_openssl YES
    have_query_cache YES
    have_raid NO
    have_rtree_keys YES
    have_symlink YES
    init_connect
    init_file
    init_slave
    innodb_additional_mem_pool_size 1048576
    innodb_autoextend_increment 8
    innodb_buffer_pool_awe_mem_mb 0
    innodb_buffer_pool_size 8388608
    innodb_data_file_path
    innodb_data_home_dir
    innodb_fast_shutdown ON
    innodb_file_io_threads 4
    innodb_file_per_table OFF
    innodb_flush_log_at_trx_commit 1
    innodb_flush_method
    innodb_force_recovery 0
    innodb_lock_wait_timeout 50
    innodb_locks_unsafe_for_binlog OFF
    innodb_log_arch_dir
    innodb_log_archive OFF
    innodb_log_buffer_size 1048576
    innodb_log_file_size 5242880
    innodb_log_files_in_group 2
    innodb_log_group_home_dir
    innodb_max_dirty_pages_pct 90
    innodb_max_purge_lag 0
    innodb_mirrored_log_groups 1
    innodb_open_files 300
    innodb_table_locks ON
    innodb_thread_concurrency 8
    interactive_timeout 28800
    join_buffer_size 1044480
    key_buffer_size 16777216
    key_cache_age_threshold 300
    key_cache_block_size 1024
    key_cache_division_limit 100
    language /usr/share/mysql/english/
    large_files_support ON
    license GPL
    local_infile ON
    locked_in_memory OFF
    log OFF
    log_bin OFF
    log_error
    log_slave_updates OFF
    log_slow_queries OFF
    log_update OFF
    log_warnings 1
    long_query_time 10
    low_priority_updates OFF
    lower_case_file_system OFF
    lower_case_table_names 0
    max_allowed_packet 67107840
    max_binlog_cache_size 4294967295
    max_binlog_size 1073741824
    max_connect_errors 10
    max_connections 650
    max_delayed_threads 20
    max_error_count 64
    max_heap_table_size 16777216
    max_insert_delayed_threads 20
    max_join_size 4294967295
    max_length_for_sort_data 1024
    max_relay_log_size 0
    max_seeks_for_key 4294967295
    max_sort_length 1024
    max_tmp_tables 32
    max_user_connections 650
    max_write_lock_count 4294967295
    myisam_data_pointer_size 4
    myisam_max_extra_sort_file_size 2147483648
    myisam_max_sort_file_size 2147483647
    myisam_recover_options OFF
    myisam_repair_threads 1
    myisam_sort_buffer_size 67108864
    myisam_stats_method nulls_unequal
    net_buffer_length 16384
    net_read_timeout 30
    net_retry_count 10
    net_write_timeout 60
    new OFF
    old_passwords ON
    open_files_limit 4260
    pid_file /var/run/mysqld/mysqld.pid
    port 3306
    preload_buffer_size 32768
    protocol_version 10
    query_alloc_block_size 16384
    query_cache_limit 1048576
    query_cache_min_res_unit 4096
    query_cache_size 67108864
    query_cache_type ON
    query_cache_wlock_invalidate OFF
    query_prealloc_size 16384
    range_alloc_block_size 2048
    read_buffer_size 1044480
    read_only OFF
    read_rnd_buffer_size 262144
    relay_log_purge ON
    relay_log_space_limit 0
    rpl_recovery_rank 0
    secure_auth OFF
    server_id 0
    skip_external_locking ON
    skip_networking OFF
    skip_show_database OFF
    slave_net_timeout 3600
    slave_transaction_retries 0
    slow_launch_time 2
    socket /var/lib/mysql/mysql.sock
    sort_buffer_size 2097144
    sql_mode
    sql_notes ON
    sql_warnings ON
    storage_engine MyISAM
    sync_binlog 0
    sync_frm ON
    sync_replication 0
    sync_replication_slave_id 0
    sync_replication_timeout 0
    system_time_zone PST
    table_cache 1800
    table_type MyISAM
    thread_cache_size 384
    thread_stack 196608
    time_format %H:%i:%s
    time_zone SYSTEM
    tmp_table_size 134217728
    tmpdir
    transaction_alloc_block_size 8192
    transaction_prealloc_size 4096
    tx_isolation REPEATABLE-READ
    version 4.1.16
    version_bdb Sleepycat Software: Berkeley DB 4.1.24: (November 30, 2005)
    version_comment Source distribution
    version_compile_machine i386
    version_compile_os redhat-linux-gnu
    wait_timeout 180



    7. MySQL stats from ssh telnet as root user type:
    --- http://forum.ih8mud.com/stat.php


    Aborted_clients 20
    Aborted_connects 7575
    Binlog_cache_disk_use 0
    Binlog_cache_use 0
    Bytes_received 96848565
    Bytes_sent 4104182676
    Com_admin_commands 1
    Com_alter_db 0
    Com_alter_table 0
    Com_analyze 0
    Com_backup_table 0
    Com_begin 0
    Com_change_db 22835
    Com_change_master 0
    Com_check 196
    Com_checksum 0
    Com_commit 0
    Com_create_db 0
    Com_create_function 0
    Com_create_index 0
    Com_create_table 0
    Com_dealloc_sql 0
    Com_delete 801
    Com_delete_multi 0
    Com_do 0
    Com_drop_db 0
    Com_drop_function 0
    Com_drop_index 0
    Com_drop_table 0
    Com_drop_user 0
    Com_execute_sql 0
    Com_flush 0
    Com_grant 0
    Com_ha_close 0
    Com_ha_open 0
    Com_ha_read 0
    Com_help 0
    Com_insert 10379
    Com_insert_select 39
    Com_kill 0
    Com_load 0
    Com_load_master_data 0
    Com_load_master_table 0
    Com_lock_tables 0
    Com_optimize 98
    Com_preload_keys 0
    Com_prepare_sql 0
    Com_purge 0
    Com_purge_before_date 0
    Com_rename_table 0
    Com_repair 1
    Com_replace 2878
    Com_replace_select 0
    Com_reset 0
    Com_restore_table 0
    Com_revoke 0
    Com_revoke_all 0
    Com_rollback 0
    Com_savepoint 0
    Com_select 78270
    Com_set_option 0
    Com_show_binlog_events 0
    Com_show_binlogs 0
    Com_show_charsets 0
    Com_show_collations 0
    Com_show_column_types 0
    Com_show_create_db 0
    Com_show_create_table 0
    Com_show_databases 6
    Com_show_errors 0
    Com_show_fields 0
    Com_show_grants 0
    Com_show_innodb_status 0
    Com_show_keys 13
    Com_show_logs 0
    Com_show_master_status 0
    Com_show_ndb_status 0
    Com_show_new_master 0
    Com_show_open_tables 0
    Com_show_privileges 0
    Com_show_processlist 0
    Com_show_slave_hosts 0
    Com_show_slave_status 0
    Com_show_status 1
    Com_show_storage_engines 0
    Com_show_tables 12
    Com_show_variables 17
    Com_show_warnings 0
    Com_slave_start 0
    Com_slave_stop 0
    Com_stmt_close 0
    Com_stmt_execute 0
    Com_stmt_prepare 0
    Com_stmt_reset 0
    Com_stmt_send_long_data 0
    Com_truncate 0
    Com_unlock_tables 0
    Com_update 16993
    Com_update_multi 0
    Connections 30410
    Created_tmp_disk_tables 91
    Created_tmp_files 11
    Created_tmp_tables 5007
    Delayed_errors 0
    Delayed_insert_threads 0
    Delayed_writes 0
    Flush_commands 1
    Handler_commit 0
    Handler_delete 6346
    Handler_discover 0
    Handler_read_first 13914
    Handler_read_key 4420666
    Handler_read_next 13843791
    Handler_read_prev 63556
    Handler_read_rnd 1943551
    Handler_read_rnd_next 12192414
    Handler_rollback 0
    Handler_update 36335
    Handler_write 1945315
    Key_blocks_not_flushed 0
    Key_blocks_unused 0
    Key_blocks_used 14497
    Key_read_requests 15734708
    Key_reads 896864
    Key_write_requests 33745
    Key_writes 22485
    Max_used_connections 651
    Not_flushed_delayed_rows 0
    Open_files 338
    Open_streams 0
    Open_tables 247
    Opened_tables 640
    Qcache_free_blocks 632
    Qcache_free_memory 58637328
    Qcache_hits 433190
    Qcache_inserts 77608
    Qcache_lowmem_prunes 0
    Qcache_not_cached 662
    Qcache_queries_in_cache 1369
    Qcache_total_blocks 3636
    Questions 588551
    Rpl_status NULL
    Select_full_join 4
    Select_full_range_join 0
    Select_range 18518
    Select_range_check 0
    Select_scan 15842
    Slave_open_temp_tables 0
    Slave_retried_transactions 0
    Slave_running OFF
    Slow_launch_threads 0
    Slow_queries 0
    Sort_merge_passes 5
    Sort_range 12871
    Sort_rows 2503439
    Sort_scan 7428
    Ssl_accept_renegotiates 0
    Ssl_accepts 0
    Ssl_callback_cache_hits 0
    Ssl_cipher
    Ssl_cipher_list
    Ssl_client_connects 0
    Ssl_connect_renegotiates 0
    Ssl_ctx_verify_depth 0
    Ssl_ctx_verify_mode 0
    Ssl_default_timeout 0
    Ssl_finished_accepts 0
    Ssl_finished_connects 0
    Ssl_session_cache_hits 0
    Ssl_session_cache_misses 0
    Ssl_session_cache_mode NONE
    Ssl_session_cache_overflows 0
    Ssl_session_cache_size 0
    Ssl_session_cache_timeouts 0
    Ssl_sessions_reused 0
    Ssl_used_session_cache_entries 0
    Ssl_verify_depth 0
    Ssl_verify_mode 0
    Ssl_version
    Table_locks_immediate 217011
    Table_locks_waited 743
    Threads_cached 382
    Threads_connected 2
    Threads_created 1847
    Threads_running 1
    Uptime 10079



    8. is your vB the only thing on the server? or other scripts & sites which utilise php and mysql?
    --- Coppermine Gallery, one tiny SMF forum 1.0.5, phpAdsNew (current)


    9. how many average and max concurrent users on your vB forum ? and what your cookie timeout is ?
    --- max, 510...concurrent, 450 normal....20 minute timeout


    10. create a file named phpinfo.php and place this code in it and post the url/link to it from your web

    site
    --- http://forum.ih8mud.com/phpinfo.php


    11. if you run Apache and you have your own dedicated server or access to your httpd.conf (apache

    configuration file) can you post the values you have set for the following :

    ServerLimit 350
    # prefork MPM
    # StartServers: number of server processes to start
    # MinSpareServers: minimum number of server processes which are kept spare
    # MaxSpareServers: maximum number of server processes which are kept spare
    # MaxClients: maximum number of server processes allowed to start
    # MaxRequestsPerChild: maximum number of requests a server process serves

    StartServers 8
    MinSpareServers 5
    MaxSpareServers 20
    MaxClients 250
    MaxRequestsPerChild 12000


    StartServers 2
    MaxClients 250
    MinSpareThreads 50
    MaxSpareThreads 150
    ThreadsPerChild 50
    MaxRequestsPerChild 12000


    NumServers 5
    StartThreads 5
    MinSpareThreads 5
    MaxSpareThreads 10
    MaxThreadsPerChild 20
    MaxRequestsPerChild 12000



    12. what version of vB are you running ?
    --- 3.5.3

    13. check to see if any files i.e. apache log files are hitting 2GB or 4GB max file size limits i.e. see

    if you have max file size exceeded messages in apache error log
    --- none


  • There are known performance issues with MySQL 4.1.16. I recommend that you at least upgrade to 4.1.18.

    http://www.vbulletin.com/forum/showthread.php?t=175162


  • 1. Upgrade MySQL server to 4.1.18 http://www.vbulletin.com/forum/showthread.php?t=175163
    2. Upgrade Apache to 2.0.55 and PHP to 4.4.2 if you use phpadsnew make sure to update to phpadsnew 2.0.7 to work with PHP 4.4.1/4.4.2
    3. Edit /etc/my.cnf and place the following mysql server settings in /etc/my.cnf and restart mysql server afterwards


    [mysqld]
    safe-show-database
    old_passwords
    back_log = 50
    skip-innodb
    max_connections = 800
    key_buffer = 16M
    myisam_sort_buffer_size = 64M
    join_buffer_size = 1M
    read_buffer_size = 1M
    sort_buffer_size = 2M
    table_cache = 1800
    thread_cache_size = 512
    wait_timeout = 180
    connect_timeout = 10
    tmp_table_size = 256M
    max_heap_table_size = 128M
    max_allowed_packet = 64M
    max_connect_errors = 10
    read_rnd_buffer_size = 524288
    bulk_insert_buffer_size = 8M
    thread_concurrency = 8
    query_cache_limit = 4M
    query_cache_size = 128M
    query_cache_type = 1
    query_prealloc_size = 65536
    query_alloc_block_size = 32768
    default-storage-engine = MyISAM

    [mysqld_safe]
    open_files_limit = 8192

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M

    [mysqlhotcopy]
    interactive-timeout


    4. If you just upgraded to vB 3.5.x try to disable these 4 options:

    Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

    Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

    Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

    Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

    5. ensure vB config.php usepconnect = 0 and phpadsnew persistent connections are disabled as well







  • #If you have any other info about this subject , Please add it free.#
    Your name:
    E-mail:
    Telphone:

    Your comments:


    If you have any other info about Dual server optimization request , Please add it free.
    wktd @ March 17, 2010 edit
    Filed under: enart.nnkl.com