Thanks to antville.org
Check for table corruption quick and fast

#!/bin/sh

for dbname in `mysqlshow | awk '{print $2}'`
do
mysqlcheck $dbname ticket -Fq
done

# call this shell script and find the errors
time sh check.sh | grep error

... Link (0 comments) ... Comment


mysql analysis

When there is an issue, We should gather some preliminary data to analyze first.

tee 'output.txt';
SHOW GLOBAL STATUS;
SHOW ENGINE INNODB STATUS;
SHOW FULL PROCESSLIST;
SELECT SLEEP(60);
SHOW GLOBAL STATUS;
SHOW ENGINE INNODB STATUS;
SHOW FULL PROCESSLIST;

SHOW GLOBAL VARIABLES;
notee;

Study the 'output.txt' file. Also the my.cnf and slow query log
From the OS;

free -m
ps aux
df -h

iostat -x 1 5
vmstat 1 5
top -b -n 3
mysql> show global status;

... Link (0 comments) ... Comment


mysql to postgresql

It is incredibly easy to migrate from MySQL to PostgreSQL. Just migrate your schema first (leaving foreign keys out until after restore) and then the mysqldump files are almost perfectly compatible with PostgreSQL when using:

mysqldump --compatible=postgresql --no-create-db --no-create-info --add-locks=false --quote-names=false --complete-insert=true

I just had to convert \' to two single quotes and fix MySQL's infamous null dates (0000-00-00 00:00:00) to be true nulls and was able to pipe the backup right into psql.

sed -e "s/\\\'/\'\'/g" -e "s/\'0000-00-00 00:00:00\'/null/g" backup.sql > output.sql

... Link (0 comments) ... Comment


import data faster

Following my.cnf parameter is highly recommended on high configuration machine. This will make importing myisam only data much faster.

#datadir=/var/lib/mysql
datadir=/mnt/data/mysql/
user=root
skip-innodb
default-storage-engine=myisam
key-buffer=1G
bulk_insert_buffer_size=1G
myisam_max_sort_file_size=20G

tmpdir=/mnt/data/mysql

... Link (0 comments) ... Comment


MySQL on Ubuntu

If you are using Ubuntu and can not change the data directory, you need to edit the file

/etc/apparmor.d/usr.sbin.mysqld

Disable firewall (ufw disable) and check the ownership and directory permissions.

ufw disable

... Link (0 comments) ... Comment


innodb metadata

Innodb tables queries based on information_schema may be slower. In order to improve the performance, we need to disable metadata updates.

set global innodb_stats_on_metadata = 0;

http://dev.mysql.com/doc/refman/5.5/en/innodb-parameters.html#sysvar_innodb_stats_on_metadata

... Link (0 comments) ... Comment


happy swapping

# sysctl vm.swappiness
vm.swappiness = 60

With that setting the Linux kernel feels encouraged to use the available swap. On a dedicated MySQL server, swappiness should be set to zero to discourage kernel from swapping out application memory.

# sysctl -w vm.swappiness=0
vm.swappiness = 0

This changes the runtime setting. To allow the change to survive system restarts, just add vm.swappiness=0 as a separate line into /etc/sysctl.conf

... Link (0 comments) ... Comment


Install latest mysql

Set up git:

yum install git-core
cd ~/.ssh
ssh-keygen -t rsa -C "shantanu.oak@gmail.com"

Contents of the file "id_rsa.pub" should be copied to gitHub site.
On the GitHub site Click “Account Settings” > Click “SSH Public Keys” > Click “Add another public key”

This will allow passwordless access to github site:
ssh -T git@github.com
_____

Global setup:

git config --global user.name "Shantanu Oak"
git config --global user.email shantanu.oak@gmail.com
_____

Next steps:

mkdir syllabalize_unicode
cd syllabalize_unicode
git init
touch README
git add README
git commit -m 'first commit'
git remote add origin git@github.com:shantanuo/syllabalize_unicode.git
git push -u origin master
_____

Existing Git Repo?

cd existing_git_repo
git remote add origin git@github.com:shantanuo/syllabalize_unicode.git
git push -u origin master
_____

clone (download) the source
git clone git@github.com:ahiguti/HandlerSocket-Plugin-for-MySQL.git
_____

Install MySQL

mkdir download
cd download
wget http://files.directadmin.com/services/all/mysql/64-bit/5.5.20/MySQL-client-5.5.20-1.linux2.6.x86_64.rpm
wget http://files.directadmin.com/services/all/mysql/64-bit/5.5.20/MySQL-devel-5.5.20-1.linux2.6.x86_64.rpm
wget http://files.directadmin.com/services/all/mysql/64-bit/5.5.20/MySQL-server-5.5.20-1.linux2.6.x86_64.rpm
wget http://files.directadmin.com/services/all/mysql/64-bit/5.5.20/MySQL-shared-5.5.20-1.linux2.6.x86_64.rpm

The commands are as follows:

rpm -iUh *

After installing mysql shared compact library, this was working as expected

wget ftp://ftp.isu.edu.tw/pub/Unix/Database/MySQL/Downloads/MySQL-5.5/MySQL-shared-compat-5.5.24-1.el6.x86_64.rpm
rpm -ihv MySQL-shared-compat-5.5.24-1.el6.x86_64.rpm
yum install php-mysql --skip-broken

_____

Here is how it can be achieved using remi or epel

/usr/bin/wget http://rpms.famillecollet.com/enterprise/remi-release-6.rpm
/bin/rpm -Uvh *.rpm
/usr/bin/yum install --enablerepo=remi mysql-server.x86_64*

Using epel:

wget http://download.fedoraproject.org/pub/epel/5/x86_64/epel-release-5-4.noarch.rpm
rpm -Uvh epel-release-5-4.noarch.rpm
yum install python26

... Link (0 comments) ... Comment


innodb_buffer_pool_instances

Divides the buffer pool into a user-specified number of separate regions, each with its own LRU list and related data structures, to reduce contention during concurrent memory read and write operations. The size specified by innodb_buffer_pool_size is divided among all the buffer pool instances. For best efficiency, specify a combination of innodb_buffer_pool_instances and innodb_buffer_pool_size so that each buffer pool instance is at least 1 gigabyte.

... Link (0 comments) ... Comment


new data-directory for MySQL

If you need fresh mysql installation you need to run script to create default mysql database and system tables. The script is called "mysql_install_db" and is either in the bin or in scripts directory of your mysql installation. Change the my.cnf to reflect new datadir and run mysql_install_db for it to create mysql database and system tables in the new datatir and then start mysqld_safe.

... Link (0 comments) ... Comment


Online for 7914 days
Last modified: 4/24/24, 9:33 AM
Status
Youre not logged in ... Login
Menu
... Home
... Tags

Search
Calendar
April 2024
SunMonTueWedThuFriSat
123456
78910111213
14151617181920
21222324252627
282930
January
Recent updates
discretize continuous features You can
"discretize" or "bin" continuous features into categorical features. from sklearn.preprocessing...
by shantanuo (4/24/24, 9:33 AM)
User Defined Property You
can create User Defined Property in libreoffice writer. File – Properties...
by shantanuo (1/9/23, 8:52 AM)
Arranging Chapters in the Navigator
To use a custom paragraph style for a heading, choose...
by shantanuo (1/4/23, 8:26 AM)
Use focus mode using Android
phones Settings > Digital Wellbeing and parental controls. Tap your...
by shantanuo (1/1/23, 3:59 AM)
Embed Fonts in document If
you use a font that the recipient is unlike to...
by shantanuo (12/18/22, 10:07 AM)
Using Navigator in Writer To
open the Navigator, select View > Navigator, or press the...
by shantanuo (12/18/22, 10:06 AM)
More about hyphenation The settings
for Tools > Options > Language Settings > Writing Aids...
by shantanuo (12/18/22, 10:04 AM)
link or unlink template If
you are using Libre office then template changer extension is...
by shantanuo (12/16/22, 5:27 AM)
Finding Styles you can select
Edit > Find and Replace > Other Options > Paragraph...
by shantanuo (12/14/22, 7:17 AM)
regex in clac In LibreOffice
Calc, you can use function REGEX for e.g. Begins with...
by shantanuo (12/14/22, 4:40 AM)
Libre Calc tips Turn Off
Grid Lines If you want to turn off grid lines...
by shantanuo (12/13/22, 8:14 AM)
More about Styles You can
goto View - Styles and change "All Styles" to "Applied...
by shantanuo (12/13/22, 7:49 AM)
Page Break Before Every Chapter
If your chapter titles are using the "Heading 2" Style:...
by shantanuo (12/13/22, 6:36 AM)
View and print in different
color Displaying Color in LO but Printing as White Page...
by shantanuo (12/13/22, 6:26 AM)
Change Normal Template in Libreoffice
Writer 1) Open a new file and set your font;...
by shantanuo (12/12/22, 8:45 AM)
Short english words in Devanagari
The list of short english words written in Devanagari. #...
by shantanuo (10/5/22, 9:05 AM)
Card issuing banks CITI
Standard Chartered HSBC American Express HDFC ICICI AXIS INDUS IND Kotak...
by shantanuo (7/16/22, 4:46 AM)
Activate IAM Access To activate
the Activate IAM Access setting, you must log in to...
by shantanuo (7/12/22, 5:52 AM)
use cheat instead of man
wget https://github.com/cheat/cheat/releases/download/4.2.3/cheat-linux-arm64.gz gunzip cheat-linux-arm64.gz chmod 770 cheat-linux-arm64 ./cheat-linux-arm64 mv cheat-linux-arm64...
by shantanuo (7/4/22, 8:53 AM)
python module itertools list of
useful methods of itertools module. permutations combinations combinations_with_replacement zip_longest count...
by shantanuo (9/8/21, 7:50 AM)
wikipedia tools 1) Collection of
useful utilities https://wikipediatools.appspot.com/ 2) all history of a user https://xtools.wmflabs.org/ec/mr.wikisource.org/Shantanuo...
by shantanuo (8/20/21, 6:36 AM)
Duration/Term of Copyright In the
case of original literary, dramatic, musical and artistic works, the...
by shantanuo (8/20/21, 6:26 AM)
Preserve seeds 6 types of
seeds to be preserved for next season. 1) laal Mula...
by shantanuo (5/7/21, 5:46 AM)
Why do I care for
Linux? I don't care that much for other software. Linux...
by shantanuo (12/17/20, 9:27 AM)
important leafy vegetables 1. Amaranthus
caudatus: rajgira. 2. Amaranthus tricolor: Math.  (Chhoti Chulai- Hindi, Cheera-...
by shantanuo (4/12/20, 2:01 PM)

RSS feed

Made with Antville
Helma Object Publisher