Archive

Posts Tagged ‘mariaDB’

MySQL Conference and Expo 2013 feelings (#perconalive)

I wasn’t at the MySQL Conference this year but it was very nice to follow this event from Paris.
Of course I didn’t feel the general atmosphere by visiting booths or met fabulous people.
But it was a great opportunity to offer you a live post about the conference with an external point of view.

Twitter, RSS feeds (yes Google, I still use RSS), Planet MySQL and infiltrators were my best friends during this crazy week.

I would like to summarize the major announcements and events occurs during this tenth edition.
 

Oracle at Percona Live!

 
Yes, Oracle was at Percona Live 2013 and it was for the best.
I invite you to watch this keynote from Tomas Ulin about Oracle’s Investment in MySQL, read this post from Sheeri and this one from Mikael Ronstrom.
Oracle promises a future for MySQL and I’m sure many of you were expecting this signal.

MySQL 5.7 and MySQL Applier for Hadoop were also announced during the conference.
MySQL Applier reveals a promising use case for the binary log API.
You can read this first look of MySQL 5.7 by Stewart Smith.
 

TokuDB and Tungsten Replicator become open source

 
TokuDB is now open source via a community edition! (An enterprise edition remains available)
The MySQL, MariaDB or Percona users can now freely use TokuDB.
And this engine deserves your attention, for more informations : http://www.tokutek.com/2013/04/announcing-tokudb-v7-open-source-and-more/

Tungsten Replicator is now 100% open source. You no longer have excuses to not use this tool.
Continuent was corporate contributor of the year through the MySQL community awards 2013.
 

SkySQL + MariaDB = Love (the community)

 
The next generation of open source database company was born, SkySQL merges with MariaDB Developers. This merge doesn’t affect the MariaDB Foundation, MariaDB will survive!
In the same time Wikipedia adopts MariaDB and shares his experience with the community.

Honestly, I’ve never really understand why SkySQL and MariaDB was two separate companies because the SkySQL’s message was confused.
From now, you can’t be surprised that SkySQL highlights MariaDB and it’s a good point because MariaDB is a great product.
This may affect the independence of SkySQL on MariaDB competitors but I’m convinced that people behind SkySQL could surprise you.

And the new SkySQL/MariaDB becomes a strong alternative to Oracle.
The ping pong between Oracle and MariaDB on their respective resources affected to MySQL/MariaDB development is also quite funny and interesting.

ishot-63BIjZ7CjCQAEt6pb.jpg-large

However, I think that MariaDB should stop criticizing Oracle and should focus and communicate more on its own features.
This kind of message is a perfect exemple of counterproductive communication :
(I know this comes from zdnet but reflects what MariaDB proclaims usually)

MariaDB deserves better, but this is only my opinion.
 

In the meantime…

 
.. you can pin on a map where you come from.
HP, Amazon, Continuent and Percona talks about the impact of MySQL and its future in the cloud.
- Brian Aker (HPCloud) asked Simone Brunozzi (AWS) : what is the engine of DynamoDB?
- Simone : we don’t disclose
- Brian : it’s MySQL!

Peter Zaitsev evokes the JaSON generation of developers.

LeapMotion announce a new shipping date, you will have to wait another 3 months.

Incredible small data stats from Facebook, again…

“the best answer of 99.9% database optimization questions is ‘it depends’”, really?

Some amazing pictures of a rather unusual booth appear on my twitter timeline.
And this post from Sheeri caught my attention, the comments too.
I believe that if someone is uncomfortable in a conference such as perconalive, there is a problem… (even if this affects only one person)
 

Slides and what’s next?

 
Slides from the conference are now available.
You can find these slides and much more on [Plus].
Next steps will be MySQL Connect 2013 and Percona Live London 2013 (hope to see you there)

Continue to follow me on Twitter or Facebook for the latest news about the MySQL Community.

And don’t forget to have fun…

Categories: Live !

Does MariaDB kill the magic query?!

February 27th, 2013 5 comments

I’m sure that many of you use the magic query from Shlomi.
This query retrieves the difference between two status values with a single query.
I’m really fan of this kind of query and about this query in particular. This query is very useful to retrieve an information without to have to store a middle result.

Now, I tried this query on a MariaDB 5.5 server and I had a surprise :

Magic_query

The result was a bit strange, with negative or null values.

I’ve just had these server for few hours in my hands and I had no more time to analyze the situation.
I assume that the subquery optimisations in MariaDB can be involve here but it’s just an assumption.

Does anyone encountered the same issue? (with MariaDB or other distro)

Categories: Admin

[Plus] readers choice 2012 : It’s time to vote!

January 10th, 2013 4 comments

Oh yes, 2012 was an incredible year for the MySQL Community!
That’s why I would like to change the rules this year and I would like to offer you a new survey for this [Plus] reader’s choice 2012.

Community users, bloggers and events made the whole community last year, tell us how you used this community?
It will only take 5 minutes of your precious time, votes will be closed Jan. 31.

Vote for what you used! (with your heart, again…)

What was your most useful blogs in 2012? (Two possible answers)

  • MySQL Performance Blog (Percona Team) (57%, 73 Votes)
  • The MariaDB Blog (MariaDB Team) (17%, 22 Votes)
  • SkySQL Blog (SkySQL Team) (13%, 17 Votes)
  • Xaprb Blog (Baron Schwartz) (9%, 12 Votes)
  • The Data Charmer (Giuseppe Maxia) (9%, 11 Votes)
  • Openark Blog (Shlomi Noach) (6%, 7 Votes)
  • The Scale Out Blog (Robert Hodges) (6%, 7 Votes)
  • Domas Mituzas's blog (5%, 6 Votes)
  • OpenLife.cc (Henrik Ingo) (4%, 5 Votes)
  • Pythian Blog (Pythian Team) (4%, 5 Votes)
  • Yoshinori Matsunobu's blog (4%, 5 Votes)
  • Dba Square (Maciej Dobrzanski & Piotr Biel) (4%, 5 Votes)
  • Johan Andersson's Cluster and HA Blog (3%, 4 Votes)
  • Chris on MySQL (Chris Calender) (3%, 4 Votes)
  • MySQL[Plus] (Cédric Peintre) (3%, 4 Votes)
  • Ulf Wendel's blog (2%, 3 Votes)
  • Hack MySQL (Daniel Nichter) (2%, 3 Votes)
  • MySQL Optimizer Team Blog (2%, 3 Votes)
  • Oracle's MySQL Blog (Oracle Team) (2%, 3 Votes)
  • MySQL Documents by Rick James (2%, 2 Votes)
  • Sergey Petrunia's blog (2%, 2 Votes)
  • LinuxJedi's /dev/null (Andrew Hutchings) (2%, 2 Votes)
  • Sheeri Dot Com (Sheeri K. Cabral) (2%, 2 Votes)
  • Karlsson on databases and stuff (Anders Karlsson) (2%, 2 Votes)
  • MySQL Fanboy (Mark Grennan) (1%, 1 Votes)
  • varokism (Stéphane Varoqui) (1%, 1 Votes)
  • MySQL Expert (Ronald Bradford) (1%, 1 Votes)
  • Roland Bouman's blog (1%, 1 Votes)
  • mySQL DBA (Dathan Pattishall) (1%, 1 Votes)
  • Mastering MySQL (Mark Leith) (1%, 1 Votes)
  • sqlhjalp (Keith Larson) (1%, 1 Votes)
  • mysqlboy (Andrew Moore) (0%, 0 Votes)
  • Andrew Morgan’s MySQL Cluster Database Blog (0%, 0 Votes)
  • Webyog blog (Webyog Team) (0%, 0 Votes)
  • Racker Hacker (Major Hayden) (0%, 0 Votes)
  • Todd's MySQL Blog (Todd Farmer) (0%, 0 Votes)

Total Voters: 127

Loading ... Loading ...

What was your most useful forum in 2012? (or exchange platform)

  • stackoverflow.com (41%, 38 Votes)
  • Twitter (18%, 17 Votes)
  • forums.mysql.com (13%, 12 Votes)
  • dba.stackexchange.com (10%, 9 Votes)
  • Facebook (10%, 9 Votes)
  • LinkedIn Groups (7%, 6 Votes)
  • Yahoo Answers (1%, 1 Votes)
  • dbforums.com/mysql (0%, 0 Votes)
  • Viadeo Groups (0%, 0 Votes)

Total Voters: 92

Loading ... Loading ...

What was the best MySQL event in 2012?

  • MySQL Conference & Expo (37%, 33 Votes)
  • Percona Live London (30%, 27 Votes)
  • FOSDEM (10%, 9 Votes)
  • Percona Live New York (8%, 7 Votes)
  • MySQL Connect (7%, 6 Votes)
  • Percona Live DC (3%, 3 Votes)
  • MySQL/NoSQL/Cloud Latin America conference (3%, 3 Votes)
  • OSCON (2%, 1 Votes)

Total Voters: 89

Loading ... Loading ...

What would you like to test in 2013? (Two possible answers)

  • Galera Replication (Percona Cluster or MaraDB Cluster) (49%, 60 Votes)
  • MySQL 5.6 (45%, 55 Votes)
  • MariaDB 10 (35%, 43 Votes)
  • Tungsten Replicator (13%, 16 Votes)
  • MySQL 5.5 (Oracle, Percona or MariaDB) (11%, 14 Votes)
  • NoSQL/NewSQL databases (8%, 10 Votes)
  • iPhone 6 (3%, 4 Votes)
  • NDB Cluster (2%, 2 Votes)
  • Other (Leave a comment) (2%, 2 Votes)

Total Voters: 123

Loading ... Loading ...

Have fun in 2013!

Categories: Readers Choice

Vote for MySQL[plus] awards 2011 !

January 5th, 2012 27 comments

First of all, I wish you a happy new year.
Many things happened last year, it was really exciting to be involved in the MySQL ecosystem.
I hope this enthusiasm will be increased this year, up to you !

To start the year, I propose the MySQL[plus] Awards 2011
It will only take 5 minutes to fill out these polls.
Answer with your heart first and then with your experience with some of these tools or services.

Polls will be closed January 31, so, vote now !
For “other” answers, please,  let me a comment with details.

Don’t hesitate to submit proposal for tools or services in the comments.
And, please, share these polls !

 

Best MySQL GUI client Tool

  • SQLyog (47%, 85 Votes)
  • MySQL Workbench (20%, 36 Votes)
  • HeidiSQL (8%, 14 Votes)
  • Navicat for MySQL (7%, 12 Votes)
  • MySQL Administrator / Query browser (6%, 10 Votes)
  • Other (5%, 9 Votes)
  • phpMyAdmin (4%, 8 Votes)
  • SQLWave (1%, 1 Votes)
  • SIDU DB Web GUI (1%, 1 Votes)
  • EMS SQL Manager for MySQL (1%, 1 Votes)
  • Sequel Pro (1%, 1 Votes)
  • sqldeveloper (1%, 1 Votes)
  • dbForge Studio (1%, 1 Votes)
  • MyQuery (1%, 1 Votes)
  • DBTools Manager (0%, 0 Votes)
  • SQL Maestro MySQL Tools (0%, 0 Votes)
  • Toad for MySQL (0%, 0 Votes)

Total Voters: 181

Loading ... Loading ...

 

Best MySQL Monitoring Tool

  • MONyog (35%, 135 Votes)
  • MySQL Enterprise Monitor (29%, 113 Votes)
  • Nagios (13%, 52 Votes)
  • Cacti (10%, 38 Votes)
  • Other (6%, 25 Votes)
  • Zabbix (5%, 19 Votes)
  • Ganglia (2%, 4 Votes)

Total Voters: 386

Loading ... Loading ...

 

Best MySQL Backup Tool (two possible answers)

  • Xtrabackup (46%, 151 Votes)
  • mysqldump (29%, 94 Votes)
  • MySQL Enterprise Backup (28%, 91 Votes)
  • mydumper (9%, 30 Votes)
  • LVM Backup (FS snapshot) (6%, 19 Votes)
  • mylvmbackup (5%, 17 Votes)
  • ZRM Enterprise (5%, 15 Votes)
  • ZRM Community (5%, 15 Votes)
  • Other (5%, 15 Votes)
  • Cold backup (2%, 6 Votes)
  • r1soft CDP for MySQL (1%, 2 Votes)

Total Voters: 329

Loading ... Loading ...

 

Best MySQL Replication/Cluster Tools (two possible answers)

  • MySQL Replication (37%, 183 Votes)
  • Tungsten Replicator (21%, 105 Votes)
  • MySQL NDB Cluster (17%, 83 Votes)
  • ShoonerSQL (16%, 76 Votes)
  • Galera Replication (13%, 66 Votes)
  • DRBD (9%, 45 Votes)
  • Other (2%, 11 Votes)
  • ScaleDB (2%, 9 Votes)

Total Voters: 490

Loading ... Loading ...

 

Best MySQL community Tool

  • Percona toolkit (37%, 117 Votes)
  • MySQL Sandbox (28%, 89 Votes)
  • MHA for MySQL (mysql-master-ha) (14%, 45 Votes)
  • Other (6%, 18 Votes)
  • Xtrabackup Manager (5%, 15 Votes)
  • mysqltuner (3%, 11 Votes)
  • Innotop (3%, 10 Votes)
  • mycheckpoint (2%, 5 Votes)
  • openark kit (1%, 3 Votes)
  • MMM (1%, 3 Votes)
  • Common schema (0%, 2 Votes)

Total Voters: 318

Loading ... Loading ...

 

Best MySQL Support Service

  • SkySQL (38%, 130 Votes)
  • Percona (28%, 96 Votes)
  • Oracle (26%, 90 Votes)
  • Other (4%, 15 Votes)
  • FromDual (3%, 9 Votes)
  • Pythian (1%, 4 Votes)
  • Blue Gecko (0%, 1 Votes)
  • PalominoDB (0%, 0 Votes)

Total Voters: 345

Loading ... Loading ...

 

Best MySQL based distribution

  • Oracle MySQL (36%, 122 Votes)
  • MariaDB (33%, 114 Votes)
  • Percona server (27%, 91 Votes)
  • Drizzle (3%, 11 Votes)
  • Other (1%, 4 Votes)
  • TokuDB (0%, 0 Votes)
  • InfiniDB (0%, 0 Votes)

Total Voters: 342

Loading ... Loading ...

 

Best NoSQL solution (two possible answers)

  • Memcached (46%, 120 Votes)
  • Hadoop / HBase (28%, 72 Votes)
  • MongoDB (25%, 65 Votes)
  • Cassandra (10%, 27 Votes)
  • Other (10%, 27 Votes)
  • HandlerSocket (9%, 24 Votes)
  • CouchDB (6%, 16 Votes)
  • Redis (5%, 13 Votes)
  • Tarantool (4%, 11 Votes)
  • Riak (3%, 7 Votes)
  • Amazon SimpleDB (2%, 5 Votes)
  • Tokyo Cabinet / Tyrant (1%, 3 Votes)

Total Voters: 259

Loading ... Loading ...

 

Best MySQL 5.6 improvement

  • Performances (27%, 77 Votes)
  • Replication (26%, 74 Votes)
  • Fulltext (16%, 47 Votes)
  • memcached API (13%, 36 Votes)
  • Backup/Restore buffer pool (8%, 22 Votes)
  • Partitioning (6%, 16 Votes)
  • Other (4%, 11 Votes)

Total Voters: 285

Loading ... Loading ...

 

Happy 2012 !
Cédric

This article is obviously not sponsored !
(MySQL is a trademark of Oracle Corporation and/or its affiliates)

Categories: Readers Choice

Why a new memory engine may change everything ?

September 26th, 2011 6 comments

I’m sure you are aware that the last Percona server release includes a new improved MEMORY storage engine for MySQL.
This new engine is based on Dynamic Row Format and offers some of great features, specialy for VARCHAR, VARBINARY, TEXT and BLOB fields in MEMORY tables.

But because this new MEMORY engine by Percona has some limitations and because Percona server hasn’t used it for its internal temporary tables yet, I would like to talk about what can be the real benefits to have a brand new MEMORY engine based on Dynamic row format specialy for internal memory tables.

Just remember or discover how MySQL uses internal memory tables

And the MEMORY storage engine characteristics and its limitations

So, the memory storage engine transforms all varchar fields in char fields for internal temporary tables or for user created memory tables. 

1. Let me explain what is the problem with a simple exemple :

I’ve created an InnoDB table (without index) with two varchar fields (50 & 100) :

mysql> show table status like 'test_memory5'\G
*************************** 1. row ***************************
           Name: test_memory5
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 621089
 Avg_row_length: 66
    Data_length: 41484288
Max_data_length: 0
   Index_length: 0
      Data_free: 5242880
 Auto_increment: NULL
    Create_time: 2011-09-21 13:10:17
    Update_time: NULL
     Check_time: NULL
      Collation: latin1_swedish_ci
       Checksum: NULL
 Create_options:
        Comment:

The size of this table is about 48Mb (and more than 600.000 rows) :

-rw-rw---- 1 mysql mysql  48M 2011-09-21 13:11 test_memory5.ibd

Now, I’m creating a new memory table with exactly the same structure and I’m setting paramters for memory tables like this :

  • set tmp_table_size=50*1024*1024;
  • set max_heap_table_size=50*1024*1024;

That means I can create a 50Mb max memory table.
Thus, let me insert my 600.000 rows in this table :

mysql> insert into test_memory6 select * from test_memory5;
ERROR 1114 (HY000): The table 'test_memory6' is full

My 50Mb memory table can’t  contain the 48Mb of the InnoDB table !
Let’s try with 80Mb :

mysql> set tmp_table_size=80*1024*1024;
Query OK, 0 rows affected (0.00 sec)
mysql> set max_heap_table_size=80*1024*1024;
Query OK, 0 rows affected (0.00 sec)
mysql> insert into test_memory6 select * from test_memory5;
ERROR 1114 (HY000): The table 'test_memory6' is full

And this error occurs until the memory tables can have a 110Mb maximum size !

Why ? Because the two varchar fields of the InnoDB table are converted in char fields with the memory storage engine.
Let’s see this example from MySQL documentation :

Value CHAR(4) Storage Required VARCHAR(4) Storage Required
'' '    ' 4 bytes '' 1 byte
'ab' 'ab  ' 4 bytes 'ab' 3 bytes
'abcd' 'abcd' 4 bytes 'abcd' 5 bytes
'abcdefgh' 'abcd' 4 bytes 'abcd' 5 bytes

By the way, this is a very good reason to take care of your varchar fields.

Conclusion : A memory table can be really bigger than an InnoDB table

2. Let  me explain why a new memory engine may change everything :

Changing the rules for memory tables may change everything for, at least, two reasons :

  • VARCHARVARBINARYTEXT and BLOB fields will be supported by this new engine for user created memory tables (Percona server can do it with restrictions)
  • Internal memory tables could be more efficient with Dynamic Row Format
The real benefits will come with internal memory tables, how often do you see that when you “explain” your queries :
Extra: Using where; Using temporary; Using filesort

Thus, for each query using a temporary table, MySQL could use less of memory (RAM) !
I don’t know what would be the real benefit but I am convinced that it can be really significant.

I look forward to see more benchmark about that with last percona server release and I hope that Percona server or MariaDB will support dynamic row format for internal memory tables soon.

Please, let us know if you have already tested this new Percona Memory engine.

Categories: Admin