Sunday, February 12. 2012How large can a MySQL database become?Trackbacks
Trackback specific URI for this entry
No Trackbacks
Comments
Display comments as
(Linear | Threaded)
Thank you for the clarity Kristian. I will mention you in the post
InnoDB uses 32-bit page numbers as file offsets internally. Which, with the 16K page size, limits any tablespace (and thus, any single table) to 64TB.
That is also documented here: http://dev.mysql.com/doc/refman/5.5/en/innodb-restrictions.html
SchoonerSQL (a complete distribution of MySQL/InnoDB) runs several TB of InnoDB databases.
Instead of a rule of thumb, we help users characterize their workload in a real world. Working-set (data frequently accessed) determines how much DRAM is required for a database to achieve the desired levels of performance. If database becomes IO limited on HDDs, Flash memory such as FusionIO can help achieve order of magnitude improvements. We constantly run into users who run MySQL on many systems without utilizing any system effectively because each system is limited and sized to run mostly out of memory (to avoid hitting HDDs on read-misses). Another perspective :)
of course the myisamchk time for large MyISAM tables is probably going to be a limiting factor. Not much use if it takes a week before you can access your data again after a crash.
What if we use SSDs. Can we then assume memory limits are not as significant because SSDs can handle random accesses quite well. Are there any other internal limits one would run into in that case.
|
QuicksearchComments
about Wed, 31.10.2012 13:46
My friendly Offtopic Channel
in IRC has horror stories
about this, it is Halloween,
after all.
"Well, I do
have [...]
about Mon, 15.10.2012 09:41
What if we use SSDs. Can we
then assume memory limits
are not as significant
because SSDs can handle
random access [...]
about Fri, 05.10.2012 07:46
In fact, I am pretty certain
that this also breaks
mysql_upgrade or has the
potential to do so.
about Fri, 05.10.2012 06:44
It is quite a bit worse than
that: Right now, the default
RPM as distributed by Oracle
will fail to install if it
[...]
about Thu, 04.10.2012 18:52
> MyISAM in mysql.* has to go
before GTID can be
sucessfully deployed.
I
think you meant to say
before it can b [...]
about Thu, 04.10.2012 18:36
Sorry, it wasn't clear given
that none of this is
actually mentioned.
about Thu, 04.10.2012 13:47
You can turn it on with FLUSH
PRIVILEGES once the tables
exist.
about Thu, 04.10.2012 11:34
I think I have to install a
comment voting plugin just
so that i can +1 what Justin
just wrote.
Categories
Blog AdministrationDisclaimerAll examples, code-snippets, advice, trivia, etc. are supplied in the hope that they are useful, but no warranty of any kind is given. Use of trademarks is not intended as a challenge to them.
ImpressumCopyright 2005-2012 bei den jeweiligen Autorinnen der Beiträge. Die Infrastruktur von MySQL-dump wird betrieben von:
Azundris, Immanuelkirchstraße 18, 10405 Berlin, Germany
|