I’m not sure why REST needs defending but apparently it does… Dare steps in and provides a solid background and Tim follows up… What is really interesting about REST from my perspective (and not everyone will agree) is that since it’s REST you can actually solve real problems without getting permission from a standards board. [...]
Categories: java,open source,REST,RSS,web2.0
In the past I’ve often used in-memory data structures (vs on disk) in situations where allocating say 5-10MB of data in the local VM is much better than continually hitting a database. This has only worked because I’m not using very large data structures. My language classification codes uses about 8MB of memory stored in [...]
Categories: java,open source
I just spend a few hours today setting up RAID on SSD to see what the performance boost would look like. I’m very happy with the results but they’re not perfect. Here’s the results from comparing a single Mtron SSD vs a RAID 0 array running with a 64k chunk size. Figure 1: Mtron SSD [...]
Categories: clustering,linux,open source,SSD
It looks like Fusion IO has published more numbers about their SSD flash storage devices. For starters, the price is totally reasonable. $2400 for an 80G device. This is $30/GB which puts it roughly 2x the price of the Mtron at $/GB. Not to bad. The raw performance numbers seem amazing: However, these can be [...]
Categories: clustering,linux,open source,SSD
Big DBA Head has run some independent MySQL benchmarks with the Mtron SSD drives that I’ve been playing with. Great to see that we’re coming to the same conclusions. It’s nice to have your research validated. Run time dropped from 1979 seconds on a single raptor drive to 379 Seconds on the standalone Mtron drive. [...]
Categories: clustering,linux,mysql,open source,SSD
I spent some more time today comparing InnoDB and MyISAM on SSD. I increased the data/cache ratio by about 5X. I allocated 1G of memory for MyISAM or InnoDB (restating MySQL after each test). Resulting on disk images are 6G for MyISAM and 7G for InnoDB. This is on a 30M row DB which stores [...]
Categories: clustering,linux,memcached,mysql,open source,SSD
I’ve been reviewing the random write performance with SSDs over the last few days and have a few updates on their performance numbers. It turns out that SSDs themselves need to handle random write IO to obtain ideal performance numbers. Due to the erase block latency on NAND flash, performance can start to suffer when [...]
Categories: linux,mysql,open source,SSD
I’ve now had about 24 hours to play with the Mtron SSDs and had some time to benchmark them. The good news is that the benchmarks look really solid. The drive is very competitive in terms of performance. I’m seeing about 100MB/s sequential read throughput and 80MB/s sequential write throughput. I’ve had some time to [...]
Categories: clustering,debian,linux,mysql,open source,SSD
I’ve been reviewing our settings for innodb prior to testing our new SSDs drives later this week. Here are some initial thoughts: * Both sync_binlog and innodb_flush_log_at_trx_commit should both be enabled. The extra seeks required isn’t really an issue on SSD and the extra reliability is worth the slight performance hit. * Read ahead for [...]
Categories: clustering,linux,mysql,open source
It looks like there’s another competitive SSD on the market. The Stec Zeus IOPS. I foolishly dismissed this drive before because I thought they weren’t disclosing their write rate (which all the other vendors are doing to lie about their performance). Turns out they’re claiming 200MB/s with 100MB/s write throughput. If these numbers are accurate [...]
Categories: clustering,linux,mysql,open source,startups,web2.0