While at Delphix, we did a lot of storage benchmarking. The I/O response times of Delphix depends, as one would logically imagine, heavily on the underlying disks. Sure Delphix can cache a lot ( with 1 TB of ram and 3x compression that's 3TB and that 3TB can be shared by 10 or a 100 copies being the equivalent to 30TB or 300TB of databases) but really there will always be important I/O coming from the storage subsystem.
Now Delphix mainly runs databases loads, so the best test for storage that is hooked up to Delphix is to benchmark the storage I/O ...
khailey
Uncategorized
'
photo by Thomas Hawk
https://github.com/khailey/pgmon
$ ./pgmon.sh
Usage: pgmon.sh [username] [password] [host] <sid=postgres> <port=5432> <runtime=3600>
$ ./pgmon.sh kyle kyle mymachine.com
psql -t -h mymachine.com -p 5432 -U kyle postgres < /tmp/MONITOR/tmp/mymachine.com:postgres_collect.pipe &
RUN_TIME=-1
COLLECT_LIST=
FAST_SAMPLE=wts
TARGET=mymachine.com:postgres
DEBUG=0
Connected, starting collect at Wed Mar 8 12:05:12 PST 2017
starting stats collecting
SET
AAS| blks_hit | blks_read | tup_returned | tup_fetched | tup_inserted | tup_updated | tup_deleted
1 | 38281 | 1 | 628629 ...
khailey
Uncategorized
pgload.jmx is JMX file you can load into Jmeter and run a substantial load on a Postgres database. Should work just as well on Oracle if you change the test SQL from "Select 1" to "select 1 from dual"
Install jmeter on our machine . On my mac, I did
brew install jmeter
You will need the Postgres driver. I used
postgresql-9.4-1202.jdbc4.jar from https://jdbc.postgresql.org/download.html
Put it in the classpath in jmeter
To use this file, save it as pgload.jmx and then open it up with Jmeter. Change the database URL with host, port, database name, and fill in your username and password.
The database URL looks like jdbc:postgresql://machine.com:5432/database
where "machine.com" is ...
khailey
Uncategorized
Little did I know this building that captured my visual attention and imagination so many times walking to work over the last 6 months would play a historic roll in the current political climate.
Here is a picture of the US District Court House from recent articles
And here are some of my iPhone shots over the last few months with some Instagram filtering mixed in :)
khailey
Uncategorized
So Jmeter seems super cool.
I've only used it a little bit but it does seem a bit touchy about somethings (like spaces in input fields) and the errors are often less than obvious and I'm not finding that much out there on google for the errors.
Today I ran into the error
Variable Name must not be null in JDBC Request
and Googling it didn't turn up anything.
I'm pretty sure I ran into this same error a few weeks ago when I was first starting with Jmeter, so blogging here to document it.
I was trying something new - running a procedure - instead ...
khailey
Uncategorized
This blog post is just a start at documenting some of my experiences with jmeter. As far as load testing tools go, jmeter looks the most promising to me. It has an active community, supports many different databases and looks quite flexible as far as architecting different work loads goes.
The flexibility of jmeter also makes it hard to use. One can use jmeter for many other things besides databases so the initial set up is a bit oblique and there look to be many paths to similar results. As such, my understand and method for doing things will probably change ...
khailey
Uncategorized
Dan Tow, in his book SQL Tuning, lays out a simple method of tuning SQL queries. The method is
Draw a diagram of each table in the query with Children above Parents
Draw join lines between each join (many-to-many, one-to-many)
Mark each table with a predicate filter and calculate the amount of table filtered out
Then to find a great optimal optimization path candidate
Start at the table with the strongest predicate filter (the filter that returns the fewest % of the table)
join down to children (if multiple children join to child with strongest predicate filter)
If you can't join to children, join up to parent
The ...
khailey
Uncategorized
Upgrading is always stressful - be it a computer, an Oracle database or an iPhone. There's always a good chance for lost data and lost time dealing with complications.
So yesterday I picked up a new iPhone 7 from Verizon. The pickup was seamless. I had signed up for an upgrade program when I got the iPhone 6, so now I just walked in, gave them my old iPhone 6 and they gave me an new iPhone 7. It's bit scary giving up my old phone before restoring to my new phone, but I had a backup AND I asked Verizon to please ...
khailey
Uncategorized
Every so often a DSS query that usually takes 10 minutes ends up taking over an hour. (or one that takes an hour never seems to finish)
Why would this happen?
When investigating the DSS query, perhaps with wait event tracing, one finds that the query which is doing full table scans and should be doing large multi-block reads and waiting for “db file scattered read” is instead waiting for single block reads, ie “db file sequential read”. What the heck is going on?
Sequential reads during a full table scan scattered read query is a classic sign of reading rollback and reading ...
khailey
Uncategorized
Excited to see the announcement of Amazon RDS Performance Insight feature for database performance monitoring and tuning.
Having met the team for this project I can say from my personal view point that the importance and future success of this feature is clear as day to me. The team is awesomely sharp, the architecture is super impressive, and this is by far the most exciting performance monitoring and feedback system I've been involved with, surpassing the work I've been involved in on Oracle's performance monitoring and tuning system and Embarcadero's DB Optimizer and Quest Foglight and Spotlight. Not only does the feature ...
khailey
Uncategorized
Recent Comments