Archive

Archive for February, 2014

NYC, NYOUG and Delphix on March 12 & 13

February 25th, 2014

 

NYC_thomashawk

photo by Thomas Hawk

Interested in talking face to face about Delphix in NYC?  Drop me a line. I’ll be in NYC on March 12th and 13th and look forward to meeting folks who are excited to learn more about Delphix.

New York Oracle’s User Group (NYOUG) is meeting March 12 and I will be speaking in the morning about the Agile Data Revolution. The cornerstone of the Agile Data Revolution is instant database duplication but there is much much more to it.
Screen Shot 2014-02-25 at 8.01.42 AM

Uncategorized

Web ASH : W-ASH

February 23rd, 2014

I’m excited about the ease of creating rich user applications  that are web enabled  given the state of technology now. JavaScript and JQuery have gone from being disdained as “not a very serious” language to moving towards the limelight of front and center.

Here is a small example.

Download the following file:  W-ASH (web enabled ASH, file is wash.tar.gz )

Source is also on github at https://github.com/khailey/wash

Go to your apache web server root, in my case on redhat Linux is

# cd /usr/local/apache2
# gzip -d wash.tar.gz
# tar xvf wash.tar
-rwxr-xr-x  21956  14:08:21 cash.sh
-rw-r--r--  30881  11:52:10 htdocs/ash.html
drwxr-xr-x      0  15:40:52 htdocs/js/
-rwxr-xr-x  10958  14:04:42 cgi-bin/json_ash.sh

(the directory htdocs/js has a number of files put into it from Highcharts. I edited them out to make the output cleaner)

There are 3 basic files

  1. cash.sh  – collect ASH like data from Oracle into a flat file, it  runs in a continual loop
  2. ash.html  – basic web page using Highcharts
  3. json_ash.sh – cgi to read ASH like data and give it to the web page via JSON

Now you are almost ready to go. You just need to start the data collection with “cash.sh”  (collect ASH)

./cash.sh
Usage: usage <username> <password> <host> [sid] [port]

The script “cash.sh” requires “sqlplus” be in the path and that is all. It’s probably easiest to

  • move/copy cash.sh to an ORACLE_HOME/bin
  • su oracle
  • kick it off as in:
nohup cash.sh system change_on_install 172.16.100.250 orcl &

The script “cash.sh” will create a directory in /tmp/MONITOR/day_of_the_week for each day of the week, clearing out any old files, so there are only maximum 7 days of data. (to stop the  collection run “rm /tmp/MONITOR/clean/*end” )

To view the data go to your web server address and add “ash.html?q=machine:sid
For example my web server is on 172.16.100.250
The database I am monitoring is on host 172.16.100.250 with Oracle SID “orcl”

http://172.16.100.250/ash.html?q=172.16.100.250:orcl

 

 

See video at : http://screencast.com/t/sZrFxZkTrmn

Uncategorized

Delphix and Business Intelligence

February 21st, 2014

  • Businesses need data to make intelligent decisions better and faster than their competitors.
  • Most of the critical data for businesses runs in enterprise applications and the data has to be extracted and loaded into reporting environments, which are then loaded into large, unwieldy data warehouses.
  • Enterprise applications, however, are often overloaded and pegged for performance, with data growing every year and batch windows shrinking due to the need for 24/7 production availability.
  • Reporting systems, often overloaded from heavy extracts and constant reporting, are often taken offline during nightly data loads.
  • As a result, many companies face a looming brick wall for their intelligence systems.
  • When extracts fail to complete within batch windows, reporting environments are left with days old data, and data warehouses end up with even older data.
  • Leaving businesses flying blind.
  • Delphix continuously collects data from applications in near real-time, enabling businesses to offload operational reporting from transactional applications and allow more reporting, even during peak activity periods, such as processing end of quarter sales.
  • Data extracts can also be offloaded onto Delphix, eliminating performance constraints and eliminating dependence upon batch windows altogether.
  • Since workloads on Delphix have no impact on production systems, data can be extracted throughout the day, instead of during a nightly data window, which drives fresher data into reporting environments.
  • Operational data stores, workgroup reporting systems, and data warehouses can also be loaded into Delphix Engines.
  • In addition, a single Delphix Engine can easily support 20 or more virtual environments for development, testing, sandboxes, or data marts—even for large, unwieldy 100TB data warehouses.
  • Data management is the key to a successful analytics architecture.
  • Our agile data platform transforms the economics of analytics, delivering fresher data and higher availability.
  • Business intelligence matters.
  • Intelligent businesses run faster on Delphix.

Uncategorized

Lineage of the 100-400 slide PPT

February 19th, 2014

 

5727330912_ca5a5a7760graphic by Frits Ahlefeldt-Laurvig

There is the  Mandel approach to power points in presentations where one is suppose to spend 3 minutes per slide, thus a 60 minute presentation is 20 slides or less.

How about going the other way, showing 3 or more slides per minute?

Sound crazy? I like this approach. It’s the median between a film and a speaker with no slides. I like visuals in presentations and too many words tend to overwhelm me and eventually tune me out. Not only does too much text overwhelm but it conflicts with the speaker. If I’m reading the slide then I end up missing out on what the speaker is saying.

I found the following slide presentation from a few years ago  inspiring.

http://www.youtube.com/watch?v=40Lnoyv-sXg

The above video by Stéphane Faroult was  inspired by

http://www.youtube.com/watch?v=RrpajcAgR1E

and that  video was partially influenced by Lawrence Lessig

http://blip.tv/lessig/what-thing-regulates-law-6597278

One friend of mine, Connor McDonald, has done over 400 slides in 60 minutes. An example of his slides  is at

Connor_Mcdonald_Upgrade_Challenges

video is at

 http://youtu.be/w34FpT-3irM

As Edward Tufte, who railed against the bullet point power presentation style,  if one wants detailed content, print it out and let the attendees read them later. Wonder what Tufte would think of these presentations.

 

 

 

Uncategorized

Full free day of performance class at Oracle Corp

February 17th, 2014

This Thursday, Feb 20, I will be giving a full day of free Oracle performance classes.  Remember the serve the best lunch ever at the Oracle conference center . It’s top class!

Register here

Here is the write-up from NoCOUG on the day:

Banner
Invite your developers to attend the free ADF Developer Lab. Details in the NoCOUG Journal.
Dear friend,NoCOUG member Gwen Shapira told us that when she was a mid-level DBA, she was attracted to NoCOUG when she heard that rock star Oracle guru Kyle Hailey was going to speak at a NoCOUG conference.  That was the first of many NoCOUG conferences that Gwen attended. She gave her first Oracle presentation at NoCOUG the following year and her career began growing in leaps and bounds. Soon she was speaking all over the country and eventually became an Oracle ACE Director. You can read her interview in Oracle Magazine.The winter conference next Thursday is supercalifragilisticexpialidocious because Kyle Hailey is conducting a full-day DBA boot camp. You can spend the whole day listening to Kyle’s insights into the mysterious inner workings of Oracle Database. Let’s all take this opportunity to learn from Kyle. RSVP here.

Kindest regards,

The board members and volunteers of your favorite Oracle user group

DBA Boot Camp with Kyle Hailey—11:00–5:00
Kyle-hailey
Kyle Hailey was a principal designer for the Oracle Enterprise Manager performance pages. He is a member of Oracle Oak Table and the co-author of Oracle Insights: Tales of the Oak Table, and he was a technical editor of Oracle Wait Interface. He holds a patent in the area of database performance diagnosis and has been a speaker at Hotsos, NOCOUG, RMOUG, NYCOUG, and Oracle World; he also organizes Oaktable World. Kyle teaches classes around the world on Oracle performance tuning. Currently Kyle works as a performance architect at Delphix, along with industry-leading software, kernel, and filesystem designers, to take corporate data management to a new level of agility.
Lies, Damned Lies, and I/O Statistics—11:00–12:00
Given a description of gas dynamics and the atmosphere, you would be hard pressed to forecast tornadoes. The term “emergence” refers to the phenomena of surprising behaviors arising in complex systems. Modern storage systems are complex and full of emergent behavior that makes forecasting application I/O performance fiendishly difficult. In collaboration with Matt Hayward, Adam Leventhal, and others, Kyle Hailey has learned some rules of thumb for how to make accurate I/O performance forecasts. You’ll learn about forecasting, benchmarking, and analyzing I/O performance in this talk.
Visual SQL Tuning—1:00–2:00
The load on the database is caused by SQL; thus it makes sense that performance bottlenecks are caused by poorly performing SQL statements. We will follow a solid step-by-step method for analyzing, understanding, and tuning these problem SQL statements though Visual SQL Tuning (VST) diagrams. VST is a method of laying out the tables and joins of a query graphically to indicate key features of the query in the graphics. Through the VST, you’ll learn how to quickly visualize any coding errors in the query; discover flaws in the underlying database schema; and most important, find the best execution path through the query.
ASH Masters—2:30–3:30
Learn about ASH Masters, a GitHub repository of queries against Average Active History (ASH). Learn about ASH math, average active sessions, and the power and pitfalls of ASH queries. ASH queries will be shown that display over database performance from on high to diving deep down into the nitty-gritty of a performance bottleneck’s internal workings. ASH is the most powerful source of performance analytic data in Oracle. Querying ASH can be difficult, with a number of pitfalls, but the rewards of correct data analysis of ASH make it the most powerful tool a DBA has for performance analysis. Learn how to query ASH correctly, and learn where to get powerful prewritten ASH queries.
Agile Data: Revolutionizing Database Cloning—4:00–5:00
Database virtualization allows the same datafiles to be shared by multiple clones, allowing almost instantaneous creation of new copies of databases with almost no disk footprint. Along with storage efficiency, database virtualization allows agile management of database copies. The data agility eliminates bottlenecks in development by removing wait time for creating database environments, allows developers to have their own full copy of the database, and provides QA and UAT with immediate copies of the development environments for testing. This presentation will compare and contrast different types of database virtualization from Oracle 11 CloneDB, Oracle 12c Snap Clones, 12c Snapshot Manager Utility, Oracle ZFS Appliance, Delphix Appliance, VMware Data Director, NetApp Snap Manager for Oracle, and EMC. We’ll explain how database virtualization works and discuss the advantages and disadvantages of different approaches.

Uncategorized