Archive

Archive for September, 2015

Delphix Express installation

September 29th, 2015

This post is part of a series

A couple of blog post ago I announced that there is now a free version of Delphix.  Here is a little more information about the installation of Delphix Express.

To get Delphix Express, the free version of Delphix, go to

and create an account, then log in. You should see a DelphixExpress folder. Click on it and you can download the OVAs.

Delphix Express

Delphix Express clones databases in minutes for almost not storage and will automates backing up you databases saving typically 30 days of backups down to the second in the size of the original database.

Delphix Express is a free version of Delphix limited to 25 GB of managed storage and 1 vCPU. Delphix Express is set up for small projects and not optimized for high throughput nor performance testing.

Landshark

Landshark is a set of 2 virtual machines consisting of a data source Linux VM and a target Linux VM. The source VM has Oracle XE preinstalled with a database and a web application installed that uses the database. The target VM has Oracle XE installed but no database and no web application. Landshark is set up to automatically register the two VMs with Delphix Express and to link the two data sources on the source VM. Once finished one can start provision a virtual database on the target machine as well as provisioning a virtual web application on the target machine

Delphix Express with Landshark Requirements

  • 60 GB free disk space
  • 6 GB of available memory
  • internet connectivity *

Compatible Hypervisors

  • VMware
    • ESX 5.0, 5.1, 5.5
    • Fusion 4,5,6,7
    • Workstation 8,8,10,11
  • Virtualbox
    • 4.3

Installation time

Required install time : 15 – 30 minutes

Architecture

Delphix Express installs a virtual machine. Landshark installs as 2 virtual machines, a Linux Source and a Linux target. The source has an XE database and web application that uses that database. The target just has the XE binaries and no database nor web application. The target has scripts that run automatically and find Delphix Express and the source and autoconfigure. After the autoconfigure finishes, the Delphix Express is linked to the source database ans source web application meaning one can provision a thin clone or virtual database onto the target. Landshark is not required for using Delphix Express but if you have never used Delphix, then it is a quick and easy way to start seeing how to use Delphix.

Screen Shot 2015-09-29 at 8.54.08 AM

Video example of the install

 

Installation

Detailed install instructions can be found on the Delphix documentation website.

Screenshots from install

When the Delphix Express VM comes up, the consol will have a blue background and orange status area as in this screen shot.

01_orange_screen

 

When the management stack comes up the status area will turn green, meaning we  can access Delphix Express Web UI.

Web UI URL is the IP address of the Delphix Express engine which you can see in the bottom left of the console screen. (if there is no IP address, then something is off with the network setup, see Network Setup Issues at the bottom of the post)

02_green_screen

 

Screen 1 : password setup

accessing the Delphix Express URL looks like the following screen capture. You are requested to change the sysadmin password (by default the sysadmin password is sysadmin. I usually keep it that way for demo systems, i.e. systems I’m only going to demo on and not do any work on)

03_sysadmin_passwd1

 

Screen 2 : Date Time and NTP Server

The defaults should work here generally , so I just hit next

 

 

04_time_1

Screen 3 : DNS and NIC setup

 

For VMware the NIC setup default should work. (for Virtualbox we will go into more detail later)

The important part to look at here is the DNS server. You want to make sure that the DNS server has a legitimate.

05_DNS_and_nic

 

Screen 4 : Storage Setup

 

 

 

Just hit “Next”

 

06_storage

 

 

Screen 5 : Web Proxy

If not using web proxy or SMTP just hit “Next”

07_proxy_smtp

Screen 6 : LDAP setup

If not using LDAP just hit “Next”

08_LDAP

Screen 6: Registation

To use Delphix Express you have to register. To register you have to have a Delphix account. To create a Delphix account go to

http://accounts.delphix.com

and create an account.

Once you have an account, then put in your account email and password and click “Register”.  If you get a message about not being able to reach register.delphix.com, then make sure your DNS server on screen 3 is correct

09_registration

Screen 6: Registation success

After successful registration, the screen will look like the following, now hit “next” 10_registration_green

Screen 7: Finish

Click “Finish” on this screen to save the configuration

11_finish

After clicking “Finish” you will be asked to save the configuration. Click “yes”

12_finish_save

 

Saving the configuration takes a minute or two :

13_finish_saving

 

After successfully saving the configuration, click “OK”

14_fnish_successful

After click “OK”, Delphix Express management stack will reboot. This will take a few minutes. The console window status will turn orange, and once the stack is up, the status will turn green. At this point we go to the Delphix Express URL again

Login as delphix_admin password delphix

15_express_login

At your first login you will be asked to change the password.

IMPORTANT: change the password to “landshark”

The auto-configuration of source and target with Delphix Express only works if the password is “landshark”

16_express_passwd

When you first come into the main Delphix Express screen it will be empty and look like this:

17_express_empty

In a few minutes the autoconfig will complete and you will see some example folders setup on the top left as well as the source XE database linked into Delphix Express as well as the web app on the source machine. The screen now looks like:

18_expess_linked

 

If the Delphix Express consol doesn’t populate with example folders and link to the data source, then you can check on the progress but logging into the target linux box as delphix , password delphix.

There is a file called

landshark_setup.log

and for starters you can tail the log to see the progress

$ tail -f  landshark_setup.log

The log is coming from the process

$ ps -ef | grep land

delphix   2078  2075  0 12:18 ?        00:00:00 /bin/sh -c [ -f /home/delphix/setup/run_setup_on_boot ] && /home/delphix/landshark_setup.py

If that process is not running you can start it manually:

$ ./landshark_setup.py

Issues

The biggest source of issues are

  • can’t register
  • auto configuration doesn’t link in data sources into Express because of Network Issues

Can’t register

For the registration issues, make sure that the DNS server is correct on screen 3 and if you have a web proxy that it is set up correctly on screen 5.

Network issues 

Network setup is different on different hypervisors.

VMware setup is much easier than Virtualbox.

With VMware, you just need to make sure that each VM has it’s network set to NAT on windows or Linux and to “Share with my Mac” on Mac. Make sure that you can ping each of the the 3 VMs from the host operating system.  Setting up Delphix Express requires being connected to the network. A bad network connection, like wifi in a hotel or conference, can mess up the network setup.

On Virtualbox there are extra steps to take to set up the network. See the the docs on setting up Delphix Express for Virtualbox.

Manually Indicating Source and Engine IPs

If the target scripts don’t automatically find the source machine and Delphix engine, you can enter those IPs manually. To manually enter them, navigate to http://target_ip:8000

You will see something like the following image. Market in red underline is the source and engine IPs:

target_config

after making a change, click the “submit changes” button on the bottom of the page.

Uncategorized

Delphix Express : Free version of Delphix available

September 23rd, 2015

Delphix Express is available!

To get a copy of Delphix Express go to

and put “Express” for your title and I’ll send you the download info.

Delphix Express is a free version of Delphix

Delphix Express differs from Delphix enterprise in that it is limited to 25 GB of managed storage.

Screen Shot 2015-09-23 at 9.58.01 AM

 

Here is a video on installing Delphix Express on VMware fusion on my Mac.

Delphix Express can also be installed on Virtualbox.

Here is a quick video showing how to create a virtual database as well as a virtual database application using Delphix Express

Delphix Express is available currently for VMware and VirtualBox hypervisors. 

As with the 30 day demo, we suggest you test Delphix Express out with our demo environment called “Landshark.” Landshark consists of a source Linux VM with an Oracle XE database and a web application and a target Linux VM where virtual copies can be provisioned. The Landshark VMs will automatically link with Delphix Express as long as they are on the same subnet and the password for “delphix_admin” is “landshark” on Delphix Express.

Start with the quick start guide and video example of install of Delphix Express along with Landshark demo. 

We also have created an instruction document for configuring and leveraging the environment.

Here is a video demonstrating how to use Delphix https://vimeo.com/119911125

Here is a blog post explaining Delphix http://blog.delphix.com/kyle/2014/delphix/

All discussion and questions of Delphix Express can be posted to the Delphix Express community at

https://community.delphix.com/delphix/categories/delphix_delphix_express

To get a copy, fill out the following form:

Uncategorized

5 Years of Delphix

September 22nd, 2015

Wow – 5 years have flown by. Five years ago I joined Delphix and five years ago Delphix began the virtual data industry. Like all successful technologies many other vendors have come into the domain.  Delphix for me is amazing compared to other virtual data solutions. Delphix is easy, fast and powerful. Check out this video of linking to a RAC database and provisioning a thin clone RAC database. How much work would it take to do the same on technologies? Can one even sync and provision from RAC on other technologies? Its the only Data as a Service thin cloning solution that you can download and try  (put “express” as your title form and I’ll send you the free version of Delphix instead of the 30 day demo)

Delphix is doing powerful things that others might never do. Delphix is the only one (AFAIK) to share not only data blocks on disk, but also in memory, meaning that if I have 10 virtual databases of the same 300GB database and 300GB  of memory, then all the data will be cached for all the virtual databases – its’ like 3 TB of memory in 300 GB of RAM. On top of that, Delphix compresses memory as well with 1/3 compression meaning that we can cache that 300 GB database in around 100 GB of memory, so you can get those 3TB  of memory in 100 GB of RAM !! We have lots of back end innovation that no one else has and it comes from the architects and creators of RMAN, ZFS, DTrace, flash back database, active dataguard who we have all hired. ( Not to mention half a dozen Oaktable members and numerous Oracle Aces).

Other technologies are limited to saving some storage and doing backups.

Delphix power is accelerating application development. What Delphix has that others  don’t:

  • Self Service for developers.
    • Rollback – recover a virtual database to any point in time
    • Refresh – refresh to most recent source database data
    • Bookmark – mark data versions. Bookmarks can be shared with other developers
    • Branch – branch an existing data version or booked mark data version to  give QA specific versions/schemas environment in minutes
    • Synchronize – refresh, rollback, branch multiple data sources together, for example the Oracle installation, the application stack and the database can all be refreshed, book marked or rolled back together, or even more powerful multiple databases can be tracked together for those applications that depend on more than one database.
  • Cloud enabled –  Delphix runs in AWS and we have partnerships VMware vCloud, IBM cloud and Dell cloud
  • Download and try – wow, who wants a technology that requires sales guys and consultants in order to try it? Not me! With Delphix you can download and try  and even run it for free   (Hint – Put “Express” as your title on the Download and try form and I’ll send you the free version of Delphix instead of the 30 day demo)
  • All major database: Oracle, SQL Server, Postgres, Sybase, DB2, MySQL etc
  • Supports any data  – application stacks, EBS stack, SAP stack etc
  • Source syncing – allowing any point in time virtual database versions
  • Open Stack –  software solution independent of specialized hardware
  • Continuous Integration – Delphix ability to provision from any point in time and branch virtual database from virtual database is about the only way to do continuos integration when  continuous integration involves a large database
  • Five years track record – other solutions have few customers of any size using their solutions. Delphix has a 100 of the Fortune 500 heavily using Delphix as well as many more in the Fortune 2000
  • Best support in the industry I’ve ever seen.  Delphix has an amazing team that has gotten accolade after accolade not to mention easy access to the engineers who built the system. I worked a Oracle support for years and was a customer of Oracle at time as well trying to use Oracle and know how challenging support can be. I also know that it’s almost impossible to get support on new technologies that are not central to a company. Our data virtualization is our company and our company is the architects and leaders in the industry who built all the underlying technologies used to implement data virtualization.

Price

With Oracle EM Snap Clone, you have to set up a test master yourself. The default with Oracle is that the test master is a copy of the source database that a DBA makes manually,  and in that case you can’t get a copy of tomorrows source database unless you take a whole new copy. To get around this probem you can setup a dataguard which runs another $47,500K per core for the dataguard instance  not to mention getting the cloud management pack $5,000/core , data lifecycle management pack $12,000 /core, masking pack $11,500/core , plus you  have to get specialized hardware being either EMC Symmetrix, Netapp or ZFS appliance.

Delphix is cheaper than the required Oracle Snap Clone packs and Delphix doesn’t need dataguard as we sync directly with the source databases (or standby).  Delphix runs on any storage. No limitations. No manual work. All automated, synchronized and optimized. The price of Delphix vs Oracle Snap Clone doesn’t even matter as numerous of Delphix customers have Unlimited License Agreement (ULA ) that cover Snap Clone and they still buy Delphix. Why? Because Delphix works. It’s automated, easy and addresses the top industry concerns which are

  • providing functionality faster
  • providing better functionality
  • providing higher quality functionality with less bugs
  • doing it all securely

Self Service:

Competitors say you can give developers access to to them, but their tools are DBA or storage admin tools, not tools for developers.

Delphix has a safe, secure and easy developer specific interface that allows them to bookmark, branch, refresh, rollback their virtual databases as well as restrict what they can do and access. The developer interface, called Jetstream, also has cool things like allowing developers to make a data version and share it with another developer with bookmarking and branching.

Source Syncing

The biggest flaw with some competitors, and it’s a huge flaw, is that they can’t sync with the source database. It only works once the DBA manually copies a clone of the source onto the EMC storage, Netapp or ZFS storage at a single point in time. There is no time flow. No way to use the data for backup and recovery at various points in time.  To improve the other solutions  requires the DBA to set  up dataguard for Oracle for each source and have the data guard datafile stored on the thin clone storage. From there the DBA has to manage taking snapshots, collecting archive logs, purging old data and keeping track of which snapshots are used by what thin clones.

Also  the competitors have no automated time flow on the virtual databases(VDB). No refresh, rollback, tagging or branching of VDBs. Oracle can take snapshots of virtual databases but they have to be manually run and don’t have point in time recovery. With Delphix, out of the box virtual databases can be recovered down to the second to any point in time over the last 2 weeks.

Branching

Branching is power. On Delphix one can make a virtual database from a virtual database. This is really cool. For example if QA person who finds a bug and logs it yet development can’t reproduce it then often the bug languishes or the developer has to come over and use the QA person’s system and the QA person has to wait. Now with branching, the QA person can just bookmark the problem data set and the developer can branch off a thin clone of that data set in minutes and reproduce the problem without every interrupting the QA person and without any waiting. Branching has many powerful uses. Branching brings the equivalent of code source control to data. With Delphix it’s now data control!

Future

The future of Delphix is exciting. I’m loving all the DevOps and Continuous Integration work being done with Delphix from integration with Ansible, Chef and Puppet to providing data containers to Docker.

 

SANYO DIGITAL CAMERA

photo by Sherri Lynn Wood

Uncategorized

Speaking in Portland at NWOUG Monday Sept 14

September 2nd, 2015

Looking forward to speaking at

Please come join me !

I lived in Portland between 2006-2008 and love city. It will be fun being back.

8:15 – 9:00 Keynote “EBS Strategy and Roadmap” – Vanessa Paskill

Technical Apps Functional Vendor Oracle
9:15 10:15 Practical Tips for Oracle Business Intelligence Applications 11g Implementations (Michael Raney, Rittman Mead) Lessons learned while Integrating Procurement Cards with Internet Expense (Ashish Nagarkar, AST Corporation) Enhanced Financial Controls and Automation for Oracle (BlackLine) Oracle Database Compression Best Practices (Gregg Christman)
10:45 11:45 Moving ahead with BI Publisher on your next Cloud project (Nelly Bushing, JIBE Consulting) PBCS: FP&A in the Cloud – Time to get on board! (Steve Wyatt, Jibe Consulting) Learn Role-Based Access Controls: Improve Security in Oracle EBS and Prepare for Fusion Cloud (FulcrumWay) Business Intelligence – Big Data: The Road to Know More About Your Business (John Drahos)
12:45 1:45 Identifying High Risk SQL Before The Upgrade (Craig Shallahamer, OraPub) Creating Business Requirements You Can Use to Move Your Business to Oracle (Meryl Logue, PMP, CDK Global) Drillbridge: The Easy and Free Way to Implement Relational Drillthrough (Key Performance Ideas) EBS Applications Technology How Oracle Enables the Cloud TBA
2:15 3:15 One Click Provisioning With Enterprise Manager 12c (Josh Turner, Seattle Pacific University) 12 Subledger And EBS Analyzers For Payables In Depth Discussion and Usages (Satya Mahanti, UTI) DBAs Double your developers productivity – Kyle Hailey Business Intelligence – Metrics That Matter: Drive bottom line impact with Oracle’s Pre- Built Business Intelligence Applications (Todd LaFavers)
3:30 4:30 Ask The Experts! (Invited panel members) Query Tuning with Toad Beyond Fire-Fighting (Dell Software)

.

15922772522_9f869b5859_k

photo by sama093

 

 

Uncategorized