/PythonDBAGraphs

Python graphing scripts for Oracle database tuning

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

# PythonDBAGraphs

This is a Python program that displays graphs that
are helpful for Oracle database performance tuning.

PythonDBAGraphs includes these graphs:

ashcpu.py - Shows cpu usage within an Oracle database
            by various parts of the application.

onewait.py - Shows the average time for an Oracle wait
             event and the number of events per period.
          
simplesqlstat.py - Show average elapsed versus executions
                   for one SQL statement.

allsql.py - Show average elapsed versus executions
            for all SQL statements.
         
groupsigs.py - Show average elapsed versus executions
               for SQL statements whose force matching
               signature is in a specified group of
               signatures.
          
sigscpuio.py - Show total elapsed, CPU, and IO time
               for SQL statements whose force matching
               signature is in a specified group of
               signatures.

sigselapctcpu.py - Show total elapsed for SQL statements 
                   whose force matching signature is in a 
                   specified group of signatures. Show 
                   percent CPU used on same graph.

sigfour.py - Four metrics for SQL statements 
             whose force matching signature is in a 
             specified group of signatures. These are
             number of executions, average elapsed time,
             CPU percent used, and average single block
             read time.
          
ashcount.py - For a time range show the number of active
              sessions on CPU and total number active.
              
sqlstatwithplans.py - Show execution time of a single 
                      SQL statement by plan.
                      
sessioncounts.py - Plot the number of connected sessions.
          
Command line help:

usage: ashcpu.py [-h] {file,screen} [database] {Y,N} {Y,N}

Database CPU by Application Area

positional arguments:
  {file,screen}  Where to send the graph
  database       Name of the database
  {Y,N}          Show SQL that was executed (Y or N)
  {Y,N}          Show data returned by query (Y or N)

optional arguments:
  -h, --help     show this help message and exit

See README for more detailed help.

Example:

python onewait.py screen ORCL N N

This creates the onewait.py graph on the ORCL database and sends the output to 
the screen. It does not display the SQL used and it does not output the
data returned by the query.

Requirements:

This has been primarily tested on Windows 7 using 32-bit
Canopy Express and the cx_Oracle package.

https://www.enthought.com/canopy-express/

https://pypi.python.org/pypi/cx_Oracle/5.2.1

Configuration:

The program uses certain directories. The paths to these directories
are stored in the file directories.txt which is kept in the same 
location as the util.py script. The directories are the configuration, 
password, and output directories.

The configuration directory contains the file userandfilenames.txt
which has the Oracle user name and the name of the password file.

The password directory contains the password file. It has lines in this 
format:

Database name:user name:password

The output directory is where image files are written if you choose
"file" as the destination for the graph.

Related blog posts:

http://www.bobbydurrettdba.com/?s=Python

Contact:

bobby@bobbydurrettdba.com

Linux configuration:

Recently tested this on Linux virtual machine following this high level outline:

Here are the steps to use PythonDBAGraphs on Linux. Tested on Oracle Enterprise
Linux, a variant of Red Hat.

1 Install Oracle linux 6 as software development workstation.
Run yum update to get current.

2 Install Oracle 11.2.0.4 client using database server yum package. Setup the 
needed Oracle directories. Setup tnsnames.ora entry for test database
and test connection with sqlplus.

3 Use yum to install tcl* and tk*

4 Build python 2.7.11 from source and install.

5 Build matplotlib from source and install.
Set backend to tkagg in matplotlibrc. Use

python s.py --verbose-helpful 

to find the rc file.

s.py:

https://gist.github.com/bobbydurrett/a65c9c457f155a0ed38a9643b05ce8f5#file-s-py

6 Build numpy from source and install.

7 Build cx_Oracle from source and install.

8 Clone PythonDBAGraphs repository using git.

9 Test application. Setup configuration files
to use SYSTEM user and Linux file paths.