Skip to main content

Dance into the Groovy

Groovy (http://groovy.codehaus.org/) is an Object Oriented scripting language for the Java platform. It is dinamically compiled to bytecode for the Java Virtual Machine. It can use and interoperate with any Java class and library (any, not only the ones provided by the JDK) and it has a Java-like syntax: this way its learning curve for a Java depeloper is almost close to zero. Groovy is very powerful and can help in different areas: in some future post I will show and explain better its benefits. In this one I want to show you just a concrete example of use from me in the past. Many times we had to deal with the move of hundreds of Oracle schemas from an envirnoment to another (dev, test, QA, production) or to migrate them from an Oracle release to another. Every time the DBAs regularly forgot to set up the DB links for the new environment. This generated errors that couldn't often be identified quickly. In order to avoid this I wrote a set of Groovy scripts to check the sanity of the DB links that could be automated after any Oracle schema or instance migration. This is a simple example of those scripts (the following code is an oversimplification of the original ones of course). Please read the comment inside the code: they explain everything.

import groovy.sql.Sql
import groovy.sql.Sql.AbstractQueryCommand
import java.sql.ResultSet

def dbLinkHostList = []

// Get a new Groovy Sql instance using the connection parameters for your Oracle schema
def sql = Sql.newInstance("jdbc:oracle:thin:@INSTANCE:1756:SID", "SCHEMA_OWNER",
                      "password", "oracle.jdbc.driver.OracleDriver")



// Execute a query in the system table user_db_links. This query gets all the DB links for your 
// schema
 sql.eachRow("select * from user_db_links") {
    // Put any found DB link name into an array
    dbLinkHostList.add("${it.db_link}");

}

sql.close();



def dbLinksCount = dbLinkHostList.size();

// Cycle between the DB links
for(i in 0..(dbLinksCount - 1)) {
    log.info("dbLink: " + dbLinkHostList.get(i))
    sql = Sql.newInstance("jdbc:oracle:thin:@INSTANCE:1756:SID", "SCHEMA_OWNER",
                      "password", "oracle.jdbc.driver.OracleDriver")

    // Execute a simple query for the DB link
    def sqlConnectionTest = "select rownum id from dual@${dbLinkHostList.get(i)}"
    def AbstractQueryCommand q = sql.createQueryCommand("${sqlConnectionTest}");
     try {
         ResultSet rs = q.execute();

         // Print a message if the DB link is OK for the new environment
         log.info("DB link connection is OK");

         // Don't forget to close the ResultSet
         rs.close();
     } catch(Exception e) {

         // Manage the exception for any broken DB link
         log.info("exception: " + e.getMessage());
     }
     finally {

         // Don't forget to close every DB object used (You don't want to leave open cursors in the 
        // DB, isn't it? :)
         q.closeResources();
         sql.close();
     }
}


This example requires just Groovy and the Oracle JDBC driver in the classpath. A simple solution to solve an annoying problem and save a lot of precious time.

I used a lot of Groovy to wrote useful scripts to automate load testing or functional testing through SoapUI, but this is another story (next...).

Comments

Popular posts from this blog

Exporting InfluxDB data to a CVS file

Sometimes you would need to export a sample of the data from an InfluxDB table to a CSV file (for example to allow a data scientist to do some offline analysis using a tool like Jupyter, Zeppelin or Spark Notebook). It is possible to perform this operation through the influx command line client. This is the general syntax: sudo /usr/bin/influx -database '<database_name>' -host '<hostname>' -username '<username>'  -password '<password>' -execute 'select_statement' -format '<format>' > <file_path>/<file_name>.csv where the format could be csv , json or column . Example: sudo /usr/bin/influx -database 'telegraf' -host 'localhost' -username 'admin'  -password '123456789' -execute 'select * from mem' -format 'csv' > /home/googlielmo/influxdb-export/mem-export.csv

jOOQ: code generation in Eclipse

jOOQ allows code generation from a database schema through ANT tasks, Maven and shell command tools. But if you're working with Eclipse it's easier to create a new Run Configuration to perform this operation. First of all you have to write the usual XML configuration file for the code generation starting from the database: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <configuration xmlns="http://www.jooq.org/xsd/jooq-codegen-2.0.4.xsd">   <jdbc>     <driver>oracle.jdbc.driver.OracleDriver</driver>     <url>jdbc:oracle:thin:@dbhost:1700:DBSID</url>     <user>DB_FTRS</user>     <password>password</password>   </jdbc>   <generator>     <name>org.jooq.util.DefaultGenerator</name>     <database>       <name>org.jooq.util.oracle.OracleDatabase</name>     ...

Using Rapids cuDF in a Colab notebook

During last Spark+AI Summit Europe 2019 I had a chance to attend a talk from Miguel Martinez  who was presenting Rapids , the new Open Source framework from NVIDIA for GPU accelerated end-to-end Data Science and Analytics. Fig. 1 - Overview of the Rapids eco-system Rapids is a suite of Open Source libraries: cuDF cuML cuGraph cuXFilter I enjoied the presentation and liked the idea of this initiative, so I wanted to start playing with the Rapids libraries in Python on Colab , starting from cuDF, but the first attempt came with an issue that I eventually solved. So in this post I am going to share how I fixed it, with the hope it would be useful to someone else running into the same blocker. I am assuming here you are already familiar with Google Colab. I am using Python 3.x as Python 2 isn't supported by Rapids. Once you have created a new notebook in Colab, you need to check if the runtime for it is set to use Python 3 and uses a GPU as hardware accelerator. You...