Skip to main content

Dance into the Groovy

Groovy (http://groovy.codehaus.org/) is an Object Oriented scripting language for the Java platform. It is dinamically compiled to bytecode for the Java Virtual Machine. It can use and interoperate with any Java class and library (any, not only the ones provided by the JDK) and it has a Java-like syntax: this way its learning curve for a Java depeloper is almost close to zero. Groovy is very powerful and can help in different areas: in some future post I will show and explain better its benefits. In this one I want to show you just a concrete example of use from me in the past. Many times we had to deal with the move of hundreds of Oracle schemas from an envirnoment to another (dev, test, QA, production) or to migrate them from an Oracle release to another. Every time the DBAs regularly forgot to set up the DB links for the new environment. This generated errors that couldn't often be identified quickly. In order to avoid this I wrote a set of Groovy scripts to check the sanity of the DB links that could be automated after any Oracle schema or instance migration. This is a simple example of those scripts (the following code is an oversimplification of the original ones of course). Please read the comment inside the code: they explain everything.

import groovy.sql.Sql
import groovy.sql.Sql.AbstractQueryCommand
import java.sql.ResultSet

def dbLinkHostList = []

// Get a new Groovy Sql instance using the connection parameters for your Oracle schema
def sql = Sql.newInstance("jdbc:oracle:thin:@INSTANCE:1756:SID", "SCHEMA_OWNER",
                      "password", "oracle.jdbc.driver.OracleDriver")



// Execute a query in the system table user_db_links. This query gets all the DB links for your 
// schema
 sql.eachRow("select * from user_db_links") {
    // Put any found DB link name into an array
    dbLinkHostList.add("${it.db_link}");

}

sql.close();



def dbLinksCount = dbLinkHostList.size();

// Cycle between the DB links
for(i in 0..(dbLinksCount - 1)) {
    log.info("dbLink: " + dbLinkHostList.get(i))
    sql = Sql.newInstance("jdbc:oracle:thin:@INSTANCE:1756:SID", "SCHEMA_OWNER",
                      "password", "oracle.jdbc.driver.OracleDriver")

    // Execute a simple query for the DB link
    def sqlConnectionTest = "select rownum id from dual@${dbLinkHostList.get(i)}"
    def AbstractQueryCommand q = sql.createQueryCommand("${sqlConnectionTest}");
     try {
         ResultSet rs = q.execute();

         // Print a message if the DB link is OK for the new environment
         log.info("DB link connection is OK");

         // Don't forget to close the ResultSet
         rs.close();
     } catch(Exception e) {

         // Manage the exception for any broken DB link
         log.info("exception: " + e.getMessage());
     }
     finally {

         // Don't forget to close every DB object used (You don't want to leave open cursors in the 
        // DB, isn't it? :)
         q.closeResources();
         sql.close();
     }
}


This example requires just Groovy and the Oracle JDBC driver in the classpath. A simple solution to solve an annoying problem and save a lot of precious time.

I used a lot of Groovy to wrote useful scripts to automate load testing or functional testing through SoapUI, but this is another story (next...).

Comments

Popular posts from this blog

Exporting InfluxDB data to a CVS file

Sometimes you would need to export a sample of the data from an InfluxDB table to a CSV file (for example to allow a data scientist to do some offline analysis using a tool like Jupyter, Zeppelin or Spark Notebook). It is possible to perform this operation through the influx command line client. This is the general syntax: sudo /usr/bin/influx -database '<database_name>' -host '<hostname>' -username '<username>'  -password '<password>' -execute 'select_statement' -format '<format>' > <file_path>/<file_name>.csv where the format could be csv , json or column . Example: sudo /usr/bin/influx -database 'telegraf' -host 'localhost' -username 'admin'  -password '123456789' -execute 'select * from mem' -format 'csv' > /home/googlielmo/influxdb-export/mem-export.csv

jOOQ: code generation in Eclipse

jOOQ allows code generation from a database schema through ANT tasks, Maven and shell command tools. But if you're working with Eclipse it's easier to create a new Run Configuration to perform this operation. First of all you have to write the usual XML configuration file for the code generation starting from the database: <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <configuration xmlns="http://www.jooq.org/xsd/jooq-codegen-2.0.4.xsd">   <jdbc>     <driver>oracle.jdbc.driver.OracleDriver</driver>     <url>jdbc:oracle:thin:@dbhost:1700:DBSID</url>     <user>DB_FTRS</user>     <password>password</password>   </jdbc>   <generator>     <name>org.jooq.util.DefaultGenerator</name>     <database>       <name>org.jooq.util.oracle.OracleDatabase</name>     ...

Turning Python Scripts into Working Web Apps Quickly with Streamlit

 I just realized that I am using Streamlit since almost one year now, posted about in Twitter or LinkedIn several times, but never wrote a blog post about it before. Communication in Data Science and Machine Learning is the key. Being able to showcase work in progress and share results with the business makes the difference. Verbal and non-verbal communication skills are important. Having some tool that could support you in this kind of conversation with a mixed audience that couldn't have a technical background or would like to hear in terms of results and business value would be of great help. I found that Streamlit fits well this scenario. Streamlit is an Open Source (Apache License 2.0) Python framework that turns data or ML scripts into shareable web apps in minutes (no kidding). Python only: no front‑end experience required. To start with Streamlit, just install it through pip (it is available in Anaconda too): pip install streamlit and you are ready to execute the working de...