The 200 issue of Mokabyte is online (http://www.mokabyte.it). It is the most important Italian web magazine about Java technologies and Agile methodologies. I am really proud to have given a contribution writing several articles (here's one, http://www2.mokabyte.it/cms/article.run?articleId=7TK-XI4-MRI-VMN_7f000001_13046033_40989f48) for it during the period 2006-2013 . I want to congratulate Giovanni Puliti, Francesco Saliola and all the people who made that magazine great. Thanks a lot guys!
Streamsets Data Collector log shipping and analysis using ElasticSearch, Kibana and... the Streamsets Data Collector
One common use case scenario for the Streamsets Data Collector (SDC) is the log shipping to some system, like ElasticSearch, for real-time analysis. To build a pipeline for this particular purpose in SDC is really simple and fast and doesn't require coding at all. For this quick tutorial I will use the SDC logs as example. The log data will be shipped to Elasticsearch and then visualized through a Kibana dashboard. Basic knowledge of SDC, Elasticsearch and Kibana is required for a better understanding of this post. These are the releases I am referring to for each system involved in this tutorial: JDK 8 Streamsets Data Collector 1.4.0 ElasticSearch 2.3.3 Kibana 4.5.1 Elasticsearch and Kibana installation You should have your Elasticsearch cluster installed and configured and a Kibana instance pointing to that cluster in order to go on with this tutorial. Please refer to the official documentation for these two products in order to complete their installation (if you do
Comments
Post a Comment