Integrating Hadoop and Elasticsearch – Part 2 – Querying and Writing to Elasticsearch from Apache Spark

Introduction In the part 2 of 'Integrating Hadoop and Elasticsearch' blogpost series we look at bridging Apache Spark and Elasticsearch. I assume that you have access to Hadoop and Elasticsearch clusters and you are faced with the challenge of bridging these two distributed systems. As spark code can be written in scala, python and java, … Continue reading Integrating Hadoop and Elasticsearch – Part 2 – Querying and Writing to Elasticsearch from Apache Spark

Integrating Hadoop and Elasticsearch – Part 1 – Loading into and Querying Elasticsearch from Apache Hive

Introduction As more and more organisations are deploying Hadoop and Elasticsearch in tandem to satisfy batch analytics, real-time analytics and monitoring requirements, the need for tigher integration between Hadoop and Elasticsearch has never been more important. In this series of blogposts we look at how these two distributed systems can be tightly integrated and how each of … Continue reading Integrating Hadoop and Elasticsearch – Part 1 – Loading into and Querying Elasticsearch from Apache Hive

Using SQL Developer to access Apache Hive with kerberos authentication

With Hadoop implementations moving into mainstream, many of the Oracle DBA's are having to access SQL on Hadoop frameworks such as Apache Hive in their day to day operations. What better way is there to achieve than using the familiar, functional and trusted Oracle SQL Developer! Oracle SQL Developer (since version 4.0.3) allows access to Apache … Continue reading Using SQL Developer to access Apache Hive with kerberos authentication

Convert non-partitioned table to partitioned table using DBMS_REDEFINITION

I had a request from my users that suddenly one of the query is running slowly. I did the usual checks, SQL Plan regression, storage response time, load on the database, there was nothing unusual. Then I told my user that the elapsed time for this query is as usual and the plan has not changed … Continue reading Convert non-partitioned table to partitioned table using DBMS_REDEFINITION