Logging in HBase

Both Master and Region Servers in HBase write text logs, which are useful while analyzing the causes of different errors. These logs are located in the /var/log/hbase directory on each of the hosts. There are two ways to find them.

Using a file system

The server file system enables you to get direct access to logs using the following operations:

  1. Connect to the host through SSH and run the following command:

    $ ls -la /var/log/hbase

    The output looks similar to this:

    total 10004
    drwxr-xr-x.  2 hbase hbase     4096 Nov 29 06:17 .
    drwxr-xr-x. 16 root  root      4096 Nov 29 05:35 ..
    -rw-r--r--.  1 hbase hbase 10209158 Nov 29 11:34 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.log
    -rw-r--r--.  1 hbase hbase      692 Nov 29 06:17 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out
    -rw-r--r--.  1 hbase hbase      692 Nov 29 05:35 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out.1
    -rw-r--r--.  1 hbase hbase      692 Nov 26 07:43 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out.2
    -rw-r--r--.  1 hbase hbase      692 Nov 26 05:58 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out.3
    -rw-r--r--.  1 hbase hbase      692 Nov 26 05:26 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out.4
    -rw-r--r--.  1 hbase hbase      692 Nov 25 15:00 hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.out.5
    NOTE

    Logs are located in the local file system of the host, not in the HDFS.

  2. View the content of the desired file:

    $ tail /var/log/hbase/hbase-hbase-regionserver-bds-adh-1.ru-central1.internal.log

    The output looks similar to this:

    SLF4J: Found binding in [jar:file:/usr/lib/phoenix/phoenix-5.0.0-HBase-2.0-pig.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/usr/lib/phoenix/phoenix-5.0.0-HBase-2.0-thin-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
    0    [RS-EventLoopGroup-1-9] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:48266, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=ClientService
    10629 [RS-EventLoopGroup-1-10] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:48328, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=AdminService
    10263041 [RS-EventLoopGroup-1-5] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:35086, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=ClientService
    10570940 [RS-EventLoopGroup-1-9] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:36368, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=ClientService
    18488201 [RS-EventLoopGroup-1-16] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:41578, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=AdminService
    18991216 [RS-EventLoopGroup-1-12] INFO  SecurityLogger.org.apache.hadoop.hbase.Server  - Connection from 10.92.6.9:43712, version=2.0.2, sasl=false, ugi=hbase (auth:SIMPLE), service=AdminService

Using Web UI

The following steps demonstrate how to view logs in HBase Web UI:

  1. Open Web UI home page for the desired Master or Region Server.

  2. Select the Local Logs menu item.

    hbase logs 1 dark
    Switching to the logs list
    hbase logs 1 light
    Switching to the logs list
  3. Click the desired file name in the opened list.

    hbase logs 2 dark
    Choosing the log file
    hbase logs 2 light
    Choosing the log file
  4. View the opened file. The latest information is located in the end.

    hbase logs 3 dark
    Viewing the log file
    hbase logs 3 light
    Viewing the log file
Found a mistake? Seleсt text and press Ctrl+Enter to report it