Конференция Arenadata
Новое время — новый Greenplum
Мы приглашаем вас принять участие в конференции, посвященной будущему Open-Source Greenplum 19 сентября в 18:00:00 UTC +3. Встреча будет проходить в гибридном формате — и офлайн, и онлайн. Онлайн-трансляция будет доступна для всех желающих.
Внезапное закрытие Greenplum его владельцем — компанией Broadcom - стало неприятным сюрпризом для всех, кто использует или планирует начать использовать решения на базе этой технологии. Многие ожидают выхода стабильной версии Greenplum 7 и надеются на её дальнейшее активное развитие.
Arenadata не могла допустить, чтобы разрабатываемый годами Open-Source проект Greenplum прекратил своё существование, поэтому 19 сентября мы представим наш ответ на данное решение Broadcom, а участники сообщества получат исчерпывающие разъяснения на все вопросы о дальнейшей судьбе этой технологии.

На конференции вас ждёт обсуждение следующих тем:

  • План возрождения Greenplum;
  • Дорожная карта;
  • Экспертное обсуждение и консультации.
Осталось до события

Add and use an interpreter in HUE

Connectors used by HUE

HUE in ADH has pre-set connectors for the Hive, Impala, Spark3 SQL, and Kyuubi[Spark3] data sources. Many more can be added via the Custom hue.ini section available at the HUE service configuration page; the full list can be found in the HUE documentation.

NOTE

Pre-set connectors only appear in the HUE UI if corresponding service components are present in the ADH cluster:

  • Impala — Impala service with all components;

  • Hive — Hive service with all components;

  • Spark3 SQL — Spark3 service with the Spark3 Thrift Server and Spark3 Client components;

  • Kyuubi[Spark3] — Kyuubi Server and Spark3 Client components on the same host.

After adding necessary services and/or components, you need to restart the HUE service for the changes to take effect.

To configure a connector, go to ADCM UI, select your ADH cluster, and navigate to ServicesHUEComponentsHUE Server. Select the required interpreter section and adjust the parameters as needed. Refer to HUE configuration parameters reference for assistance.

Connect to ADB (Greenplum)

This is an example of how to add and configure a connector for the ADB database, which is based on Greenplum.

To be able to connect HUE to ADB database instance make sure that it expects connection on a certain network interface with certain credentials. Go to the ADCM UI and select your ADB cluster, then navigate to ServicesADBPrimary configuration. Open the Custom pg_hba section parameter and add a string of the following kind to it:

host <dbname> <user> <IP-address>/<mask> trust

where:

  • <dbname> — name of the database being connected to.

  • <user> — username of that database.

  • <IP-address>/<mask> — address of the ADH host where HUE Server is installed.

Example:

host adb admin 10.10.10.21/0 trust

Save the configuration, then click Actions and select Reconfigure.

Next, you need to add connection parameters to the HUE configuration. Select your ADH cluster in ADCM UI, and navigate to ServicesHUEComponentsHUE Server. In the Primary configuration tab that appears, click Show advanced. Open the Custom hue.ini section and add three parameters by clicking Add property:

  • notebook.interpreters.greenplum.name = Greenplum

  • notebook.interpreters.greenplum.interface = sqlalchemy

  • notebook.interpreters.greenplum.options = '{"url": "postgresql+psycopg2://<user>:<password>@<dbaddress>:<port>/<dbname>"}'

where:

  • <password> — database user password.

  • <dbaddress> — address of the database host awaiting connection (ADB master).

  • <port> — database listen port.

Standard Greenplum port in ADB is 5432. Example for the options parameter: '{"url": "postgresql+psycopg2://admin:Secure_pass35@10.10.10.10:5432/adb"}'.

Save the configuration and click Restart HUE Server in the Actions menu. Wait for the restart to complete and go to the HUE UI. The Greenplum data source should appear in the quick browse menu and in the Editor list.

Greenplum data source
Greenplum data source
Greenplum data source
Greenplum data source

You can perform queries against the selected table. Type in the query in the application area and click Execute (or press Ctrl+Enter).

Query example
Query example
Query example
Query example

If ADB parameter Custom pg_hba section wasn’t configured correctly, or invalid credentials were specified on the HUE Server configuration side, the connection will fail and an error message will appear.

Invalid pg_hba.conf configuration error
Invalid pg_hba.conf configuration error
Invalid pg_hba.conf configuration error
Invalid pg_hba.conf configuration error

If a wrong port was specified on the HUE Server configuration side, the connection will fail and an error message will appear.

Connection refused error
Connection refused error
Connection refused error
Connection refused error
Found a mistake? Seleсt text and press Ctrl+Enter to report it