Arenadata Streaming

System for real-time streaming processing of huge data amounts

Arenadata Streaming (ADS) is a scalable, fault-tolerant solution for real-time streaming data processing, adapted for enterprise and built on Apache Kafka and Apache Nifi.

Get started

Concepts

Use cases
Architecture
Storage concepts

Planning

Hardware requirements
Network requirements
Software requirements
Kafka сonfiguration best practices
NiFi сonfiguration best practices

Installation

Online installation
Offline installation

Kafka

Basic operations

Quick start

Authentication

Use SASL PLAINTEXT in Kafka
Use MIT Kerberos in Kafka
SSL channel security in Kafka
Use Kerberos with MS Active directory in Kafka

Authorization

Ranger Kafka plugin activation
Use Ranger in Kafka
AСL in Kafka

Kafka Connect

Basic operations

Mirror Maker 2

Kafka REST Proxy

Kafka REST Proxy usage example

ksqlDB

KsqlDB usage example

NiFi

UI overview

NiFi Server
NiFi Registry

Access management

Authentication
Authorization in UI
Ranger NiFi plugin activation
Use Ranger in NiFi

Basic operations

Work with processors
Processors and process groups configuring
Work with attributes
Work with templates
Built-in monitoring in the NiFi interface

Advanced examples

Build a dataflow
Usе Expression Language

Tutorials

Cluster managment

Cluster actions
Service actions

Monitoring cluster

Metrics

ADS Control

ADS Control overview
UI overview
Cluster actions
Service actions
FileStream
Mirror Maker 2

Authentication

Basic
MIT Kerberos
Kerberos with MS Active Directory
SASL PLAINTEXT
SSL channel security

Authorization

Arenadata Platform Security installation
Integration with ADS cluster
Audit management in Ranger

References

Settings

ADS configuration parameters
ADS Control configuration parameters

Found a mistake? Seleсt text and press Ctrl+Enter to report it