Atri Bhattacharya 933bf58a22 Accepting request 821141 from home:jgrassler:branches:science
- Fix duplicate BuildRequire on storm-kit
- update to 1.2.3 (SOC-9974, CVE-2019-0202, SOC-9998,
  CVE-2018-11779):
  * 1.2.3
    * [STORM-3233] - Upgrade zookeeper client to newest version
      (3.4.13) [STORM-3077] - Upgrade Disruptor version to 3.3.11
    * [STORM-3083] - Upgrade HikariCP version to 2.4.7
    * [STORM-3094] - Topology name needs to be validated at
      storm-client
    * [STORM-3222] - Fix KafkaSpout internals to use LinkedList
      instead of ArrayList [STORM-3292] - Trident HiveState must
      flush writers when the batch commits
    * [STORM-3013] - Deactivated topology restarts if data flows
      into Kafka [STORM-3028] - HdfsSpout does not handle empty
      files in case of ack enabled
    * [STORM-3046] - Getting a NPE leading worker to die when
      starting a topology.
    * [STORM-3047] - Ensure Trident emitter refreshPartitions is
      only called with partitions assigned to the emitter
    * [STORM-3055] - never refresh connection
    * [STORM-3068] - STORM_JAR_JVM_OPTS are not passed to
      storm-kafka-monitor properly
    * [STORM-3082] - NamedTopicFilter can't handle topics that
      don't exist yet
    * [STORM-3087] - FluxBuilder.canInvokeWithArgs is too
      permissive when the method parameter type is a primitive
    * [STORM-3090] - The same offset value is used by the same
      partition number of different topics.
    * [STORM-3097] - Remove storm-druid in 2.x and deprecate
      support for it in 1.x

OBS-URL: https://build.opensuse.org/request/show/821141
OBS-URL: https://build.opensuse.org/package/show/science/storm?expand=0&rev=6
2020-07-16 18:32:31 +00:00

SUSE Specific Changes
=====================

When packaging Storm we made the following changes:

* Storm executables and binaries reside in __LIBDIR__/storm. The following
  executables are symlinked to __BINDIR__:

  * storm
  * flight.bash

* Most configuration resides in __CONFDIR__. The log4j configuration is the
  sole exception, since it is unlikely to need changing. It continues to reside
  in __LIBDIR__/storm/log4j2.
* There is a systemd unit for every Storm service. You will find them in the
  following packages:

   =====================+======================================== 
    Package name        | Service name                            
   =====================+========================================
    storm-logviewer     | storm-logviewer                         
   ---------------------+---------------------------------------- 
    storm-nimbus        | storm-nimbus                            
   ---------------------+---------------------------------------- 
    storm-pacemaker     | storm-pacemaker                         
   ---------------------+---------------------------------------- 
    storm-supervisor    | storm-supervisor                        
   ---------------------+---------------------------------------- 
    storm-ui            | storm-ui                                
   ---------------------+---------------------------------------- 
    storm-zookeeper     | storm-zookeeper                         
   ---------------------+---------------------------------------- 

* We changed the following default settings to conform to the
  File System Hierarchy Standard:

   =====================+======================================== 
    Setting             | Value                                   
   =====================+======================================== 
    storm.local.dir     | __LOCALDIR__                          
   ---------------------+---------------------------------------- 
    storm.log.dir       | __LOGDIR__                          
   ---------------------+---------------------------------------- 
    dev.zookeeper.path  | __ZKDIR__                               
   ---------------------+---------------------------------------- 

  While you can do so, we recommend not overriding these settings in
  storm.yaml. If you do override them anyway, please make sure they all point
  to directories writable by the storm user.


Setting up a single node cluster
================================

Note: this section only covers the SUSE specific steps in setting up a single
      node Storm cluster for testing/development. Please refer to the upstream
      documentation at

      https://storm.apache.org/releases/1.0.2/Setting-up-a-Storm-cluster.html

      for details not covered here.

Prerequisites
-------------

Your system needs a fully qualified domain name, otherwise some Storm services
will fail to start. If you do not have a proper FQDN, just enter your IP
address with a made up FQDN in /etc/hosts to set one.

Installing packages
-------------------

First of all, you need to ensure you have the packages for Storm's component
services installed. Since you are reading this document we'll assume you
already have the storm main package installed. Beyond that,

  zypper install storm-nimbus storm-supervisor storm-zookeeper

is the minimum you'll need to install to get your cluster going. Optionally,

  zypper install storm-logviewer storm-pacemaker storm-ui

will install the remaining services (you won't need these for a minimum
cluster).


Enabling services
-----------------

Once you've got your packages installed, enable the services for a minimum
cluster:

  systemctl enable storm-zookeeper
  systemctl enable storm-nimbus
  systemctl enable storm-supervisor


Starting your cluster
---------------------

First of all, start a single-node Zookeeper cluster for storm to use:

  systemctl start storm-zookeeper

This is required by both storm-nimbus and storm-supervisor. They need a working
Zookeeper cluster.

Next, start your cluster master service (Nimbus):

  systemctl start storm-nimbus

Finally, start the Storm supervisor (which will in turn spawn worker
processes), issue a

  systemctl start storm-supervisor

Troubleshooting
---------------

You will find logs for all Storm services in /var/log/storm. Some services
(e.g. storm-logviewer) may have multiple log files.
Description
No description provided
Readme 57 KiB
Languages
Shell 100%