Skip to content

Release Notes

Siddhi Distribution Releases

Siddhi Distribution 5.1.0

Highlights

  • Siddhi 5.1.0 distribution release contains the features and bug fixes done in Siddhi core 5.1.x releases. Other than that, it provides a lot of new features and improvements that help for the cloud native stream processing deployments. Please find more details in below.

Features & Improvements

  • Caching support to retain on-demand queries provided by users through editor. (#499)
  • Add alerts for the docker push process. (#507)
  • Improve logging and default selections in K8/Docker export. (#516)
  • Add validations to the export docker config step. (#526)
  • Improve auto completion in editor to include latest keywords. (#528)
  • Support relative path for -Dapps and -Dconfig parameters. (#543)
  • Make templated Siddhi apps collapsable. (#592)
  • Add alert dialog to see the console if artifacts are pushed to Docker. (#598)
  • Docker image push support and set values for templated variables in Siddhi apps (#485)
  • Improvements to perform list operations with events. Check here
  • Add styling for template option in Docker/Kubernetes export dialog (#442)
  • Add side panel to the editor which allows the user to set values for templated variables in Siddhi apps (#446)
  • Deprecate existing query API and introduce on-demand queries (#481)
  • Add preview support to receive/publish gRpc events. (#396)
  • Skip empty jar/bundle selections in Docker/Kubernetes export. (#367)
  • UI/UX improvements in k8/Docker export feature. (#373), (#369)
  • Improve startup scripts carbon.sh and carbon.bat to support JDK 11. (#394)
  • Add support for offset in siddhi parser (#291)
  • Add overload param support for source view editor (#310)
  • Improve design view to show the connection between *-call-request and *-call-response IOs. (#310)
  • Feature to support downloading docker and Kubernetes artifacts from Tooling UI (#349)

Bug Fixes

  • Fix samples not loading in welcome page. (#491)
  • Remove unnecessary console logs. (#494)
  • Fix multiple template value showing issue. (#495)
  • Docker build fails due to in-proper . handling of user inputs. (#496)
  • Avoid syntax validation while app is running and validate when stopped. (#501)
More Info on Bug Fixes
  • Refactor gRPC related samples. (#502)
  • Fix UI issues in Docker/Kubernets export. (#504)
  • Add proper error handling to Docker/Kubernets export backend services. (#503)
  • Maintain templated Siddhi app in runtime without overriding with the populated app. (#505)
  • Fix console reconnection issue in editor. (#506)
  • Show only the started siddhi apps in on-demand query dialog box. (#522)
  • Avoid passing empty values for unset variables in Docker/Kubernetes export. (#525)
  • Prettify error messages in editor console. (#531)
  • Sample test client failures in windows environment. (#534)
  • Log error trace (if any) while trying to start Siddhi app from editor. (#542)
  • Jar to Bundle conversion failure in Windows environment. (#554)
  • Maintain a single Siddhi manager and reuse it across components. (#556)
  • Faulty Siddhi app not recovers even after the valid changes. (#559)
  • Siddhi app cannot be saved is the app name annotation is not given. (#563)
  • Docker push is not working in Widnows environment. (#565)
  • CSS issue when deleting elements in editor design view. (#571)
  • Simulator controls are not get disabled when app becomes faulty. (#574)
  • Case sensitivity issue in fault stream annotations. (#578)
  • Fix K8s unexpected character issue and set default messaging. (#583)
  • Issue in docker export with 'Could not acquire image ID or digest following build'. (#587)
  • Duplicate ports being added to docker file and readme. (#589)
  • Docker export does not list all the Siddhi apps. (#591)
  • Avoid parser creating multiple passthrough queries. (#593)
  • Add validation in docker export to select either download or push. (#597)
  • Duplicate stream definitions being added to Siddhi topology. (#599)
  • Bug fixes related to Docker/Kubernetes artifacts export features. (#372)
  • Change export file names and replace init script from the Dockerfile. (#383)
  • Remove unnecessary and unprotected API from runner distribution. (#389)
  • Bug: Switching from design view to source view after changing any element causes the conversion of triple-quotes into single ones in the avro scheme definition. (#353)
  • Fix for snakeyaml dependency issue. (#310)
  • Fix design view toggle button position (#243)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Please find the details of the corresponding docker release here

Siddhi Distribution 5.1.1-RC1 (Pre Release)

Features & Improvements

  • Provide snapshot persistence support for Amazon S3 buckets. (#657)
  • Support partial app creation for in-memory bridged apps. (#649)

Bug Fixes

  • Add proper names to zip files exported through Docker/K8S export wizard. (#613)
  • Use file separator instead of / in Docker and K8s export files. (#614)
  • Fix retry mechanism deploying a successful app again and again. (#615)
  • Fix parsing Siddhi apps with zero Siddhi query elements. (#643)
  • Avoid removing sink/sources while converting in-mem transports. (#650)
  • Remove editor file system based hot deployment. (#651)
  • Add triple quotes for highlighting rules. (#664)
  • Exception occurs in the Siddhi-Editor while sending events through event simulator. (#668) ) Fix simulator listing siddhi apps with template variables as FAULTY. (#678)
  • Use user-given topic for inMemory bridges during parsing. (#675)
  • Refresh explorer & simulator after file import. (#681)
  • Autofocus fails in search bar of the Import Sample option in editor. (#682)
  • Suppress log if the feed simulation is deployed with no relevant siddhi app in the workspace. (#684)

Highlighted Change

This release onwards, debug feature is removed from Siddhi editor runtime. (#669)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Please find the details of the corresponding docker release here

Siddhi Core Libraries Releases

Siddhi Core 5.1.8

Features & Improvements

  • Support mapping transport properties to any data type. (#1560)

Bug Fixes

  • NPE being thrown intermittently while removing bundles in shutdown process. (#1541)
  • Avoid triggers to start before other elements. (#1543)
  • SiddhiQL.g4 grammar file not building with antlr. (#1550)
  • Event chunk breaks for scatter-gather data processing with joins. (#1559)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.7

Bug Fixes

  • Fix aggregation definition error logs. (#1538)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.6

Highlights

  • Bug fixes related to Siddhi sink retry implementation, logging and aggregations. Most importantly, it contains a bug fix for the Siddhi extension loading issue in slow environments.

Features & Improvements

  • Improve error with context when updating environment variable (#1523)

Bug Fixes

  • Fix reconnection logic when publish() always throw connection unavailable exception. (#1525)
  • Fix Siddhi extension loading issue in slow environments. (#1529)
  • Fix the inconsistent behaviour aggregation optimization. (#1533)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.5

Highlights

  • Bug fixes covering various execution parts of Siddhi; mainly it contains fixes related to in-memory event table, error handling, extension loading, and event synchronization.

Features & Improvements

  • Improve logs for duplicate extension additions (#1521)
  • Code refactoring changes to rename store query to On-Demand query (#1506)

Bug Fixes

  • Fix for NPE when using stream name to refer to attributes in aggregation join queries. (#1503)
  • Fix update or insert operation in InMemoryTable for EventChunks. (#1497) , (#1512)
  • Fix for extension loading issue in certain OS environments (slow environments) (#1507)
  • Bug fixes related to error handling in Triggers (#1515)
  • Stop running on-demand queries if the Siddhi app has shut down (#1515)
  • Fix input handler being silent when siddhi app is not running (Throw error when input handler used without staring the Siddhi App runtime) (#1518)
  • Fix synchronization issues BaseIncrementalValueStore class (#1520)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.4

Highlights

  • Improvements related to @index annotation usage in stores and some dependency upgrades.

Features & Improvements

  • Change the behavior of in-memory tables to support multiple '@index' annotations. (#1491)

Bug Fixes

  • Fix NPE when count() AttributeFunction is used (#1485)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.3

Highlights

  • Improvements done for use cases such as throttling, continuous testing & integration and error handling.

Features & Improvements

  • Introduce RESET processing mode to preserve memory optimization. (#1444)
  • Add support YAML Config Manager for easy setting of system properties in SiddhiManager through a YAML file (#1446)
  • Support to create a Sandbox SiddhiAppRuntime for testing purposes (#1451)
  • Improve convert function to provide message & cause for Throwable objects (#1463)
  • Support a way to retrieve the sink options and type at sink mapper. (#1473)
  • Support error handling (log/wait/fault-stream) when event sinks publish data asynchronously. (#1473)

Bug Fixes

  • Fixes to TimeBatchWindow to process events in a streaming manner, when it's enabled to send current events in streaming mode. This makes sure all having conditions are matched against the output, whereby allowing users to effectively implement throttling use cases with alert suppression. (#1441)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.2

Highlights

  • There is an improvement done for Template Builder by removing Java Message Format dependency since it is causing some inconsistencies with performing custom mapping for float, double and long values. Due to this fix, there might be some differences (corrected proper output) in the output that you get for custom output mapping with Text, XML, JSON, and CSV. (#1431)
  • There is a behavioral change introduced with the improvements done with (#1421). When counting patterns are used such as e1=StockStream<2:8> and when they are referred without indexes such as e1.price it collects the price values from all the events in the counting pattern e1 and produces it as a list. Since the list is not native to Siddhi the attribute will have the object as its type. In older Siddhi version, it will output the last matching event’s attribute value.

Features & Improvements

  • SiddhiManager permits user-defined data to be propagated throughout the stack (#1406)
  • API to check whether the Siddhi App is stateful or not (#1413)
  • Support outputting the events collected in counting-pattern as a list (#1421)
  • Support API docs having multiline code segments (#1430)
  • Improve TemplateBuilder & remove Java MessageFormat dependency (#1431)
  • Support pattern ‘every’ clause containing multiple state elements with within condition (#1435)

Bug Fixes

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.1

Features & Improvements

  • Siddhi store join query optimizations (#1382)

Bug Fixes

  • Log Rolling when aggregation query runs when Database is down (#1380)
  • Fix to avoid API changes introduced for Siddhi store implementation in Siddhi 5.1.0 (#1388)
  • Counting pattern issue with ‘every’ (#1392)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi Core 5.1.0

Features & Improvements

  • Minor improvements related to error messages used for the no param case when paramOverload annotation is in place. (#1375)

Complete Changes

Please find the complete changes here

Please find more details about the release here

Siddhi K8s Operator Releases

Siddhi Operator 0.2.0

Siddhi team is excited to announce the Siddhi Operator Release 0.2.0. Please find the major improvements and features introduced in this release.

Compatibility & Support

There are specification changes in Siddhi Process Custom Resource Definition. You have to use siddhi.io/v1alpha2 custom resources with this release.

Features & Improvements

SiddhiProcess Spec Changes from 0.1.1

  1. Aggregate previous apps and query specs to a single spec called apps.

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    apps:
    -
        configMap: app
    -
        script: |-
            @App:name("MonitorApp")
            @App:description("Description of the plan")  
            @sink(type='log', prefix='LOGGER')
            @source(
                type='http',
                receiver.url='http://0.0.0.0:8080/example',
                basic.auth.enabled='false',
                @map(type='json')
            )
            define stream DevicePowerStream (type string, deviceID string, power int);
            @sink(type='log', prefix='LOGGER')
            define stream MonitorDevicesPowerStream(sumPower long);
            @info(name='monitored-filter')
            from DevicePowerStream#window.time(100 min)
            select sum(power) as sumPower
            insert all events into MonitorDevicesPowerStream;
    
  2. Replace previous pod spec with the container spec.

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    container:
        env:
            -
            name: RECEIVER_URL
            value: "http://0.0.0.0:8080/example"
            -
            name: BASIC_AUTH_ENABLED
            value: "false"
            -
            name: NATS_URL
            value: "nats://siddhi-nats:4222"
            -
            name: NATS_DEST
            value: siddhi
            -
            name: NATS_CLUSTER_ID
            value: siddhi-stan
        image: "siddhiio/siddhi-runner-ubuntu:latest"
    
  3. The imagePullSecret under pod spec which was in previous releases move to the upper level in the YAML. (i.e Directly under the spec of CR )

  4. Remove previous tls spec. Now you can configure ingress TLS secret using the siddhi-operator-config config map.
  5. Change YAML naming convention to the Camel case.

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    14
    15
      messagingSystem:
        type: nats
        config: 
          bootstrapServers: 
            - "nats://nats-siddhi:4222"
          streamingClusterId: stan-siddhi
    
      persistentVolumeClaim: 
        accessModes: 
          - ReadWriteOnce
        resources: 
          requests: 
            storage: 1Gi
        storageClassName: standard
        volumeMode: Filesystem
    

  6. Enable the version controlling to the SiddhiProcesses. (#57), (#66)

  7. NGINX ingress 0.22.0+ support.
  8. Adding readiness and liveness probes to the Siddhi runner. (#46)
  9. Change previous static Siddhi parser to a dynamic one which embedded with the Siddhi runner. (#71)

Bug Fixes

  1. Failover Deployment support related features (#33)
  2. Operator crashes the when NATS unavailable in the cluster (#50)
  3. Versioning in siddhi application level (#42)
  4. Getting segmentation fault error when creating PVC automatically (#86)
  5. Stateful Siddhi Application fails deployment if persistence volume is unavailable (#92)

Siddhi Operator 0.2.1-RC1 (Pre Release)

Bug Fixes

  1. Enable users to view deployed partial Siddhi apps directly using SiddhiProcess (#101)
  2. Enable users to view the READY status when pods become available (#80)
  3. Add initial pending state and intermediate updating state to the SiddhiProcess custom resource object (#90)

Please find more details about the release here

Top