Ohara: Ohara 0.8.0 Release

[chia7712]

Schedule: Forzen: 10/1, Release: 10/9

Highlights

APIs:

1. support setting fields for all clusters. (#2191 @saivirtue)
   
   
   
   • From now on, the parameters of a request from cluster API could be decided by users, all the parameters are moved to the "settings" field. You can use the API to create a cluster with your own custom settings.
   
   
2. config the services by what you want. (the available configs is exposed by definitions. see APIs). For example, you are able to config a topic with "flush.ms" to force the data to be frequently flush to disk. Or you can increase the segment size of a topic via setting "segment.bytes". Apart from topic, you are able to create connector and streamapp as you wish. (#2181)

Connector:

1. A powerful and flexible CSV connector (#2447 @eechih)
2. Introduce SMB Sink Connector (#2274 @eechih)
3. Integration test support JDBC Source connector for the Oracle Database. (#1740 @jackyoh)
4. a simple but powerful restful services with json representation - JsonIn and JsonOut (#2547)

Document

1. A quick start tutorial document with a ready to use VM. (@vitojeng)
   
   
   
   • VM for quick start: Generate automatically and integrate with our Jenkins flow. (#2440)
   
   
   • Quick start: Use the quick start VM to demonstrate how to rapidly build data pipelines using Ohara.(#1787)
   
   

UI:

1. Allow users to upgrade an existing workspace (#1343) @wu87988622
   
   
   
   • Add plugins tab in workspace and inside overview tab (#2482 )
   
   
   • Upgrade workspace with updated plugins (#2483)
   
   
   • Restore workspace if the upgrade failed (#2484)
   
   
2. Material UI migration phase 2 (#2221) (#2378) @konekoya @wu87988622
3. Support all official connectors (#1969) @konekoya
4. Support all value types (#2383) @konekoya
5. JointJS survey (#866) @konekoya
6. Topics can only be used in a single pipeline (#2469) @konekoya

1. Adapt backend API changes (#2457) @konekoya

ToDo:

• [x] Create 0.8 branch (base on the last commit of frozen day)
• [x] Bump snapshot and docs versions (#2865)
• [x] Change branch and docs versions from 0.8 to 0.8.x (#2884)
• [x] Make sure jenkins is able to build and test on both 0.8.x and 0.9 branches
• [x] Deploy to demo environment
• [x] Create Ohara product testing report issue (#2869)
• [x] Update 0.8.x branch's SNAPSHOT version to 0.8.0 (#2976)
• [x] Create a new release draft in GitHub's release page
• [x] Build and Upload Ohara jars to Bintray repo
• [x] Add tag to release wiki page
• [x] Build and upload 0.8's binary files to the release draft we created earlier
• [x] Bump snapshot version to 0.8.1-SNAPSHOT (#3010)
• [x] Remove all 0.8.0-SNAPSHOT images from docker hub

[chia7712]

@wu87988622 @konekoya Is it possible to add "log" to our UI in 0.8?

[konekoya]

@chia7712 Are you talking about the API in #1532

[chia7712]

Are you talking about the API in #1532

1532 is a use case of log. The usage of logs for 0.8 are shown below.

1) show the logs of a starting workspace, 2) show the log of of streamapp

It seems to me the logs is a powerful information to say what happens on backend.

As a RM, I indeed long for this feature :)

[vitojeng]

If we want to add "log" to our UI, it would be better to create a simple proposal include a wireframe first.
/cc @eechih

[konekoya]

+1 with @vitojeng's suggestion.

As for this feature, I think we (frontend) already have quite some tasks at hand 😅 Maybe we can do this in 0.9. Sorry about that @chia7712!

[chia7712]

Sorry about that

Not a problem at all.

For another, what about definition for clusters?

[konekoya]

For another, what about definition for clusters?

That's planned in 0.9 as well :)

[konekoya]

@oharastream/developer the frozen date of this release will be postponed. Since @vitojeng needs more time to discuss the ongoing product design in #2470 with us. I will update the description when the date is confirmed.

[konekoya]

@oharastream/developer updated the 0.8 codebase frozen and release date.

[konekoya]

@oharastream/developer Please remove 0.8 label (fix version) from your issues if the issue won't get into 0.8 release/branch. Thanks :)

[konekoya]

@oharastream/developer Hey guys! We will be releasing 0.8.0 in tomorrow afternoon. Just wanted to remind you if you haven't updated or wanted to add more about what you have done in this release in the __highlights__.

[konekoya]

Highlights

• Quickstart VM:

  A pre-prepared Ohara with all modules loaded in a single node VM. Now you can experience the latest Ohara-Manager more easily and quickly.(download here)

• Upgrading workspace:

  You're now able to upgrade a running workspace with only a few keystrokes with our UI. This means you can upload/delete jars from your running workspace without stopping it and losing your data!

• Connectors:

  • __JDBC Source Connector__: Added JDBC Source connector integration test for Oracle database.
  • __JsonIn and JsonOut connector__: A simple but powerful restful services with JSON representation
  • __SMB connector__: A powerful connector for SMB with the ability to read and write CSV files.

• API:

  • Cluster APIs support user-defined setting fields
  • Group is fully supported now.

[konekoya]

@vitojeng Please help resolve the last task in the issue description, thanks :)

[konekoya]

0.8.0-SNAPSHOT images removed, closing this issue