Ohara: Ohara 0.9.0 Release

[saivirtue]

Schedule: ~Forzen: 2020/1/5, Release: 2020/02/17~

Forzen: 2020/02/17 (一), Release: 2020/03/20 (五)

Need To Be Done

[Manager]

• [x] Disable the following functions (#3689) @konekoya
  
  
  
  • Expert mode link
  
  
  • Event Log icon button
  
  
  • add node and delete buttons of node list & node view page in k8s mode
  
  
  • Overview and Settings tabs of workspace
  
  
  • More action icon button of edit workspace dialog
  
  
  • Used by pipelines column from edit workspace's topic list. And in workspace list dialog
  
  
• [x] upload file action of workspace should switch to the file tab after successfully uploading a file (#3698) @konekoya
• [x] workspace title should use the current workspace name (#3689) @konekoya
• [x] add pipeline should delay the checking of naming rule (length > 1) (#3698) @konekoya
• [x] add link lines to components of pipeline will cause weird display sometimes @wu87988622 #3649
• [x] workspace last modified time is wrong in workspace list icon button (#3698) @konekoya

[Backend]

• Ohara docs
  
  
  
  • [ ] Update restful api docs (@jackyoh, @chia7712)
  
  
  • [ ] Update Ohara Manager related pages (@konekoya)
  
  
• Quickstart VM docs
  
  
  
  • [ ] Quickstart VM docs (@konekoya)
    
    

Highlights

Some important changes

UI

1. Frontend project scaffolding (#2994)
2. Implement pipeline navigator (#3097)
3. Implement pipeline toolbar (#3331)
4. Implement pipeline toolbox (#3184)

Tasks that have been moved to v0.10

1. Cluster settings
2. Event log
3. Navigator outline and filter
4. Property view
5. Passing timezone to UI by inspect APIs
6. add a finish step in creating workspace
7. Metrics of topic list change to 2/3 of overall layout

APIs

1. LIST request accept filter queries now. For example, pass topics?a=b to get topics having setting "a -> b".
2. Log APIs is able to fetch Configurator service log
3. Info APIs is able to fetch the available settings from the docker image which you are going to deploy
4. Query APIs is able to fetch the content of file and Topic

5. strict checks of resources dependencies.

   Zookeeper:

6. CAN'T stop a zookeeper cluster used by RUNNING broker cluster.

7. CAN'T delete a zookeeper cluster refereed by broker cluster

   Broker:

8. CAN'T create a broker cluster related to nonexistent zookeeper cluster.

9. CAN'T stop a broker cluster used by RUNNING worker cluster, streamApp or topic.

10. CAN'T delete a broker cluster refereed by worker cluster, streamApp or topic

    Worker:

11. CAN'T create a worker cluster related to nonexistent broker cluster.

12. CAN'T create a worker cluster related to nonexistent jar
13. CAN'T stop a worker cluster used by RUNNING connector.

14. CAN'T delete a worker cluster refereed by connector

    Topic:

15. CAN'T create a topic related to nonexistent broker cluster.

16. CAN'T stop a topic used by RUNNING connector or streamApp.

17. CAN'T delete a topic refereed by connector or streamApp

    Connector:

18. CAN'T create a connector related to nonexistent worker cluster.

19. CAN'T create a connector related to topics which are not on same broker cluster

    Stream:

20. CAN'T create a streamApp related to topics which are not on same broker cluster

21. CAN'T create a worker cluster related to nonexistent jar

    File:

22. CAN'T delete a file used by Worker cluster or streamApp

    Node:

23. CAN'T delete a node used by Worker, streamApp, Zookeeper or Broker

ToDo

1. 
   
   • [x] fork 0.9.x branch
   
   
2. 
   
   • [x] change 0.9.0-SNAPSHOT to 0.10.0-SNAPSHOT for master branch (#4052)
   
   
3. 
   
   • [x] Create a new testcase "jdbc->topic->stream->topic->hdfs" (#3695)
   
   
4. 
   
   • [x] Create Ohara product testing report issue
   
   
5. 
   
   • [x] Make sure jenkins is able to build and test on both 0.9.x and 1.0 branches
   
   
6. 
   
   • [x] change 0.9.0-SNAPSHOT to 0.9.0 for 0.9.x branch (#4370)
   
   
7. 
   
   • [x] change "branch" to 0.9.0 for gradle.properties (#4387)
   
   
8. 
   
   • [x] change "branch" to 0.9.x for build.yml (#4402)
   
   
9. 
   
   • [x] Build and Upload Ohara jars to Bintray repo
   
   
10. 
    
    • [x] Build and Upload docker images to dockerhub
    
    
11. 
    
    • [x] Remove all 0.9.0-SNAPSHOT images from docker hub
    
    
12. 
    
    • [x] Create release page
    
    
13. 
    
    • [x] Deploy to demo environment (QA env is unavailable now so I skip this)
    
    

noted: the above changes (5, 6, 7) should be completed by single PR in the future!!!

[saivirtue]

ping @chia7712
Feel free to take over this issue :)

[chia7712]

Feel free to take over this issue :)

together :)

[chia7712]

@oharastream/developer

I will start the release of 0.9.0 if #4313 is merged. Feel free to raise objection :)

[konekoya]

I will start the release of 0.9.0 if #4313 is merged. Feel free to raise objection :)

4313 is ready for 0.9. But 0.10's PR breaks some e2e tests due to the recent Manager's refactoring and structure changes. Should I just remove 0.10 from its task and so we can close the issue and ready for release?

[vitojeng]

@chia7712 Just raise #4332 , it would be better backport to 0.9.x

[chia7712]

Should I just remove 0.10 from its task and so we can close the issue and ready for release?

The fix ought to be in both 0.9.0 and 0.10.0 if it is a "bug" fix :)

[chia7712]

I'm going to update the version to 0.9.0 if all tests pass again :)

[chia7712]

@oharastream/frontend Do you resolve the version issue? IIRC, you encountered that Ohara Manager fails to get the version file from the distribution files?

[konekoya]

@oharastream/frontend Do you resolve the version issue? IIRC, you encountered that Ohara Manager fails to get the version file from the distribution files?

It was resolved by @saivirtue but we didn't plan backporting to 0.9.

[chia7712]

blocked by #4350