Dolphinscheduler: Suggest to support the Kettle job/transformation
Use Shell dispatching a kettle component for a large number of kettle jobs can cause a memory explosion. Can you support this aspect of scheduling optimization
Mryst
All 9 comments
@zhaxiaodong9860 is doing this feature
dailidong
on 12 Mar 2020
Each call to kettle with a shell script will Initialize a JVM environment, which is the reason of memory overload.Calling the kettle API with Java can solve the memory overload problem, and I'm currently planning to support kettle job/transformation in the DS.
zhaxiaodong9860
on 12 Mar 2020
Each call to kettle with a shell script will Initialize a JVM environment, which is the reason of memory overload.Calling the kettle API with Java can solve the memory overload problem, and I'm currently planning to support kettle job/transformation in the DS.
good job, if you have some progress for this feature, please add to the comment
dailidong
on 19 Mar 2020
@zhaxiaodong9860 this feature is done? I ask a question. where the ktr/kjb save? file or db?
lzy305
on 26 Mar 2020
@lzy305 Not yet,I plan to achieve both. It's planned to be finished by the end of May.
zhaxiaodong9860
on 2 Apr 2020
@lzy305 Not yet,I plan to achieve both. It's planned to be finished by the end of May.
Hi~ how is the progress
Mryst
on 20 Apr 2020
@zhaxiaodong9860 Hi ~ how is the progress
Mryst
on 26 Apr 2020
what kettle vision is supported and how is the progress?
jinyabin111
on 28 May 2020
@zhaxiaodong9860 hi ,how is the progress?
dailidong
on 19 Jun 2020
Related issues
gaoyang-projects
·
6Comments
13430647361
·
3Comments
wistwill
·
4Comments
zhangkaikai
·
3Comments
baihongbin
·
5Comments
Most helpful comment
Each call to kettle with a shell script will Initialize a JVM environment, which is the reason of memory overload.Calling the kettle API with Java can solve the memory overload problem, and I'm currently planning to support kettle job/transformation in the DS.