Label-studio: Undocumented schema for ML predictions

Created on 14 Sep 2020  路  5Comments  路  Source: heartexlabs/label-studio

Hello, first of all, thank you for your great project! Seems very useful!

I am trying to to connect some custom ML backends. In order to do that, I would need to understand what format the various tasks expect as a response. The ML examples all use the same schema which, if I understand correctly, is for a classification task. I am trying to connect a NER task and I cannot figure out what is the schema of the expected response.

Is this documented anywere (possibly for other tasks too)?

documentation

Most helpful comment

What I did to figure out the required format for the responses was to study a JSON file in the completions folder. Once any example is labeled manually, a file should appear in the completions folder and contain the schema. Then, you would only have to identify where your values from the backend have to be inserted.

All 5 comments

What I did to figure out the required format for the responses was to study a JSON file in the completions folder. Once any example is labeled manually, a file should appear in the completions folder and contain the schema. Then, you would only have to identify where your values from the backend have to be inserted.

Thank you, that works! Still, I will leave this open, since it would be better to have it documented explicitly

I'll add it into docs. Also in 0.7.5 it will be more comfortable way to explore the task body.

It would be nice to get an example JSON similar to task creation.
Also, please document, that fields can be left empty.

We have different tasks for annotation of the same image, it took me a while to figure out, that I could leave some results empty.

https://labelstud.io/guide/predictions.html now contains more details and example JSON

Was this page helpful?
0 / 5 - 0 ratings

Related issues

Rishabh-hyperverge picture Rishabh-hyperverge  路  6Comments

atakanokan picture atakanokan  路  3Comments

potipot picture potipot  路  4Comments

Rishabh-hyperverge picture Rishabh-hyperverge  路  3Comments

dalekube picture dalekube  路  3Comments