Joss-reviews: [REVIEW]: Miet: an R package for region of interest analysis from magnetic reasonance images

Created on 2 Nov 2019  ยท  97Comments  ยท  Source: openjournals/joss-reviews

Submitting author: @benoit-combes (Benoit Combรจs)
Repository: https://gitlab.inria.fr/miet/miet
Version: v0.2
Editor: @arokem
Reviewer: @janfreyberg, @neuroimaginador
Archive: 10.5281/zenodo.3626693

Status

status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/812bd13a18e338ef53c6760c32e6216c"><img src="https://joss.theoj.org/papers/812bd13a18e338ef53c6760c32e6216c/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/812bd13a18e338ef53c6760c32e6216c/status.svg)](https://joss.theoj.org/papers/812bd13a18e338ef53c6760c32e6216c)

Reviewers and authors:

Please avoid lengthy details of difficulties in the review thread. Instead, please create a new issue in the target repository and link to those issues (especially acceptance-blockers) by leaving comments in the review thread below. (For completists: if the target issue tracker is also on GitHub, linking the review thread in the issue or vice versa will create corresponding breadcrumb trails in the link target.)

Reviewer instructions & questions

@janfreyberg & @neuroimaginador, please carry out your review in this issue by updating the checklist below. If you cannot edit the checklist please:

  1. Make sure you're logged in to your GitHub account
  2. Be sure to accept the invite at this URL: https://github.com/openjournals/joss-reviews/invitations

The reviewer guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html. Any questions/concerns please let @arokem know.

โœจ Please try and complete your review in the next two weeks โœจ

Review checklist for @janfreyberg

Conflict of interest

  • [x] I confirm that I have read the JOSS conflict of interest (COI) policy and that: I have no COIs with reviewing this work or that any perceived COIs have been waived by JOSS for the purpose of this review.

Code of Conduct

General checks

  • [x] Repository: Is the source code for this software available at the repository url?
  • [x] License: Does the repository contain a plain-text LICENSE file with the contents of an OSI approved software license?
  • [x] Contribution and authorship: Has the submitting author (@benoit-combes) made major contributions to the software? Does the full list of paper authors seem appropriate and complete?

Functionality

  • [x] Installation: Does installation proceed as outlined in the documentation?
  • [x] Functionality: Have the functional claims of the software been confirmed?
  • [x] Performance: If there are any performance claims of the software, have they been confirmed? (If there are no claims, please check off this item.)

Documentation

  • [x] A statement of need: Do the authors clearly state what problems the software is designed to solve and who the target audience is?
  • [x] Installation instructions: Is there a clearly-stated list of dependencies? Ideally these should be handled with an automated package management solution.
  • [x] Example usage: Do the authors include examples of how to use the software (ideally to solve real-world analysis problems).
  • [x] Functionality documentation: Is the core functionality of the software documented to a satisfactory level (e.g., API method documentation)?
  • [x] Automated tests: Are there automated tests or manual steps described so that the functionality of the software can be verified?
  • [x] Community guidelines: Are there clear guidelines for third parties wishing to 1) Contribute to the software 2) Report issues or problems with the software 3) Seek support

Software paper

  • [x] Summary: Has a clear description of the high-level functionality and purpose of the software for a diverse, non-specialist audience been provided?
  • [x] A statement of need: Do the authors clearly state what problems the software is designed to solve and who the target audience is?
  • [x] State of the field: Do the authors describe how this software compares to other commonly-used packages?
  • [x] Quality of writing: Is the paper well written (i.e., it does not require editing for structure, language, or writing quality)?
  • [x] References: Is the list of references complete, and is everything cited appropriately that should be cited (e.g., papers, datasets, software)? Do references in the text use the proper citation syntax?

Review checklist for @neuroimaginador

Conflict of interest

  • [x] I confirm that I have read the JOSS conflict of interest (COI) policy and that: I have no COIs with reviewing this work or that any perceived COIs have been waived by JOSS for the purpose of this review.

Code of Conduct

General checks

  • [x] Repository: Is the source code for this software available at the repository url?
  • [x] License: Does the repository contain a plain-text LICENSE file with the contents of an OSI approved software license?
  • [x] Contribution and authorship: Has the submitting author (@benoit-combes) made major contributions to the software? Does the full list of paper authors seem appropriate and complete?

Functionality

  • [x] Installation: Does installation proceed as outlined in the documentation?
  • [x] Functionality: Have the functional claims of the software been confirmed?
  • [x] Performance: If there are any performance claims of the software, have they been confirmed? (If there are no claims, please check off this item.)

Documentation

  • [x] A statement of need: Do the authors clearly state what problems the software is designed to solve and who the target audience is?
  • [x] Installation instructions: Is there a clearly-stated list of dependencies? Ideally these should be handled with an automated package management solution.
  • [x] Example usage: Do the authors include examples of how to use the software (ideally to solve real-world analysis problems).
  • [x] Functionality documentation: Is the core functionality of the software documented to a satisfactory level (e.g., API method documentation)?
  • [x] Automated tests: Are there automated tests or manual steps described so that the functionality of the software can be verified?
  • [x] Community guidelines: Are there clear guidelines for third parties wishing to 1) Contribute to the software 2) Report issues or problems with the software 3) Seek support

Software paper

  • [x] Summary: Has a clear description of the high-level functionality and purpose of the software for a diverse, non-specialist audience been provided?
  • [x] A statement of need: Do the authors clearly state what problems the software is designed to solve and who the target audience is?
  • [x] State of the field: Do the authors describe how this software compares to other commonly-used packages?
  • [x] Quality of writing: Is the paper well written (i.e., it does not require editing for structure, language, or writing quality)?
  • [x] References: Is the list of references complete, and is everything cited appropriately that should be cited (e.g., papers, datasets, software)? Do references in the text use the proper citation syntax?
accepted published recommend-accept review

Most helpful comment

Congratulations, @benoit-combes, your JOSS paper is published! ๐Ÿš€

Huge thanks to our editor: @arokem, and the reviewers: @janfreyberg, @neuroimaginador โ€” your contributions to JOSS are invaluable ๐Ÿ™

All 97 comments

Hello human, I'm @whedon, a robot that can help you with some common editorial tasks. @janfreyberg, @neuroimaginador it looks like you're currently assigned to review this paper :tada:.

:star: Important :star:

If you haven't already, you should seriously consider unsubscribing from GitHub notifications for this (https://github.com/openjournals/joss-reviews) repository. As a reviewer, you're probably currently watching this repository which means for GitHub's default behaviour you will receive notifications (emails) for all reviews ๐Ÿ˜ฟ

To fix this do the following two things:

  1. Set yourself as 'Not watching' https://github.com/openjournals/joss-reviews:

watching

  1. You may also like to change your default settings for this watching repositories in your GitHub profile here: https://github.com/settings/notifications

notifications

For a list of things I can do to help you, just type:

@whedon commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@whedon generate pdf
Attempting PDF compilation. Reticulating splines etc...

@arokem can you check progress here?

@janfreyberg : I see that you've checked off a couple of items. Any progress on the other items?

@neuroimaginador : have you had a chance to take a look?

Hi @arokem - apologies for the delay! I've been away with work.

I've ticked the bits I was able to verify and will raise a few issues on their repo now.

@janfreyberg @neuroimaginador. Thanks for agreing to review my work and for your first inputs. If I can do anything that may help you in the reviewing process, please let me know.

@janfreyberg @neuroimaginador. Dear reviewers, I just realized that a directory was missing from the miet repository. This lack simply causes the function documentation not to be available using the regular package installation procedure. I corrected this lack by adding the missing directory so that the doc is not available using the regular "?" command. I hope this lack did not disturb too much your work. If I can do anything that may help you in the reviewing process, please let me know.

Thanks @benoit-combes - I've left a few comments about the documentation. I think aside from a fix / answer to the issues on your gitlab issue, I didn't feel able to tick off "state of the field" - would you be able to add this to the paper, even if it's just "Currently you have to read array data manually and program all the table creations yourself" or something along those lines.

@whedon generate pdf

Attempting PDF compilation. Reticulating splines etc...

@whedon generate pdf

@janfreyberg. Thanks for these valuable points. I tried to address them with my last pushes. Concerning the point you raised in your comment, I added to the joss paper (end of section 1):

"Such an analysis needs to iterate over all MR volumes to read them and to
extract the relevant statistics. To the best of our knowledge, there is no
dedicated framework to ease such tasks, which may result in lengthy technical
analysis codes. Miet (acronym of medical imaging extraction tools) is an R
package attempting to fill that gap. More specifically, miet is designed to
specify and extract tibbles (which is an improved data.frame structure) ready for data analysis from a specified folder hierarchy and a
set of extraction formulas."

I commented my fixes for each of the other points in the issues you raised on gitlab.

I hope everythink is correct to you, if for any reason it is not the case, please let me know.

Thanks again for your inputs.

@whedon generate pdf

Great, thanks. This addresses all my concerns.

Dear @arokem, may I ask you whether you get supplemental information about @neuroimaginador availability to review the work ? Thanks in advance.

Sorry about the delay here. Let me try to track this reviewer down, as they have not responded here.

Sorry about the delay, @arokem and @benoit-combes , I'm now reviewing the paper and the package. Just opened an issue regarding a potential enhancement by using a "testthat" folder structure as described in http://r-pkgs.had.co.nz/tests.html, which is a standard and completely automated way of testing, and required by CRAN submissions.

Thank you, @benoit-combes for addressing my issues, I'm more than satisfied with this package, since it may be very useful to get people from neuroimaging into R. I have already closed all my issues. Thanks.

@neuroimaginador. Thanks for this relevant suggestion. I modified the testing strategy following your suggestion. I hope everythink is now ok to you, if for any reason it is not the case, please let me know.

@whedon generate pdf

@whedon generate pdf

@whedon generate pdf

Dear @arokem, I read again the paper and fixed a few grammar/spelling mistakes and ambiguous wordings. If I can do anything that may help you in the editing process, please let me know.

@whedon check references

Reference check summary:

OK DOIs

- None

MISSING DOIs

- https://doi.org/10.1148/radiographics.14.2.8190954 may be missing for title: Magnetization transfer: theory and clinical applications in neuroradiology.

INVALID DOIs

- None

In addition to adding the missing DOI for this reference, I have added some proposed edits in a patch attached to https://gitlab.inria.fr/miet/miet/issues/9

@whedon generate pdf

@whedon check references

Reference check summary:

OK DOIs

- None

MISSING DOIs

- https://doi.org/10.1148/radiographics.14.2.8190954 may be missing for title: Magnetization transfer: theory and clinical applications in neuroradiology.

INVALID DOIs

- None

@whedon check references

Reference check summary:

OK DOIs

- None

MISSING DOIs

- https://doi.org/10.1148/radiographics.14.2.8190954 may be missing for title: Magnetization transfer: theory and clinical applications in neuroradiology.

INVALID DOIs

- None

@whedon generate pdf

@whedon check references

Reference check summary:

OK DOIs

- None

MISSING DOIs

- None

INVALID DOIs

- https://pubs.rsna.org/doi/10.1148/radiographics.14.2.8190954 is INVALID because of 'https://doi.org/' prefix

@whedon generate pdf

@whedon check references

Reference check summary:

OK DOIs

- None

MISSING DOIs

- None

INVALID DOIs

- https://doi.org/10.1148/radiographics.14.2.8190954 is INVALID because of 'https://doi.org/' prefix

@whedon generate pdf

@whedon check reference

I'm sorry human, I don't understand that. You can see what commands I support by typing:

@whedon commands

@whedon check references

Reference check summary:

OK DOIs

- 10.1148/radiographics.14.2.8190954 is OK

MISSING DOIs

- None

INVALID DOIs

- None

Dear @arokem.

Thanks for your responsiveness and for these nice suggestions, I added all of them, expect the one consisting in capitalizing "miet" as "Miet". In the last version, I used "Miet" to start a new sentence (and title), but it seems to me that this is actually not the conventional practice and that this may have motivated your suggestion. In the revised version, I proposed to use "miet" everywhere ; I looked at standard R package e.g. dplyr and they seem to follow this rule. Do you feel confortable with this choice ?

I also added the doi as suggested.Thanks,
B.

Yes - that sounds fine to me! With these changes, I believe that your submissions is ready for final review by the editors in chief. Before we proceed to this step, could you please do the following:

  • [ ] Make a tagged release of your software, and list the version tag of the archived version here.
  • [ ] Archive the reviewed software in Zenodo or a similar service (e.g. figshare, an institutional repository)
  • [ ] Check the archival deposit (e.g., in Zenodo) has the correct metadata, this includes the title (should match the paper title) and author list (make sure the list is correct and people who only made a small fix are not on it); you may also add the authors' ORCID.
  • [ ] Please list the DOI of the archived version here.

We can then move forward with accepting the submission.

@arokem ; thanks for these detailed steps. So here is :

If I am correct, this fills the 4 steps detailed above, if it is not the case, please let me know.

Moreover, the paper title has changed from "Miet: an R package for region of interest analysis from magnetic reasonance images" to "miet: an R package for region of interest analysis from magnetic reasonance images", maybe there is some metadata related to my submission to change ?

@whedon set 10.5281/zenodo.3626693 as archive

OK. 10.5281/zenodo.3626693 is the archive.

@openjournals/joss-eics : I believe this is ready for your final review.

In particular, not submitter's question above:

[...], the paper title has changed from "Miet: an R package for region of interest analysis from magnetic reasonance images" to "miet: an R package for region of interest analysis from magnetic reasonance images", maybe there is some metadata related to my submission to change ?

Does it?

@whedon generate pdf

@arokem @benoit-combes - the PDF has the correct title so I think this should be fine (i.e. no additional changes are necessary).

@whedon set v0.2 as version

OK. v0.2 is the version.

@benoit-combes โ€” Your last reference is missing its DOI. I found it is 10.1093/scan/nsm006.

Would you consider formatting the software title with code font? It looks a bit odd to see the word miet in the text with normal font, so I'm suggesting using miet. What do you think?

In a couple of places, you have a reference inside a parenthetical, resulting in two sequential brackets, like this "))" โ€” if you care to tweak a bit, that could be avoided. (Just a small style thing.)

And you have a "colmun" instead of "column" in there. Have a look!

@whedon generate pdf

@whedon generate pdf

@whedon generate pdf

@whedon check references

Reference check summary:

OK DOIs

- 10.1148/radiographics.14.2.8190954 is OK
- 10.1093/scan/nsm006 is OK

MISSING DOIs

- None

INVALID DOIs

- None

Dear @labarba,

thanks for your inputs. I generated a new article proof where:

  • I added the mission DOI.
  • I changed the title according to your suggestion ; I fully agree your feeling about the original verion.
  • I rephrased the references to avoid the "))" sequences.
  • I corrected the "colmun" typo.

If I can do anything that may help you in the editing process, please let me know.

Oops. Now you've left citations appearing in the sentences without any brackets at all. Have a look at the Citation Syntax guidelines we like to apply. When the citation is part of the sentence, it appears as: Author (year). If the citation is not part of the sentence, then it appears in parenthesis. E.g. โ€œWe take inspiration from Smith et al. (2006) to do blah โ€œ / "The code implements Theory 1 (Jones 2012) and Theory 2 (Roberts 2014) to obtain โ€ฆ โ€œ

My original comment was for instances where you had a citation inside a parenthetical comment in the text. You can sometimes replace the parentheses by em-dashes. Or you can make some other adjustment.

Sorry that my suggestion led you astray.

Could you change to code-font for "miet" inside the text? For example, at the start of the section with heading "A short example."

@whedon generate pdf

@whedon generate pdf

@whedon generate pdf

Thanks @labarba. It seems, that for any reason, I indeed missed the correct syntax for citation. Sorry for that. I hope that the newly generated version now follows the standard.

Moreover, as suggested I "codify" each instance of miet in the text.

If I can do anything that may help you in the editing process, please let me know.

@whedon accept

Attempting dry run of processing paper acceptance...
Reference check summary:

OK DOIs

- 10.1148/radiographics.14.2.8190954 is OK
- 10.1093/scan/nsm006 is OK

MISSING DOIs

- None

INVALID DOIs

- None

Check final proof :point_right: https://github.com/openjournals/joss-papers/pull/1252

If the paper PDF and Crossref deposit XML look good in https://github.com/openjournals/joss-papers/pull/1252, then you can now move forward with accepting the submission by compiling again with the flag deposit=true e.g.
@whedon accept deposit=true

@whedon accept deposit=true

Doing it live! Attempting automated processing of paper acceptance...

๐Ÿฆ๐Ÿฆ๐Ÿฆ ๐Ÿ‘‰ Tweet for this paper ๐Ÿ‘ˆ ๐Ÿฆ๐Ÿฆ๐Ÿฆ

๐Ÿšจ๐Ÿšจ๐Ÿšจ THIS IS NOT A DRILL, YOU HAVE JUST ACCEPTED A PAPER INTO JOSS! ๐Ÿšจ๐Ÿšจ๐Ÿšจ

Here's what you must now do:

  1. Check final PDF and Crossref metadata that was deposited :point_right: https://github.com/openjournals/joss-papers/pull/1253
  2. Wait a couple of minutes to verify that the paper DOI resolves https://doi.org/10.21105/joss.01862
  3. If everything looks good, then close this review issue.
  4. Party like you just published a paper! ๐ŸŽ‰๐ŸŒˆ๐Ÿฆ„๐Ÿ’ƒ๐Ÿ‘ป๐Ÿค˜

    Any issues? notify your editorial technical team...

Congratulations, @benoit-combes, your JOSS paper is published! ๐Ÿš€

Huge thanks to our editor: @arokem, and the reviewers: @janfreyberg, @neuroimaginador โ€” your contributions to JOSS are invaluable ๐Ÿ™

:tada::tada::tada: Congratulations on your paper acceptance! :tada::tada::tada:

If you would like to include a link to your paper from your README use the following code snippets:

Markdown:
[![DOI](https://joss.theoj.org/papers/10.21105/joss.01862/status.svg)](https://doi.org/10.21105/joss.01862)

HTML:
<a style="border-width:0" href="https://doi.org/10.21105/joss.01862">
  <img src="https://joss.theoj.org/papers/10.21105/joss.01862/status.svg" alt="DOI badge" >
</a>

reStructuredText:
.. image:: https://joss.theoj.org/papers/10.21105/joss.01862/status.svg
   :target: https://doi.org/10.21105/joss.01862

This is how it will look in your documentation:

DOI

We need your help!

Journal of Open Source Software is a community-run journal and relies upon volunteer effort. If you'd like to support us please consider doing either one (or both) of the the following:

Please explain the situation here, and point to the correction you want made. The paper is already published so any corrections need to be made _by hand_.

Ping @openjournals/dev

Dear @labarba,

I added more information to my last message. Do you think it is sufficient to apply the correction ? If not please, let me know.

Thanks in advance for your consideration,
B.

The EiC (@arfon) can help you with a post-publication correction. This is a manual process.

This is now updated. It may take a few hours to show up differently on the JOSS site due to caching.

Dear Joss Editor @labarba @arfon,

thanks a lot for having considered my request quickly and gently. I am now very happy of the paper and greatly appreciated my experience as an author.

B.

Was this page helpful?
0 / 5 - 0 ratings