SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex) - Phase 1 Forum

Go back to competition Back to thread list Post in this thread

> description of the test submission

Dear organizers,

We were wondering where we are actually expected to upload the description of the submission. We are supposed to prepare

"a one-paragraph statement of the methods used to obtain the submitted results, including information regarding the approach and data set(s) used to train your system, the image analysis and segmentation (if applicable) methods used, the type of classifier, and any relevant references for these methods that should be cited."

However, the space that we are given in participate->Submit/View Results seems to be limited to 256 characters. Are you expecting us to stick to this limit or are we looking at a wrong place?

Posted by: nyu_bteam @ Jan. 24, 2021, 8:25 p.m.

Hi, that's a very good question. Obviously 256 characters isn't going to cut it for that purpose. In the past we have collected the additional material differently, so I will check into this issue and we will get back to you.

Posted by: kdrukker @ Jan. 25, 2021, 6:57 p.m.

Hi all,

*NOTE:* PLEASE practice with the validation phase to let us know if this will work.

If you could bare with me as I figure this out, I want to use the new submission view to maybe have the text as input.

Now that I enabled Teams, the submission screen has additional inputs. This forum is not equipped to show images, however I took a screen shot of what I am talking about and uploaded to the "Learn The Details\Evaluation and Output Format" tab. You can find it under text "Test Phase Submission (Added Jan 25th): ". There is a field called method description that allows at least 2471 characters rather than the 256 limit before. There are other fields you can use for citing sources, but if they prove to be clunky then add to the method description.

Please let us know if this seems feasible. The other option is to to include it with your .zip submissions, but I need to write code to handle that. We are wondering if this will work for people and trying it out with the validation phase will let us know if it can effectively capture the length required. If not we will probably extend the deadline just long enough for me to edit a script that will allow you .zip containers to have a .csv and a .doc\.txt with your paragraph.

Posted by: challenge-organizer @ Jan. 25, 2021, 8:09 p.m.

Let me suggest an alternative. In my opinion a much easier one, given the number of participating teams. How about you simply ask to provide this description by email, after the challenge, with some reasonable length limit (e.g. one page)?

We treated this challenge very seriously and put a lot of effort into planning our work (including validation and test submissions) such that we maximize our performance tonight. We are sprinting on the last 100 meters of this run and we can't go on much longer. I am pretty sure most teams feel the same. It would not be fair to extend the deadline in the last minute.

Posted by: nyu_bteam @ Jan. 26, 2021, 1:09 a.m.

Yes, I understand your point. Currently, the deadline remains unchanged.

Posted by: kdrukker @ Jan. 26, 2021, 1:22 a.m.
Post in this thread