I don't quite understand how prior_box_layer performs backpropagation if it is not implemented
prior_box_layer is only used to generate prior (default) bbox, which is fixed. The location prediction (e.g. *_mbox_loc) is the real prediction (offset on top of prior box), which is backpropagated during training.
I see. In DetectionOutput layer, the fixed prior bbox is required in the loss caculation between predicted bbox and ground truth bbox.
Most helpful comment
prior_box_layer is only used to generate prior (default) bbox, which is fixed. The location prediction (e.g. *_mbox_loc) is the real prediction (offset on top of prior box), which is backpropagated during training.