Hello again,
I would like to share some issues that I faced while running the training script. Note that I have prepared the datasets as explained in the R2D2 repository.
- Mismatch of dimensions during det_loss calculation:
While executing this line I get
RuntimeError: The size of tensor a (64) must match the size of tensor b (65) at non-singleton dimension 1
I solved this by replacing the line 357 as follows:
elif self.detloss in ['ce']:
# det_loss = self.det_loss(pred_score=output["semi"], gt_score=output["gt_semi"], weight=output["weight"],
# stability_map=None)
det_loss = self.det_loss(pred_score=output["semi"], gt_score=output["gt_semi_norm"], weight=output["weight"],
stability_map=None)
I think this error is caused by parsing of wrong values. In inputs, we got
output["gt_semi"].shape = (4,64,64,64) (==gt_score)
output["semi"].shape = (4,65,64,64) (==pred_score)
in output dict we also had
output["gt_semi_norm"] with shape (4,65,64,64)
So i replaced gt_semi with gt_semi_norm which has matching dimensions. I am not sure if this is a valid solution.
- Learning rate decay parameters are not specified. In trainer.py, line 166 the interpreter complains that
self.args.decay_rate and self.args.decay_iter cannot be found. Indeed, they are neither specified in the argparser nor in the config file. The workaround for now is to disable learning rate decay by replacing line 166 with
#lr = min(self.args.lr * self.args.decay_rate ** (self.iteration - self.args.decay_iter), self.args.lr)
lr = self.args.lr
I think this change will prevent us from replicating the results in the paper.
Also, while running the test script test_aachenv_1_1 there are some matters I would like to mention:
- I am not sure whether to use the Aachen dataset that we prepared during the training, or Aachen v1.1 dataset that we can find online (for example, I downloaded it from here, as mentioned in the readme file). Since the datasets might be different, I would like to ask if there are any specific preprocessing steps I should follow to reproduce your results?
- In line 31 of the test script, the file
pairs-db-covis20.txt is missing. I found it here, but since I found this file and the aachen v1.1 database from different sources, I wanted to ask if there is some other source I should download the aachen v1.1 dataset from, maybe a source including this file already?
- We need to specify outputs folder as shown here Does that mean I should first run some other script to do inference and collect the results under some outputs folder I specified?
- Missing file
aachen_db_imglist.txt here. Google search for this file was not successful.
- Missing file
day_night_time_queries_with_intrinsics.txt here. Google search for this file was not successful. The aachen v1.1 dataset I mentioned above only has night_time_queries_with_intrinsics.txt.
Thank you very much and best regards,
Hello again,
I would like to share some issues that I faced while running the training script. Note that I have prepared the datasets as explained in the R2D2 repository.
While executing this line I get
I solved this by replacing the line 357 as follows:
I think this error is caused by parsing of wrong values. In inputs, we got
in output dict we also had
So i replaced
gt_semiwithgt_semi_normwhich has matching dimensions. I am not sure if this is a valid solution.self.args.decay_rateandself.args.decay_itercannot be found. Indeed, they are neither specified in the argparser nor in the config file. The workaround for now is to disable learning rate decay by replacing line 166 withI think this change will prevent us from replicating the results in the paper.
Also, while running the test script
test_aachenv_1_1there are some matters I would like to mention:pairs-db-covis20.txtis missing. I found it here, but since I found this file and the aachen v1.1 database from different sources, I wanted to ask if there is some other source I should download the aachen v1.1 dataset from, maybe a source including this file already?aachen_db_imglist.txthere. Google search for this file was not successful.day_night_time_queries_with_intrinsics.txthere. Google search for this file was not successful. The aachen v1.1 dataset I mentioned above only hasnight_time_queries_with_intrinsics.txt.Thank you very much and best regards,