check failed: error == cudaSuccess(29 vs. 0) driver shutting down

[samylee]

Hi @zeakey ,
Thank you very much for your code to give me a lot of help, but when I train your datasets of sk506, I got initial loss around 10000, is that normal? And second question is when I use the program of demo.py, the caffemodel is sk506_it14k.caffemodel, I got error is "cudasuccess(29 vs. 0) driver shutting down"? Have you ever met before? And I put the question on google, the answer told me to check the BVLC/caffe#2016. How should I do to solve the problem? Any advice would be helpful to me.
Thanks!!!

Samylee

[zeakey]

Hi @samylee ,

1. I think this initial loss is normal, you can keep watching whther the trend is decreasing;

2. I suggest you to use demo.ipynb, or results.py instead.

[samylee]

Hi @zeakey ,
Thank you very much for your quick reply.
When I use results.py, it works for me. The result images can be saved in result/sk506/9k, but the error of "cudasuccess(29 vs. 0)" still exist when the program is done. How can I do to solve this issue?
Thanks again for you kind help.

Samylee

[zeakey]

@samylee
Yeah, I also suffered from this error, I just ignore it ...

[samylee]

@zeakey
Haha, OK~
Thank you very much for your quick reply. ^_^

[samylee]

Hi @zeakey ,
Sorry to bother you again. I want to train my own datasets, but I don't have the tools to make labels(edge and symmetry). So could you please provide me with a tool for making labels, if it is convenient to you? My emaill address is [email protected].
Thank you very much!!!

Samylee

[jie3377]

@samylee hello, i meet the same question about making labels,did you solve the question?