DragonSearch: right-side match results for left-side photo

What Wildbook are you working in? DragonSearch

What is the entire URL out of the browser, exactly where the error occurred?
https://wildbook.dragonsearch.org/iaResults.jsp?taskId=bb05dac4-58a8-4c59-8629-2fe2a88a4671

Can you describe what the issue is you’re experiencing?
For this encounter, match results included right-side images for a left-side image submission.

Can you provide steps on how to reproduce what you’re experiencing?
Reviewing match results at this particular link.

If this is a bulk import report, send the spreadsheet to services@wildme.org with the email subject line matching your bug report

Hello,

I’ve taken a look at this image and the annotations detected on it. Instead of left or right, this
annotation has been detected as a back viewpoint. Like all viewpoints in the system, this annotation will compare against other annotations with the same viewpoint, and neighboring ones like backleft and backright.

This is something that will happen occasionally with the trained model’s margin of error. I’d personally call this a strong backleft, and a detection as such would have it matching against left and back images, but not backright. Since this information is produced by the model, the only way to influence decisions like this is to provide more true examples of back viewpoints, possibly adjust some of the already annotated back and back adjacent viewpoints then retrain the model.

Thanks.

1 Like

Thank you Colin for looking into this and for the explanation! That totally makes sense. However it turns out that Nerida has been having this issue often, with photos that don’t have a back viewpoint. I’m going to try to find some more examples because I know you need those to look into it. Will try to provide those soon! But just wanted to keep you in the loop, as we aren’t sure how much it matters that the system is storing up incorrect matches? Anyway, will be back in touch with more details soon. Thanks!

-Chrissy

Hi Chrissy,

I’d be happy to look at more examples. It’s important to know that viewpoint is still decided by the
model, so any attempt to change the output would need new manually annotated training data including a larger proportion of non-typical viewpoints.

These viewpoint decisions will not influence your other left/right matching at all.

For some background here are the current left/right and back adjacent annotation viewpoints in the database:

back: 39
backright: 413
backleft: 530
right: 2159
left: 2880

These are counts of both head and body annotations. Of the 39 marked back, 21 are seadragon heads.

Hope this information is useful.