Forum Moderators: phranque

Message Too Old, No Replies

How Much User Feedback

without divulging my data-science alchemy

         

NickMNS

9:41 pm on Sep 24, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have a form in which the user submits two images. I use data from the two images to determine the authenticity of those images, I use hints from both images to determine if they have been tampered with. I am confident that the system I have developed will provide a reliable result. The question is, should I provide feedback to the user if I have determined that an image has been tampered with? The concern is that a malicious user could keep submitting images until it is accepted, thus diminishing the effectiveness of the system.

Another option, I can simply accept the tampered image, and treat it as such. The assumption here is that if a user has tampered with the image they have done so willfully, providing the user with another chance will either result in them giving up or trying again with anther tampered image. In both cases one is no better off. The risk is that the assumption doesn't hold, maybe my system has provided a false positive, or the user has misunderstood something and given a second they would correct the problem.

So maybe there is a hybrid option, where if the first attempt fails, the user is given one more chance, but then that is it.

A few additional points:
- With this system, once the image is accepted it is then shown to a subsequent user who then validates the contents. The plan is to provide a confidence score, regarding the veracity of the image, if the images is deemed to have been tampered with, then that score would be zero or very close to zero, but ultimately it would be up to the receiver of the image to make the decision to trust it or not.

- The user submitting the images has little incentive to do so. They would be doing this as a courtesy to the receiver. The more cumbersome the system is the more likely that user will be to give-up.

- The hybrid option requires the most work

not2easy

3:06 am on Sep 25, 2021 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



If the procedure is unlikely to allow false positives I might be tempted to let it go with a single effort and treat the result as the result that it returns (pass or fail) without explanation. BUT if there is no do-over for an error it could work the same as a false positive. You would need to be quite certain about the process to offer one chance only without correction as it assumes no mistakes, no errors.

The hybrid option could be worth the extra effort, but I would be guessing at both the stakes and amount of extra effort. It is kind of a balancing act.

NickMNS

3:53 am on Sep 28, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I spent some time testing my algo, it seems to work pretty well in that it is not prone to produce false positives. Legitimate images that are submitted according to the instructions are not being flagged, but it can produce false negatives. I don't think it would take much to figure out how to trick the system either.

I think less is more in this case, I'm going to accept all images and notify the recipient that the images cannot be trusted. In this case it will be evident to a human that an image has been doctored. Regardless, due to the possibility of false negatives the recipient will need to be vigilant even in the case where the images are not flagged.

Also once the system is in production, I will be able to gather more real-world data and then I can develop a more robust system.

csdude55

9:43 pm on Oct 24, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I had a similar debate while rebuilding my profanity filter: do I alert the user and give them a chance to fix it?

In my case, 9 out of 10 of the people trying to post profanity would take the opportunity to add * between characters or something to get around the filter. So instead of making it easier on them (read: harder on me), I opted to just filter it out without explanation.

I just realized, I'm getting sour in my old age :-/

tangor

4:21 am on Oct 26, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I just realized, I'm getting sour in my old age :-/


Or more seasoned and wise?

csdude55

4:24 am on Oct 26, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



LOL Your way sounds better so I'll run with that :-D