Sorry but I don't trust your research just based on yours words and cherry picked images.
Also research is incremental, so producing a proper code on which other can work on top of should be part of the CONTRIBUTION.
80 karma · joined May 10, 2017
Sorry but I don't trust your research just based on yours words and cherry picked images.
Also research is incremental, so producing a proper code on which other can work on top of should be part of the CONTRIBUTION.
Digital Watermarking, you want the "message" to be very robust to transformation. The main usage I know is to help protection against piracy, for example if somebody upload a movie online, you want to put a specific signature related to the location where you sold the movie so you can find the uploader. Eventually the uploader will try to remove the watermarking by either identifying it or by applying some transformation to the movie in hope that it will make the message unrecognizable. So it's a game between industry and the potential tricks that the uploader could apply.
The intersection between the two fields is that they both try to modify the media as little as possible.
The point of view of this work is much more related to watermarking than steganography, as they don't really focus on detectability.
Industries have been using watermarking for a long time, for example to identify video piracy.
Also you are talking about a model which is specifically designed for TPU (the dimensionality of the networks is especially fine-tuned).
And even tho, BERT_large still fit in the memory of a single GPU (for very small batch), there is an implementation on Pytorch. I don't understand, are people complaining that Deep Learning is actually (reasonably) scaling ? Isn't it a good news ?
Modification: There have been repeatedly successful case of transfer learning where you take a pretrained deep neural network and train on a new dataset (even very small).
Vulnerability: you dont need the training dataset to test vulnerabilities, you just either very specific input (that you probably gonna have to create yourself because they are so specific that they are not even in the dataset) or using one input that you corrupt for attacking. And as far as I know it doesn't sound harder than making test for regular algorithms.