You should check out this time-to-event neural network [1].

[1] https://github.com/ragulpr/wtte-rnn