I think a reasonable initial step towards this ambitious feature is to show annotations correctly on mobile.
Now on the android app, it’s not even possible to view annotation blocks (and their references), both area highlights and text highlights.
See my similar discussion here.