As a practicing oncologist myself I concur with just about everything noted in the above two posts. See also some additional considerations in other threads in this forum here and here.
Certainly the limitations of RECIST provide plenty of research opportunities for methodologists. We made a small contribution here and have another one in the pipeline addressing more of the points made above by @sme.