🔬 Training Transformers to solve 95% failure rate of Cancer Trials — Ron Alfa & Daniel Bear, Noetik

“you only really see the benefits of using larger models when you're looking at longer context lengths. And here, longer context really means, again, like you're seeing more tissue at once, more area at once.”

“it doesn't follow that, like, any data set is a machine learning data set. It doesn't follow that that data set is going to solve the problem you're trying to solve.”

“my bet is that the same is going to be true for these models too is that, like, by modeling sort of at the level of functional tissue where you have a bunch of cells interacting in, like, a disease context that that's going to get you to the problem of predicting kind of the patient-level behavior much faster than trying to first model a cell and then stitch a bunch of those cells together.”