Understanding the atomistic resolution changes during the self-assembly of amyloid peptides or proteins is important to develop compounds or conditions to alter the aggregation pathways and suppress the toxicity and potentially aid in the development of drugs. However, the complexity of protein aggregation and the transient order/disorder of oligomers along the pathways to fibril are very challenging. In this Perspective, we discuss computational studies of amyloid polypeptides carried out under various conditions, including conditions closely mimicking in vivo and point out the challenges in obtaining physiologically relevant results, focusing mainly on the amyloid-beta Aβ peptides.