The method, which combines a ChatGPT-like large language model with information about a protein\u2019s 3D shape, could make it easier and faster to develop better medicines for infectious diseases, cancer, and other conditions<\/p>\n
Proteins have evolved to excel at everything from contracting muscles to digesting food to recognizing viruses. To engineer better proteins, including antibodies, scientists often iteratively mutate the amino acids \u2013 the units that are arranged in a sequence to make up proteins \u2013 in different positions until the resulting protein has an improved function, like eliciting a stronger immune response or capturing carbon dioxide from the atmosphere more efficiently.<\/p>\n
But there are more possible amino acid sequences than there are grains of sand in the world. And finding the best protein and, therefore, the best potential drug, is often expensive or impossible.<\/p>\n
Stanford scientists have developed a new machine learning-based method to more quickly and accurately predict the molecular changes that will lead to better antibody drugs. Published in Science on July 4, the approach combines the 3D structure of the protein backbone with large language models based on amino acid sequence, and allows researchers to find, in minutes, rare and desirable mutations that would otherwise only be found with exhaustive experiments.<\/p>\n
Led by Peter S. Kim, professor of biochemistry and institute scholar at Sarafan ChEM-H, and Brian Hie, assistant professor of chemical engineering, the team showed that they could improve a once FDA-approved SARS-CoV-2 antibody that had been discontinued due to its ineffectiveness against a new strain in November 2022. Their approach resulted in a 25-fold improvement against the virus.<\/p>\n
\u201cA lot of effort in AI and drug development is centered around amassing tons of data about how well a certain molecule performs a certain task so that a computer can learn enough to design a better version,\u201d said Kim. \u201cWhat\u2019s remarkable is that we\u2019ve shown that structure can be used in lieu of a lot of that data, and the computer will still learn.\u201d<\/p>\n
\u201cNow, more antibodies actually get a shot at being optimized,\u201d said Hie, who is also an innovation investigator at the Arc Institute.<\/p>\n
Animation showing the 3D structure of a once FDA-approved SARS-CoV-2 antibody (shown in green and orange) bound to a protein that appears on the virus\u2019 surface (shown in white). The new approach allowed the team to identify specific changes to amino acids that make up the antibody (shown as blue and pink spheres) that made the antibody 25 times more effective against the virus. | Varun Shanker<\/p>\n
Bent into shape<\/p>\n
When faced with the challenge of finding the best amino acid sequence, scientists will often make millions and test them in miniaturized, simplified versions of biological systems. They hope that the best drug in a dish will also be the best drug in humans.<\/p>\n
\u201cIt\u2019s a lot of guess and check,\u201d said Hie. \u201cThe goal of a lot of intelligent algorithms is to remove the guesswork from this.\u201d<\/p>\n
To speed up the process, scientists have developed ChatGPT-like machine learning algorithms that are trained on the amino acid sequences of millions of proteins to predict desirable mutations.<\/p>\n
These models, however, often point scientists toward sequences that, once produced in the lab, are unstable or worse than where they started.<\/p>\n
This is partially because protein function depends not only on the sequence of amino acids but also on the 3D structure of that sequence. For example, to trigger an immune response, antibodies must be the right shape to bind to molecules that sit atop the surface of viruses.<\/p>\n
The key, the team thought, to developing a better prediction algorithm was structure. So, they constrained the long list of possible beneficial mutations \u2013 as determined by the sequence-based large language model \u2013 to only those that would preserve the 3D shape of the starting protein.<\/p>\n
Testing ground<\/p>\n
In December 2022, the team put it to the test on a recently discontinued SARS-CoV-2 antibody therapy.<\/p>\n
\u201cThe prevailing theory was that trying to improve this antibody would fail,\u201d said Varun Shanker, a medical student, graduate student in biophysics, and lead author on the study. \u201cThe virus was too smart. It evolved as it spread through millions of people to know exactly how to mutate to avoid these antibodies.\u201d<\/p>\n
Using purely sequence-based models to optimize the protein resulted in a modest twofold increase in effectiveness. But with their structure-guided approach, the team saw a 25-fold increase.<\/p>\n
\u201cWe were finally catching up to the virus,\u201d said Shanker, who is also a fellow in the Chemistry\/Biology Interface Training Program at Sarafan ChEM-H.<\/p>\n
Teaching an old model new tricks<\/p>\n
Most efforts in using AI to build better drugs rely on \u201ctraining\u201d or \u201csupervising\u201d the model, which involves generating huge amounts of data about the function and performance of unique protein sequences. This approach takes a lot of time, and results in a model tailored to specific protein performing a specific task.<\/p>\n
This model does not require any input about what the protein does, how well it does it, or any lab experiments. Because structure is so closely tied to function, the protein\u2019s coordinates become a proxy for performance. For the COVID antibody work, they constrained the structure not just to the antibody itself, but to the antibody when it is bound to the virus. From there, their model \u201clearned\u201d some rules of antibody binding without ever needing to be taught.<\/p>\n
Early experiments show that the approach is generalizable to other kinds of proteins, like enzymes, which help catalyze chemical reactions in our bodies. So far, the researchers have found that the model points scientists to tens of proteins, and, on average, half are better than the starting point.<\/p>\n
This tool could be useful to quickly respond to emerging or evolving diseases. It also lowers the barrier to making more effective medicines. Stronger medicines mean lower doses are necessary, which means that a given quantity could benefit more patients. For infectious diseases like HIV, where studies have shown that large but infrequent doses of an antibody can protect patients from infection, this could be transformational.<\/p>\n
The team is making their model and code freely available to anyone.<\/p>\n
\u201cThis is an exciting example of the power of deep learning to democratize the process of building better proteins,\u201d said Shanker. \u201cThis not only allows people to develop new medicines, but also opens up new areas of scientific exploration that had been inaccessible.\u201d<\/p>\n
The work was supported by the Virginia & D.K. Ludwig Fund for Cancer Research and the Chan Zuckerberg Biohub.<\/p>\n