How can ChatGPT help the research?

Ideas and Inspiration
, , , ,
15

I just wanted to add my two pence/two cents worth on ChatGPT and LLMs in general. In my experience they are a good resource for gathering background information and generating draft narratives, but they are unreliable and must be used with caution, particularly in scientific work . I see 4 issues with them:

  1. They often give incomplete responses. For instance, if you ask for a list of all prescription drugs used to treat PD, they will likely miss a few.
  2. They sometimes give incorrect information (this is known as “AI hallucination”). Essentially they are built on probabilistic models drawing from multiple data sources and sometimes this leads to false statements.
  3. They are trained on out-of-date information e.g. GPT 3.5 is trained on data up to January 2022.
  4. They are typically unable or unwilling (I think by design) to give estimates and opinions on things.

So I think they are a useful tool for generating supplementary information and drafting text, but aren’t a substitute for a human who actually understands the topic at hand.

Jodie

As an aside they are great for fun stuff. For example, ask ChatGPT to “Write a summary of the Michael J. Fox Foundation in the style of a US presidential inauguration speech” and you will get things like:

“…Founded by one of America’s most beloved sons, Michael J. Fox, this remarkable institution stands as a beacon of light in the fight against Parkinson’s disease—a scourge that has afflicted millions around the globe. With unwavering resolve and unwavering dedication, the Michael J. Fox Foundation has tirelessly pursued its noble mission: to accelerate breakthroughs in Parkinson’s research and empower those living with the disease to lead lives of dignity and purpose…
As we embark upon this new chapter in our nation’s history, let us draw inspiration from the example set forth by the Michael J. Fox Foundation. Let us stand together in solidarity, united in our determination to conquer Parkinson’s disease once and for all. And let us pledge ourselves to the noble cause of advancing science, fostering empathy, and building a future of boundless possibility for all.” etc.

6 Likes