Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by derbOac on Friday August 25, 2023 @11:36AM
(#37262909)
So to be clear, it's good to see this kind of corpus/dataset.
Just from professional experience, the way patients (and providers) approach discussion of issues is really different from the wiki/faq type-text. It tends to be much more idiosyncratic, sometimes indirect because patients don't recognize patterns, and is more "raw" and unfiltered.
The privacy issues are huge to be sure though. I have done some related research on natural language modeling and understand it's difficult or impossible to separate out the identifying information from the rest of it, and gets worse as an information problem as size increases.
I just personally might refer to the nature of this type of language dataset differently. I'm not sure what the right way of referring to it is though. I might just drop "conversational" or substitute "question" or "information" or something like that. I suppose in the end it doesn't matter much though — people will figure out what it is.
Just from professional experience, the way patients (and providers) approach discussion of issues is really different from the wiki/faq type-text. It tends to be much more idiosyncratic, sometimes indirect because patients don't recognize patterns, and is more "raw" and unfiltered.
The privacy issues are huge to be sure though. I have done some related research on natural language modeling and understand it's difficult or impossible to separate out the identifying information from the rest of it, and gets worse as an information problem as size increases.
I just personally might refer to the nature of this type of language dataset differently. I'm not sure what the right way of referring to it is though. I might just drop "conversational" or substitute "question" or "information" or something like that. I suppose in the end it doesn't matter much though — people will figure out what it is.