top | item 41966752

(no title)

rmorey | 1 year ago

I feel similarly about NotebookLM, but have noticed one odd thing - occasionally Host A will be speaking, and suddenly Host B will complete their sentence. And usually when this happens, it's in a way that doesn't make sense, because Host A was just explaining something to or answering a question of Host B.

I'm actually not sure what to make of that, but it's interesting to note

discuss

order

dleeftink|1 year ago

It's speaker diarisation, and depending on the quality of the resulting labelling and speaker end marker tokens, what influences the rhythm of a conversation (Or the input data just has many podcast hosts completing each other's..sandwiches?)

behnamoh|1 year ago

That's the annoying part about NLM. It ruins the illusion of having one person explaining it to the other person.

albert_e|1 year ago

I think this is an important enough quality that betrays that there are no two minds here creating 1+1=3.

One cheap trick to overcome this uncanny valley may be to actually use two separate LLMs or two separate contexts / channels to generate the conversations and take "turns" to generate the followup responses and even interruptions if warranted.

Might mimic a human conversation more closely.

thomashop|1 year ago

Funnily, even two different LLMs, when put in conversation with each other, can end up completing each other's sentence. I guess it has something to do with the sequence prediction training objective.

benmo_atx|1 year ago

Those moments always make me think they’re going for a scripted conversation style where the “learner” is picking up the thread too quickly and interjecting their epiphany inline for the benefit of the listener.