An LLM generates text one token at a time. These tokens can represent a single character, word or part of a phrase. To create a sequence of coherent text, the model predicts the next most likely token to generate. These predictions are based on the preceding words and the probability scores assigned to each potential token.
For example, with the phrase “My favorite tropical fruits are __.” The LLM might start completing the sentence with the tokens “mango,” “lychee,” “papaya,” or “durian,” and each token is given a probability score. When there’s a range of different tokens to choose from, SynthID can adjust the probability score of each predicted token, in cases where it won’t compromise the quality, accuracy and creativity of the output.
This process is repeated throughout the generated text, so a single sentence might contain ten or more adjusted probability scores, and a page could contain hundreds. The final pattern of scores for both the model’s word choices combined with the adjusted probability scores are considered the watermark.
2024-11-06 19:10:04 Polls in Wisconsin closed at 8 p.m. Tuesday, and many voters across the…
2024-11-06 19:00:03 CNN — Republican Bernie Moreno will defeat Democratic Sen. Sherrod Brown, CNN projects,…
PITTSBURGH, Pa. -- PITTSBURGH, Pa. (AP) — Donald Trump has spent nearly a decade bragging…
2024-11-06 18:50:02 Voters have elected Republican Bernie Moreno to represent Ohio in the U.S. Senate…
Saudi Arabia and allied oil producing countries said on Sunday they would postpone a plan…
2024-11-06 18:40:02 A ballot measure that would have enshrined abortion rights in Florida's Constitution failed…