Categories: Technology

Google open-sourced its watermarking tool for AI-generated text

An LLM generates text one token at a time. These tokens can represent a single character, word or part of a phrase. To create a sequence of coherent text, the model predicts the next most likely token to generate. These predictions are based on the preceding words and the probability scores assigned to each potential token.

For example, with the phrase “My favorite tropical fruits are __.” The LLM might start completing the sentence with the tokens “mango,” “lychee,” “papaya,” or “durian,” and each token is given a probability score. When there’s a range of different tokens to choose from, SynthID can adjust the probability score of each predicted token, in cases where it won’t compromise the quality, accuracy and creativity of the output.

This process is repeated throughout the generated text, so a single sentence might contain ten or more adjusted probability scores, and a page could contain hundreds. The final pattern of scores for both the model’s word choices combined with the adjusted probability scores are considered the watermark.

News Today

Share
Published by
News Today

Recent Posts

What to know about Wisconsin and other “blue wall” states

2024-11-06 19:10:04 Polls in Wisconsin closed at 8 p.m. Tuesday, and many voters across the…

5 mins ago

Moreno will defeat Brown in Ohio, CNN projects, in key pickup for GOP

2024-11-06 19:00:03 CNN  —  Republican Bernie Moreno will defeat Democratic Sen. Sherrod Brown, CNN projects,…

15 mins ago

Empty seats become a more common sight at Trump’s final rallies

PITTSBURGH, Pa. -- PITTSBURGH, Pa. (AP) — Donald Trump has spent nearly a decade bragging…

20 mins ago

Republican Bernie Moreno defeats incumbent Sherrod Brown for Ohio U.S. Senate seat • Ohio Capital Journal

2024-11-06 18:50:02 Voters have elected Republican Bernie Moreno to represent Ohio in the U.S. Senate…

25 mins ago

OPEC extends its oil output cuts by one month until the end of December

Saudi Arabia and allied oil producing countries said on Sunday they would postpone a plan…

30 mins ago

Florida voters reject abortion rights amendment ballot measure

2024-11-06 18:40:02 A ballot measure that would have enshrined abortion rights in Florida's Constitution failed…

35 mins ago