Alibaba announces patents related to generative language models.

According to the QiChaCha APP, recently, Alibaba Limited has applied for a patent for "generative language model and training method, device, electronic equipment, storage medium". The patent abstract shows that this application provides a generative language model, including: setting up N semantic nodes and a text generation module, each semantic node having a designated role, where: the initial semantic node positioned at the starting position receives target prompt words provided by the user, generates semantic content related to its designated role; the middle semantic node positioned in the middle receives semantic outputs of preceding semantic nodes according to its designated role, and generates semantic content related to its designated role; the endgame semantic node positioned at the end receives semantic outputs of preceding nodes, generates semantic form of target guidance information; the text generation module outputs target semantic response based on the target prompt words and guided by the target guidance information. This application largely solves the interpretability problem of generative language models, which is of great significance for applying generative language models in situations with high demands for information accuracy.