Automatic text summarization is one of the mentionable research areas of natural language processing. The amount of data is increasing rapidly, and the necessity of understanding the gist of any text is just a mandatory tool, nowadays. The area of text summarization has been developing since many years. Mentionable research has been already done through extractive summarization approach; in other side, abstractive summarization approach is the way to summarize any text as like human. Machine will be able to provide a new type of summarization, where the understanding of given summary may found as like as human-generated summary. Several research developments have already been done for abstractive summarization in English language. This paper shows a necessary method—“text generation” in context of Bengali abstractive text summarization development. Text generation helps the machine to understand the pattern of human-written text and then produce the output as is human-written text. A basis recurrent neural network (RNN) has been applied for this text generation approach. The most applicable and successful RNN—long short-term memory (LSTM)—has been applied. Contextual tokens have been used for the better sequence prediction. The proposed method has been developed in the context of making it useable for further development of abstractive text summarization.