Another version of the Polish chatbot – Bielik v2 – has been presented by the SpeakLeash Foundation and the Academic Computer Center Cyfronet AGH. 

It is a Polish model from the LLM (Large Language Models) category, i.e. large language models, with 11 billion parameters. 

Bielik was developed on the basis of the Mistral-7B model and significantly expanded, making it one of the most powerful language models created in Poland. It uses advanced technologies such as SiLU activations, Grouped Query Attention, Sliding Window Attention, KV-Cache / Rolling Buffer KV and Positional Encoding in the form of RoPE (Rotary Position Embedding). 

The new version, thanks to its increased size, allows even better understanding and generation of Polish. The improved training datasets mean more high-quality data, which means improved performance in a variety of tasks. Quantized versions are available for effective use of the model on different hardware platforms. 

Bielik v2 is available for free. It can also be used in commercial applications. It is an open source chatbot and anyone can analyze its code. 

To test Bielik v2 and check all the necessary information, just follow this link https://bielik.ai/