Only 30 lines Create a Simple ChatBot with Gemini Pro API and Streamlit

In this post, I will introduce how to create a simple chat bot with Gemini Pro API and Streamlit

Requirements

• python 3.9+
• API Key
  https://makersuite.google.com/app/apikey
• google-generativeai
  https://pypi.org/project/google-generativeai/
• Streamlit
  https://streamlit.io/
• Hugging Face account (if you want to host the app)
  https://huggingface.co/

1. Install packages

First, we will need to install packages that I mentioned in the requirements. Please make sure your python version is 3.9+.

pip install streamlit google-generativeai

2. Write a script

app.py

import os
import streamlit as st
import google.generativeai as genai

try:
    gemini_api_key = os.environ['GOOGLE_GEMINI_KEY']
    genai.configure(api_key=gemini_api_key)
    model = genai.GenerativeModel('gemini-pro')

    if "chat" not in st.session_state:
      st.session_state.chat = model.start_chat(history=[])
    st.title('Gemini Pro Test')

    def role_to_streamlit(role: str) -> str:
      if role == 'model':
        return 'assistant'
      else:
        return role

    for message in st.session_state.chat.history:
      with st.chat_message(role_to_streamlit(message.role)):
        st.markdown(message.parts[0].text)

    if prompt := st.chat_input("I possess a well of knowledge. What would you like to know?"):
      st.chat_message("user").markdown(prompt)
      response = st.session_state.chat.send_message(prompt)
      with st.chat_message("assistant"):
        st.markdown(response.text)
except Exception as e:
    st.error(f'An error occurred: {e}')

Now we can try a chat bot.

streamlit run app.py

3. Optional Push code to the Hugging Face Space

Go to https://huggingface.co/spaces and Create new Space.

Please make sure you select Streamlit when you create a new space.

After creating a new space, you will need to clone the repository for your space.

Then add app.py you created to your local repository. Hugging Face Space has installed Streamlit for you alread. But it won’t install any packages. We will need to tell packages we need for the application to the space. For doing that we need to create requirements.txt.

But it’s only one line since iois built-in package and is already installed by Hugging Face. We only need to install google-generatifveai.

requirements.txt

google-generativeai

Then you just need to push your change to Hugging Face space repo. This may take a few minutes. Then access your app.