Simple RAG Application to Summarize Paragraph Using Local Appsmith + Ollama+ Google Sheet

1. Install Ollama LLM Llama3.2 locally 

   1. Download Ollama from https://ollama.com/download for MacOS
   2. Unzip downloaded file & install it locally 
   3. Open MacBook terminal & types ollama run llama3.2 to Install & Run Llama3.2
   4. Ask any query in terminal it will give the text output for it in terminal
   5. Verify Installation by running ollama list
   6. Verify Ollama running on local host by using http://localhost:11434/ in browser

   

2. Setup google sheet for data source in Appsmith

   1. Appsmith provide the inbuilt integration with Google Sheet
   2. Go to Datasource & Select Google Sheet> Give required permissions & select Sheet
   3. Write Appsmith query to get all Paragraphs available in datasource name it as "getAllParagraphs"

   

    4.  Write Google Sheet query to Update the Paragraph record with generates summary in summary column, name it as "SaveSummary"

   

3. Create Interactive & simple UI on Local Appsmith

   1. Add a Table Widget to display paragraphs from Google Sheets.

      Data binding {{getAllParagraphs.data}}

   2. Add a Text Widget to show the generated summary.

      Data binding: {{ generate_summary.data.response }}

   3. Add a Button Widget to save summary of paragraph

4. Connect Appsmith to Llama3.2

   1. In Appsmith, create a REST API Datasource pointing to the Llama model API.
   2. Use a POST request to send the paragraph for summarization.
   3. Method=> POST
   4. URL: http://host.docker.internal:11434/api/generate

   5. Body=> {
       "model": "llama3.2",
       "prompt": "{{ 'Summarize the paragraph in single line:\n\n' + JSON.stringify(Table1.triggeredRow.Paragraph) }}",
       "stream": false
      } 

   6. Note: When running Appsmith locally using Docker, it runs inside a Docker container, host.docker.internal => ensures that Appsmith inside the Docker container can successfully connect Ollama running on the local machine.
   7. Name this API "generate_summary"

   8. Call API on "Generate" button trigger Action for each rows of Table

      

   Bind the response to the Text Widget to display the summary.

5. Store Summary in Google Sheet

   1. Add a "Save Summary" button in Appsmith.

   2. Use the Google Sheets query to update the row with the generated summary. Name it as "SaveSummary"

      Operation=> UpdateOne

      Update row Object=>

       {
       "rowIndex": {{Table1.triggeredRow.rowIndex}},
          "id": "{{Table1.triggeredRow.ID}}",
       "Paragraph": "{{Table1.triggeredRow.Paragraph}}",
       "Summary": "{{generate_summary.data.response}}"
      } 

   3. Call "SaveSummary" API on "Save Summary" button OnClick event

      {{SaveSummary.run().then(() => {
       showAlert('Paragraph summary saved successfully!', 'success');
       getAllParagraphs.run();
      });}}

      

Conclusion

Additional Resources

• Learn to Connect Appsmith to Llama3 On an M1 Macbook
• Self-hosting Appsmith using Docker