Posts

Building a Local RAG System with Ollama and Gemma: A Complete Guide - Part 3

Image
Deploying Your Local RAG System with Chat Memory to Google Cloud Platform Deploying Your Local RAG System with Chat Memory to Google Cloud Platform This is the third installment in our comprehensive series on building and deploying RAG (Retrieval-Augmented Generation) systems. In Part 1 , we built a foundational RAG system using Ollama and Gemma. In Part 2 , we enhanced it with Redis-based chat memory functionality. Now, we’ll take the next crucial step: deploying our memory-enhanced RAG system to Google Cloud Platform (GCP) for production use. Moving from local development to cloud deployment opens up new possibilities for your RAG system. You’ll gain better accessibility, scalability, and the ability to serve multiple users simultaneously while maintaining the same powerful local AI capabilities we’ve built. Why Deploy to Google Cloud Platform? Before diving into the deployment process, let’s understand why GCP is an excellent choice for hosting your RAG ...

Building a Local RAG System with Ollama and Gemma: A Complete Guide - Part 2

Image
Building a Local RAG System with Chat Memory Building a Local RAG System with Chat Memory Using Redis This is a continuation of our comprehensive guide on building a local RAG system with Ollama and Gemma. If you haven’t read Part 1, we recommend starting there to understand the foundational concepts and basic implementation. In our previous article, we successfully built a functional RAG (Retrieval-Augmented Generation) system that could process documents and answer questions based on their content. However, our system had one significant limitation: it couldn’t remember previous conversations or maintain context across multiple interactions. Today, we’ll enhance our RAG system by adding chat memory functionality using Redis, enabling it to maintain conversation history and provide more contextual responses. This upgrade transforms our stateless question-answering system into an intelligent conversational AI that can reference previous exchanges. Why Add Ch...

Building a Local RAG System with Ollama and Gemma: A Complete Guide - Part 1

Image
Building a Local RAG System with Ollama and Gemma: A Complete Guide Retrieval-Augmented Generation (RAG) has revolutionized how we interact with large language models by combining the power of information retrieval with text generation. In this comprehensive guide, we’ll walk through creating a complete RAG system that runs entirely on your local machine using Ollama and the Gemma 2B model. Why Build a Local RAG System? Before diving into the implementation, let’s understand why building a local RAG system is beneficial: Data Privacy : Your sensitive documents never leave your machine Cost Efficiency : No API costs or usage limits Offline Capability : Works without internet connectivity Customization : Full control over the model and parameters Scalability : Process large document collections without external constraints What is RAG? RAG (Retrieval-Augmented Generation) combines two key components: Retrieval System : Searches for relevant...

Getting 500 Internal Server Error after ASP.Net Core Hosting

Image
Getting 500 Internal server error when browsing ASP.NET Core Application in IIS web server. This error occurs because the target server system does not have .NET Core Runtime installed in it. This issue can be resolved by in installing " Hosting Bundle Installer ". which includes Windows Server Hosting and .Net Core Runtime version you are using. You can also install this two components separately. Both of this components are required to run ASP.NET Core Applications on server. You can download " Hosting Bundle Installer " from here . Check here for latest versions. If you need to download .NET runtime only, follow this link .

HOW TO ACCESS MS SQL IN WINDOWS SERVER FROM A REMOTE SQL SERVER MANAGEMENT STUDIO

Image
It is always troublesome to access MS SQL running in windows server from a local system. In this post I am explaining how to do it easily in less time. The main things to be done are: First we need to allow remote access to the sql server we are using.Then set a port to access the sql server through TCP/IP connection. Next step is to create an inbound rule in firewall to accept connection to that port. You can follow the steps given below to do this. 1. Connect with windows server 2. Open sql server management studio. And connect to the sql server instance. 3. Right click on the SQL server instance and select properties. 4. Select "Connections" from side menu. Make sure the "Allow remote connections to this server" Checkbox is selected. then press OK.  5.  Open "SQL server configuration manager" 6. In the side menu expand "SQL server network configuration" 7. Double click on the SQL instance name. 8. Ensure that "Shared memory...