Prompt AI Mannequin Tuning: Leveraging HNSW Vector with Firebase Genkit for Retrieval-Augmented Technology | by Surahutomo Aziz Pradana | Might, 2024

Now let’s apply to be taught extra how we are able to construct such an AI Answer!

Conditions

Earlier than putting in the plugin, guarantee you might have the next put in:

• Node.js (model 12 or larger)
• npm (comes with Node.js)
• TypeScript (set up globally by way of npm: npm set up -g typescript)
• Genkit (set up globally by way of npm: npm set up -g genkit)

Very first thing first, provoke the Genkit venture with

genkit init

comply with the directions right here.

Upon getting the Genkit venture put in, ensure the venture is effectively ready. You’ll be able to strive first by

genkit begin

If it runs effectively and open the Genkit UI in a browser, then you might be good to go!

Putting in the HNSW plugin

To put in the Genkit HNSW plugin, run the next command:

npm set up genkitx-hnsw

We can be utilizing 2 Genkit Plugins right here.

1. HNSW Indexer plugin
2. HNSW Retriever plugin

1. HNSW Indexer Plugin

The HNSW Indexer plugin helps create a vector index out of your information, which can be utilized as a information reference for the HNSW Retriever.

Knowledge Preparation

Put together your information or paperwork, as an illustration, restaurant information, in a devoted folder.

Registering the HNSW Indexer Plugin

Import the plugin into your Genkit venture:

discover genkit.config.ts file in your venture, normally /root/src/genkit.config.ts.

Then import the plugin into the file.

import { hnswIndexer } from "genkitx-hnsw";

// 
export default configureGenkit({
plugins: [
hnswIndexer({ apiKey: "GOOGLE_API_KEY" })
]
});

Operating the Indexer

1. Open the Genkit UI and choose the registered HNSW Indexer plugin.
2. Execute the circulation with the required parameters:

• dataPath: Path to your information and paperwork.
• indexOutputPath: Desired output path for the generated vector retailer index.

Vector Retailer Index Consequence

The HNSW vector retailer can be saved within the specified output path, prepared to be used with the HNSW Retriever plugin.

The HNSW Retriever plugin processes immediate with the Gemini LLM Mannequin, enriched with extra particular data from the HNSW Vector index.

Registering the HNSW Retriever Plugin

Import the required plugins into your Genkit venture:

import { googleAI } from "@genkit-ai/googleai";
import { hnswRetriever } from "genkitx-hnsw";

export default configureGenkit({
plugins: [
googleAI(),
hnswRetriever({ apiKey: "GOOGLE_API_KEY" })
]
});

Operating the Retriever

1. Open the Genkit UI and choose the HNSW Retriever plugin.
2. Execute the circulation with the required parameters:

• immediate: Your enter question is for the AI.
• indexPath: Path to the vector index file generated by the HNSW Indexer plugin.

Instance Immediate

To ask concerning the worth record of a restaurant in Surabaya Metropolis:

immediate: "What's the worth record of my restaurant in Surabaya Metropolis?"
indexPath: "/path/to/your/vector/index"

The mixing of HNSW Vector index with Genkit considerably enhances the capabilities of Generative AI fashions by offering enriched context and particular information.

This strategy not solely improves the accuracy of AI responses but additionally simplifies the method of information integration, making it a strong software for numerous purposes.

By following the steps outlined on this article, you may successfully leverage the HNSW Vector index to construct extra clever and context-aware AI methods in a really brief time like immediately!

Hope this helps and see you within the subsequent one!