GitHunt
LI

linyao-reevo/search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

Search with Lepton

Build your own conversational search engine using less than 500 lines of code.
Live Demo

Features

  • Built-in support for LLM
  • Built-in support for search engine
  • Customizable pretty UI interface
  • Shareable, cached search results

Setup Search Engine API

There are two default supported search engines: Bing and Google.

To use the Bing Web Search API, please visit this link to obtain your Bing subscription key.

You have two options for Google Search: you can use the Google Search API from Serper or opt for the Programmable Search Engine provided by Google.

Setup LLM and KV

Note

We recommend using the built-in llm and kv functions with Lepton.
Running the following commands to set up them automatically.

pip install -U leptonai && lep login

Build

  1. Set Bing subscription key
export BING_SEARCH_V7_SUBSCRIPTION_KEY=YOUR_BING_SUBSCRIPTION_KEY
  1. Build web
cd web && npm install && npm run build
  1. Run server
BACKEND=BING python search_with_lepton.py

For Google Search using Serper:

export SERPER_SEARCH_API_KEY=YOUR_SERPER_API_KEY
BACKEND=SERPER python search_with_lepton.py

For Google Search using Programmable Search Engine:

export GOOGLE_SEARCH_API_KEY=YOUR_GOOGLE_SEARCH_API_KEY
export GOOGLE_SEARCH_CX=YOUR_GOOGLE_SEARCH_ENGINE_ID
BACKEND=GOOGLE python search_with_lepton.py

Deploy

You can deploy this to Lepton AI with one click:

Deploy with Lepton AI

You can also deploy your own version via

lep photon run -n search-with-lepton-modified -m search_with_lepton.py --env BACKEND=BING --env BING_SEARCH_V7_SUBSCRIPTION_KEY=YOUR_BING_SUBSCRIPTION_KEY

Learn more about lep photon here.

Languages

TypeScript54.1%Python44.0%JavaScript1.1%CSS0.7%

Contributors

Apache License 2.0
Created January 30, 2024
Updated January 30, 2024
linyao-reevo/search_with_lepton | GitHunt