CodeCow/stack
1
0
Fork 0
mirror of https://github.com/stack-auth/stack.git synced 2026-06-13 21:01:21 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Add context to system prompt in AI query route

Browse Source 
This update includes a comment explaining the rationale behind appending the verified QA corpus to the system prompt for each request
This commit is contained in:
Aadesh Kheria 2026-04-27 18:41:53 -07:00
parent 49d2c04c8e
commit 60c538b612
1 changed files with 7 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
apps/backend/src/app/api/latest/ai/query/[mode]/route.ts
View File

@ -63,6 +63,13 @@ export const POST = createSmartRouteHandler({
const isDocsOrSearch = systemPromptId === "docs-ask-ai" || systemPromptId === "command-center-ask-ai";
let systemPrompt = getFullSystemPrompt(systemPromptId);
if (isDocsOrSearch) {
// Stuffing the entire verified QA corpus into the system prompt on every
// request is intentionally naive — it grows monotonically with each new
// QA pair and re-fetches/re-sends content that's mostly unchanged across
// requests. Once the corpus is large enough to matter we should swap to
// an embedding-based retriever (top-k by query similarity) and/or cache
// the assembled context, but for the current corpus size this is fine
// and lets the model see everything
systemPrompt += await getVerifiedQaContext();
}
const tools = await getTools(toolNames, { auth: fullReq.auth, targetProjectId: projectId });