{"id":2014,"date":"2025-02-23T14:27:25","date_gmt":"2025-02-23T05:27:25","guid":{"rendered":"https:\/\/rfsec.ddns.net\/db\/?p=2014"},"modified":"2025-10-26T19:42:15","modified_gmt":"2025-10-26T10:42:15","slug":"llm-rag%e7%92%b0%e5%a2%83%e3%81%ae%e6%a7%8b%e7%af%89","status":"publish","type":"post","link":"https:\/\/rfsec.ddns.net\/db\/?p=2014","title":{"rendered":"LLM\/RAG\u74b0\u5883\u306e\u69cb\u7bc9"},"content":{"rendered":"\n<p><strong>\u5b9f\u884c\u30b9\u30af\u30ea\u30d7\u30c8<\/strong><\/p>\n\n\n\n<p>PS C:\\Users\\mars&gt; docker run -d -p 3000:8080 &#8211;<strong>e RAG_EMBEDDING_ENGINE=ollama -e RAG_EMBEDDING_MODEL=bge-m3:latest<\/strong> &#8211;add-host=host.docker.internal:host-gateway -v open-webui:\/app\/backend\/data &#8211;name open-webui-rag &#8211;restart always ghcr.io\/open-webui\/open-webui:main<\/p>\n\n\n\n<p>PS C:\\Users\\mars&gt;docker run -d -p 3000:8080 <strong>-e RAG_EMBEDDING_ENGINE=ollama -e RAG_EMBEDDING_MODEL=bge-m3:latest<\/strong> <strong>&#8211;gpus all<\/strong> &#8211;add-host=host.docker.internal:host-gateway -v open-webui:\/app\/backend\/data &#8211;name open-webui &#8211;restart always ghcr.io\/open-webui\/open-webui:cuda<\/p>\n\n\n\n<p><strong>\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u8a2d\u5b9a<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u8a2d\u5b9a\u753b\u9762 \u2192 \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\uff08Documents\uff09\u30bb\u30af\u30b7\u30e7\u30f3\u3067\uff1a<\/li>\n\n\n\n<li><code>\u30bb\u30de\u30f3\u30c6\u30a3\u30c3\u30af\u30d9\u30af\u30c8\u30eb\u30a8\u30f3\u30b8\u30f3: Ollama <\/code><\/li>\n\n\n\n<li><code>\u30e2\u30c7\u30eb\u540d: bge-m3:latest <\/code><\/li>\n\n\n\n<li><code>\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba: 1500 <\/code><\/li>\n\n\n\n<li><code>\u30c1\u30e3\u30f3\u30af\u30aa\u30fc\u30d0\u30fc\u30e9\u30c3\u30d7: 100<\/code><\/li>\n\n\n\n<li>\u305d\u306e\u4ed6\u30d1\u30e9\u30e1\u30fc\u30bf\u306f\u30c7\u30d5\u30a9\u30eb\u30c8\u7dad\u6301<a href=\"https:\/\/cuterwrite.top\/en\/p\/integrate-open-webui-ollama-qwen25-local-rag\/\" target=\"_blank\" rel=\"noreferrer noopener\">1<\/a><a href=\"https:\/\/cuterwrite.xlog.app\/integrate-open-webui-ollama-qwen25-local-rag?locale=en\" target=\"_blank\" rel=\"noreferrer noopener\">3<\/a><\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>**\u77e5\u8b58\u30d9\u30fc\u30b9\u4f5c\u6210** <\/strong><\/li>\n\n\n\n<li>1. Workspace \u2192 Knowledge \u2192 [+ Create Knowledge Base]<\/li>\n\n\n\n<li>2. \u540d\u524d\u3068\u7528\u9014\uff08\u4f8b: Assistance\uff09\u3092\u8a2d\u5b9a<\/li>\n\n\n\n<li>3. \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u30d5\u30a1\u30a4\u30eb\uff08PDF\/TXT\/Markdown\uff09\u3092\u30c9\u30e9\u30c3\u30b0&amp;\u30c9\u30ed\u30c3\u30d7\u3067\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9[2][5]<\/li>\n\n\n\n<li><strong>**\u8cea\u554f\u65b9\u6cd5** <\/strong><\/li>\n\n\n\n<li>1. \u65b0\u898f\u30c1\u30e3\u30c3\u30c8\u4f5c\u6210\u6642\u306b\u4f7f\u7528\u3059\u308bLLM\u3092\u9078\u629e\uff08\u4f8b: Qwen2.5\u7cfb\u30e2\u30c7\u30eb\uff09<\/li>\n\n\n\n<li>2. \u30c1\u30e3\u30c3\u30c8\u5165\u529b\u6b04\u306b`#`\u3092\u5165\u529b\u2192\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u6e08\u307f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u9078\u629e <\/li>\n\n\n\n<li>3. \u81ea\u7136\u8a00\u8a9e\u3067\u8cea\u554f\u3092\u5165\u529b[1][5]<\/li>\n<\/ul>\n\n\n\n<p><br><strong>openwab-ui\u306e\u753b\u9762\u306echat control\u30d1\u30e9\u30e1\u30fc\u30bf\u3067\u3001\u8a2d\u5b9a\u3092default\u304b\u3089\u5909\u66f4\u3057\u305f\u65b9\u304c\u826f\u3044\u9805\u76ee\u3068\u5185\u5bb9\u3092\u6559\u3048\u3066<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u63a8\u5968\u3055\u308c\u308b\u5909\u66f4\u4f8b\uff1a<\/h2>\n\n\n\n<p>\u4ee5\u4e0b\u306f\u3001\u4e00\u822c\u7684\u306a\u30e6\u30fc\u30b9\u30b1\u30fc\u30b9\u306b\u304a\u3051\u308b\u4f8b\u3067\u3059\uff1a<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>\u30e6\u30fc\u30b9\u30b1\u30fc\u30b9<\/th><th>Max Tokens<\/th><th>Temperature<\/th><th>Top-p<\/th><th>Repetition Penalty<\/th><\/tr><\/thead><tbody><tr><td>\u77ed\u3044\u6b63\u78ba\u306a\u56de\u7b54<\/td><td>100<\/td><td>0.5<\/td><td>0.8<\/td><td>1.2<\/td><\/tr><tr><td>\u9577\u6587\u3067\u8a73\u7d30\u306a\u8aac\u660e<\/td><td>300<\/td><td>0.7<\/td><td>0.9<\/td><td>1.1<\/td><\/tr><tr><td>\u5275\u9020\u7684\u30fb\u81ea\u7531\u306a\u6587\u7ae0\u751f\u6210<\/td><td>500<\/td><td>1.0<\/td><td>1.0<\/td><td>1.0<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong>Grok<\/strong>\u306b\u554f\u3044\u5408\u308f\u305b\u305f\u7d50\u679c<\/p>\n\n\n\n<p>Open WebUI\u306eRAG\u6a5f\u80fd\u3092\u5229\u7528\u3059\u308b\u5834\u5408\u3001\u91cd\u8981\u306a\u30d1\u30e9\u30e1\u30fc\u30bf\u306a\u3069\u306e\u8981\u7d20\u3068\u3001\u305d\u306e\u8a2d\u5b9a\u5024\u306f\uff1f<\/p>\n\n\n\n<p>Open WebUI\u3067RAG\uff08Retrieval-Augmented Generation\uff09\u6a5f\u80fd\u3092\u5229\u7528\u3059\u308b\u969b\u3001\u52b9\u679c\u7684\u306a\u52d5\u4f5c\u3092\u5b9f\u73fe\u3059\u308b\u305f\u3081\u306b\u306f\u3001\u3044\u304f\u3064\u304b\u306e\u91cd\u8981\u306a\u30d1\u30e9\u30e1\u30fc\u30bf\u3084\u8a2d\u5b9a\u8981\u7d20\u3092\u9069\u5207\u306b\u8abf\u6574\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u4ee5\u4e0b\u306b\u3001\u4e3b\u8981\u306a\u8981\u7d20\u3068\u305d\u306e\u8a2d\u5b9a\u5024\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306fOpen WebUI\u306e\u7ba1\u7406\u8005\u30d1\u30cd\u30eb\uff08\u4f8b: \u300c\u8a2d\u5b9a &gt; \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u300d\u3084\u300c\u30ef\u30fc\u30af\u30b9\u30da\u30fc\u30b9 &gt; \u30e2\u30c7\u30eb\u300d\uff09\u3067\u8abf\u6574\u53ef\u80fd\u306a\u9805\u76ee\u306b\u57fa\u3065\u3044\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">1. <strong>\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb (Embedding Model)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u30d9\u30af\u30c8\u30eb\u5316\u3057\u3001\u691c\u7d22\u6642\u306e\u985e\u4f3c\u5ea6\u8a08\u7b97\u306b\u4f7f\u7528\u3059\u308b\u30e2\u30c7\u30eb\u3002<\/li>\n\n\n\n<li><strong>\u30c7\u30d5\u30a9\u30eb\u30c8<\/strong>: Sentence Transformers\uff08\u4f8b: all-MiniLM-L6-v2\uff09\u3002\u8efd\u91cf\u3060\u304c\u30d1\u30e9\u30e1\u30fc\u30bf\u6570\u304c\u5c11\u306a\u3044\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u9ad8\u7cbe\u5ea6\u3092\u6c42\u3081\u308b\u5834\u5408: <code>nomic-embed-text<\/code>\uff08137M\u30d1\u30e9\u30e1\u30fc\u30bf\uff09\u3084<code>mxbai-embed-large<\/code>\uff08334M\u30d1\u30e9\u30e1\u30fc\u30bf\uff09\u306a\u3069\u3001\u3088\u308a\u5927\u304d\u306a\u30e2\u30c7\u30eb\u3092\u9078\u629e\u3002<\/li>\n\n\n\n<li>\u591a\u8a00\u8a9e\u5bfe\u5fdc\u304c\u5fc5\u8981\u306a\u5834\u5408: <code>bge-m3<\/code>\uff08\u591a\u8a00\u8a9e\u5bfe\u5fdc\u3067\u9ad8\u6027\u80fd\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u30c7\u30d5\u30a9\u30eb\u30c8\u30e2\u30c7\u30eb\u306f\u8efd\u91cf\u3060\u304c\u7cbe\u5ea6\u304c\u4e0d\u8db3\u3059\u308b\u5834\u5408\u304c\u3042\u308b\u305f\u3081\u3001\u7528\u9014\u306b\u5fdc\u3058\u3066\u5909\u66f4\u3092\u691c\u8a0e\u3002\u30e2\u30c7\u30eb\u5909\u66f4\u5f8c\u306f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306e\u518d\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u304c\u5fc5\u8981\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">2. <strong>\u30e2\u30c7\u30eb\u518d\u30e9\u30f3\u30ad\u30f3\u30b0 (Model Reranking)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u691c\u7d22\u7d50\u679c\u306e\u95a2\u9023\u6027\u3092\u518d\u8a55\u4fa1\u3057\u3001\u3088\u308a\u9069\u5207\u306a\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u4e0a\u4f4d\u306b\u914d\u7f6e\u3002<\/li>\n\n\n\n<li><strong>\u30c7\u30d5\u30a9\u30eb\u30c8<\/strong>: \u518d\u30e9\u30f3\u30ad\u30f3\u30b0\u306a\u3057\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u8efd\u91cf\u30e2\u30c7\u30eb: <code>cross-encoder\/ms-marco-MiniLM-L-6-v2<\/code>\uff08\u9ad8\u901f\u3060\u304c\u7cbe\u5ea6\u306f\u4e2d\u7a0b\u5ea6\uff09\u3002<\/li>\n\n\n\n<li>\u9ad8\u7cbe\u5ea6\u30e2\u30c7\u30eb: <code>cross-encoder\/ms-marco-MiniLM-L-12-v2<\/code>\uff08\u3088\u308a\u6b63\u78ba\u3060\u304c\u51e6\u7406\u8ca0\u8377\u304c\u5897\u52a0\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u518d\u30e9\u30f3\u30ad\u30f3\u30b0\u3092\u6709\u52b9\u306b\u3059\u308b\u3068\u56de\u7b54\u306e\u8cea\u304c\u5411\u4e0a\u3059\u308b\u3002\u7279\u306b\u60c5\u5831\u91cf\u304c\u591a\u3044\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u6271\u3046\u5834\u5408\u306b\u6709\u52b9\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">3. <strong>\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba (Chunk Size)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u5206\u5272\u3059\u308b\u30b5\u30a4\u30ba\u3002\u691c\u7d22\u7cbe\u5ea6\u3068\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u30d0\u30e9\u30f3\u30b9\u306b\u5f71\u97ff\u3002<\/li>\n\n\n\n<li><strong>\u30c7\u30d5\u30a9\u30eb\u30c8<\/strong>: 1500\u30c8\u30fc\u30af\u30f3\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u5c0f\u898f\u6a21\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8: 500\u301c1000\u30c8\u30fc\u30af\u30f3\uff08\u7d30\u304b\u3044\u7c92\u5ea6\u3067\u691c\u7d22\u7cbe\u5ea6\u3092\u5411\u4e0a\uff09\u3002<\/li>\n\n\n\n<li>\u5927\u898f\u6a21\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8: 1500\u301c2000\u30c8\u30fc\u30af\u30f3\uff08\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u5e83\u304f\u4fdd\u6301\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u5c0f\u3055\u3059\u304e\u308b\u3068\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u304c\u4e0d\u8db3\u3057\u3001\u5927\u304d\u3059\u304e\u308b\u3068\u30ce\u30a4\u30ba\u304c\u5897\u3048\u308b\u305f\u3081\u3001\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306e\u5185\u5bb9\u306b\u5fdc\u3058\u3066\u8abf\u6574\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">4. <strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u9577\u3055 (Context Length)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: LLM\u304c\u56de\u7b54\u751f\u6210\u6642\u306b\u53c2\u7167\u3059\u308b\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u6700\u5927\u9577\u3002<\/li>\n\n\n\n<li><strong>\u30c7\u30d5\u30a9\u30eb\u30c8<\/strong>: 2048\u30c8\u30fc\u30af\u30f3\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u77ed\u3044\u56de\u7b54: 1024\u301c2048\u30c8\u30fc\u30af\u30f3\u3002<\/li>\n\n\n\n<li>\u8a73\u7d30\u306a\u56de\u7b54: 4096\u30c8\u30fc\u30af\u30f3\uff08\u30e2\u30c7\u30eb\u304c\u5bfe\u5fdc\u3057\u3066\u3044\u308b\u5834\u5408\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u4f7f\u7528\u3059\u308bLLM\u306e\u6700\u5927\u30c8\u30fc\u30af\u30f3\u6570\u306b\u4f9d\u5b58\u3002\u9577\u3059\u304e\u308b\u3068\u51e6\u7406\u901f\u5ea6\u304c\u4f4e\u4e0b\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">5. <strong>\u30c8\u30c3\u30d7K (Top K)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u691c\u7d22\u7d50\u679c\u304b\u3089\u4e0a\u4f4d\u4f55\u4ef6\u306e\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3068\u3057\u3066\u4f7f\u7528\u3059\u308b\u304b\u3002<\/li>\n\n\n\n<li><strong>\u30c7\u30d5\u30a9\u30eb\u30c8<\/strong>: 10\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u9ad8\u7cbe\u5ea6\u91cd\u8996: 3\u301c5\uff08\u95a2\u9023\u6027\u306e\u9ad8\u3044\u3082\u306e\u3060\u3051\u3092\u53b3\u9078\uff09\u3002<\/li>\n\n\n\n<li>\u60c5\u5831\u91cf\u91cd\u8996: 10\u301c15\uff08\u5e45\u5e83\u3044\u60c5\u5831\u3092\u30ab\u30d0\u30fc\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u5024\u304c\u5927\u304d\u3044\u307b\u3069\u591a\u69d8\u306a\u60c5\u5831\u3092\u542b\u3080\u304c\u3001\u30ce\u30a4\u30ba\u3082\u5897\u3048\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">6. <strong>\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306e\u524d\u51e6\u7406<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u691c\u7d22\u7528\u30c7\u30fc\u30bf\u306e\u54c1\u8cea\u3092\u5411\u4e0a\u3055\u305b\u308b\u3002<\/li>\n\n\n\n<li><strong>\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u63a8\u5968\uff08PDF\u3084Word\u306f\u4e8b\u524d\u306b\u30c6\u30ad\u30b9\u30c8\u5909\u63db\uff09\u3002<\/li>\n\n\n\n<li>\u30ce\u30a4\u30ba\u9664\u53bb\uff08\u4f59\u5206\u306a\u7a7a\u767d\u3001\u30bf\u30d6\u3001\u6539\u884c\u306e\u6574\u7406\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: \u524d\u51e6\u7406\u304c\u4e0d\u5341\u5206\u3060\u3068\u691c\u7d22\u7cbe\u5ea6\u304c\u843d\u3061\u308b\u305f\u3081\u3001\u304d\u308c\u3044\u306a\u30c7\u30fc\u30bf\u3092\u7528\u610f\u3059\u308b\u3053\u3068\u304c\u91cd\u8981\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">7. <strong>\u751f\u6210\u30e2\u30c7\u30eb (LLM)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5f79\u5272<\/strong>: \u691c\u7d22\u3055\u308c\u305f\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u3082\u3068\u306b\u56de\u7b54\u3092\u751f\u6210\u3059\u308b\u30e2\u30c7\u30eb\u3002<\/li>\n\n\n\n<li><strong>\u63a8\u5968\u8a2d\u5b9a\u5024<\/strong>:<\/li>\n\n\n\n<li>\u30ed\u30fc\u30ab\u30eb: <code>gemma2:2b<\/code>\uff08\u8efd\u91cf\uff09\u3001<code>ELYZA-japanese-Llama-2-13b<\/code>\uff08\u65e5\u672c\u8a9e\u5bfe\u5fdc\uff09\u3002<\/li>\n\n\n\n<li>API\u7d4c\u7531: <code>gpt-4o-mini<\/code>\uff08\u9ad8\u7cbe\u5ea6\u3060\u304c\u30b3\u30b9\u30c8\u304c\u304b\u304b\u308b\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30dd\u30a4\u30f3\u30c8<\/strong>: RAG\u306e\u52b9\u679c\u306f\u751f\u6210\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u306b\u3082\u4f9d\u5b58\u3002\u30ed\u30fc\u30ab\u30eb\u74b0\u5883\u3067\u306f\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u30b9\u30da\u30c3\u30af\u3092\u8003\u616e\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u8a2d\u5b9a\u306e\u6d41\u308c\uff08\u4f8b\uff09<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u7ba1\u7406\u8005\u30d1\u30cd\u30eb &gt; \u8a2d\u5b9a &gt; \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8<\/strong>\u3067\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3092<code>bge-m3<\/code>\u306b\u5909\u66f4\u3002<\/li>\n\n\n\n<li><strong>\u30e2\u30c7\u30eb\u518d\u30e9\u30f3\u30ad\u30f3\u30b0<\/strong>\u306b<code>cross-encoder\/ms-marco-MiniLM-L-12-v2<\/code>\u3092\u6307\u5b9a\u3002<\/li>\n\n\n\n<li><strong>\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba<\/strong>\u30921000\u3001<strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u9577\u3055<\/strong>\u30922048\u3001<strong>\u30c8\u30c3\u30d7K<\/strong>\u30925\u306b\u8a2d\u5b9a\u3002<\/li>\n\n\n\n<li>\u524d\u51e6\u7406\u6e08\u307f\u306e\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u3092\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u3002<\/li>\n\n\n\n<li><strong>\u30ef\u30fc\u30af\u30b9\u30da\u30fc\u30b9 &gt; \u30e2\u30c7\u30eb<\/strong>\u3067\u751f\u6210\u30e2\u30c7\u30eb\uff08\u4f8b: <code>gemma2:2b<\/code>\uff09\u3092\u9078\u629e\u3057\u3001RAG\u7528\u306b\u30ab\u30b9\u30bf\u30e0\u30e2\u30c7\u30eb\u3092\u4f5c\u6210\u3002<\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u6ce8\u610f\u70b9<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u4f9d\u5b58<\/strong>: \u30ed\u30fc\u30ab\u30eb\u74b0\u5883\u3067\u306fGPU\u3084\u30e1\u30e2\u30ea\u5bb9\u91cf\u304c\u51e6\u7406\u901f\u5ea6\u306b\u5f71\u97ff\u3002<\/li>\n\n\n\n<li><strong>\u518d\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9<\/strong>: \u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb\u3084\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba\u3092\u5909\u66f4\u3057\u305f\u5834\u5408\u3001\u65e2\u5b58\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u524a\u9664\u3057\u3066\u518d\u767b\u9332\u304c\u5fc5\u8981\u3002<\/li>\n\n\n\n<li><strong>\u8a66\u884c\u932f\u8aa4<\/strong>: \u6700\u9069\u306a\u8a2d\u5b9a\u306f\u30c7\u30fc\u30bf\u3084\u7528\u9014\u306b\u3088\u308a\u7570\u306a\u308b\u305f\u3081\u3001\u5b9f\u9a13\u3057\u306a\u304c\u3089\u8abf\u6574\u3059\u308b\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u3053\u308c\u3089\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u9069\u5207\u306b\u8a2d\u5b9a\u3059\u308b\u3053\u3068\u3067\u3001Open WebUI\u306eRAG\u6a5f\u80fd\u3092\u6700\u5927\u9650\u306b\u6d3b\u7528\u3057\u3001\u9ad8\u7cbe\u5ea6\u3067\u6709\u7528\u306a\u56de\u7b54\u3092\u5f97\u3089\u308c\u308b\u74b0\u5883\u3092\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p><strong><font red=\"\">100K\u6587\u5b57\u7a0b\u5ea6\u306e\u30c6\u30ad\u30b9\u30c8\u3092RAG\u3067\u691c\u7d22\u3059\u308b\u3068\u4eee\u5b9a\u3057\u305f\u969b\u306b\u3001\u305d\u308c\u305e\u308c\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u6700\u9069\u5024\u306f<\/font><\/strong>\uff1f<\/p>\n\n\n\n<p>100K\u6587\u5b57\u7a0b\u5ea6\u306e\u30c6\u30ad\u30b9\u30c8\u3092RAG\uff08Retrieval-Augmented Generation\uff09\u3067\u691c\u7d22\u3059\u308b\u5834\u5408\u3001\u30c7\u30fc\u30bf\u91cf\u3068\u3057\u3066\u306f\u4e2d\u898f\u6a21\uff08\u65e5\u672c\u8a9e\u3067\u7d0450K\u301c100K\u30c8\u30fc\u30af\u30f3\u7a0b\u5ea6\u3068\u4eee\u5b9a\uff09\u306b\u8a72\u5f53\u3057\u307e\u3059\u3002\u3053\u306e\u898f\u6a21\u306e\u30c6\u30ad\u30b9\u30c8\u3092\u52b9\u7387\u7684\u304b\u3064\u9ad8\u7cbe\u5ea6\u306b\u51e6\u7406\u3059\u308b\u305f\u3081\u306b\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u8a2d\u5b9a\u306b\u4ee5\u4e0b\u306e\u70b9\u3092\u8003\u616e\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u4ee5\u4e0b\u306b\u3001\u524d\u56de\u306e\u56de\u7b54\u3092\u30d9\u30fc\u30b9\u306b\u5177\u4f53\u7684\u306a\u6700\u9069\u5024\u3092\u63d0\u6848\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u524d\u63d0\u6761\u4ef6<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u30c6\u30ad\u30b9\u30c8\u91cf<\/strong>: 100K\u6587\u5b57\uff08\u65e5\u672c\u8a9e\u306e\u5834\u5408\u3001\u7d0450K\u30c8\u30fc\u30af\u30f3\u3068\u4eee\u5b9a\u3002\u53e5\u8aad\u70b9\u3084\u5358\u8a9e\u306e\u9577\u3055\u306b\u4f9d\u5b58\uff09\u3002<\/li>\n\n\n\n<li><strong>\u76ee\u7684<\/strong>: \u95a2\u9023\u6027\u306e\u9ad8\u3044\u60c5\u5831\u3092\u8fc5\u901f\u306b\u691c\u7d22\u3057\u3001\u6b63\u78ba\u306a\u56de\u7b54\u3092\u751f\u6210\u3002<\/li>\n\n\n\n<li><strong>\u74b0\u5883<\/strong>: \u30ed\u30fc\u30ab\u30eb\uff08GPU\u3042\u308a\uff09\u307e\u305f\u306f\u30af\u30e9\u30a6\u30c9\uff08API\u5229\u7528\uff09\u3092\u60f3\u5b9a\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">1. <strong>\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb (Embedding Model)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>: <code>bge-m3<\/code><\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>100K\u6587\u5b57\u306f\u8907\u6570\u306e\u30c8\u30d4\u30c3\u30af\u3092\u542b\u3080\u53ef\u80fd\u6027\u304c\u9ad8\u304f\u3001\u591a\u8a00\u8a9e\u5bfe\u5fdc\u304b\u3064\u9ad8\u7cbe\u5ea6\u306a\u57cb\u3081\u8fbc\u307f\u304c\u5fc5\u8981\u3002<\/li>\n\n\n\n<li><code>bge-m3<\/code>\u306f\u7d04568M\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6301\u3061\u3001\u65e5\u672c\u8a9e\u3092\u542b\u3080\u591a\u8a00\u8a9e\u3067\u512a\u308c\u305f\u6027\u80fd\u3092\u767a\u63ee\u3002<\/li>\n\n\n\n<li><strong>\u4ee3\u66ff\u6848<\/strong>: \u30ea\u30bd\u30fc\u30b9\u304c\u9650\u3089\u308c\u308b\u5834\u5408\u3001<code>all-MiniLM-L12-v2<\/code>\uff08\u8efd\u91cf\u304b\u3064\u305d\u3053\u305d\u3053\u306e\u7cbe\u5ea6\uff09\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">2. <strong>\u30e2\u30c7\u30eb\u518d\u30e9\u30f3\u30ad\u30f3\u30b0 (Model Reranking)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>: <code>cross-encoder\/ms-marco-MiniLM-L-12-v2<\/code><\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>\u4e2d\u898f\u6a21\u30c6\u30ad\u30b9\u30c8\u3067\u306f\u691c\u7d22\u7d50\u679c\u306b\u30ce\u30a4\u30ba\u304c\u6df7\u3056\u308a\u3084\u3059\u3044\u305f\u3081\u3001\u518d\u30e9\u30f3\u30ad\u30f3\u30b0\u3067\u7cbe\u5ea6\u3092\u5411\u4e0a\u3002<\/li>\n\n\n\n<li><code>L-12-v2<\/code>\u306f\u7cbe\u5ea6\u3068\u901f\u5ea6\u306e\u30d0\u30e9\u30f3\u30b9\u304c\u826f\u304f\u3001100K\u6587\u5b57\u7a0b\u5ea6\u306e\u51e6\u7406\u306b\u9069\u3057\u3066\u3044\u308b\u3002<\/li>\n\n\n\n<li><strong>\u4ee3\u66ff\u6848<\/strong>: \u9ad8\u901f\u51e6\u7406\u512a\u5148\u306a\u3089<code>MiniLM-L-6-v2<\/code>\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">3. <strong>\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba (Chunk Size)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>: 800\u301c1000\u30c8\u30fc\u30af\u30f3<\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>100K\u6587\u5b57\uff08\u7d0450K\u30c8\u30fc\u30af\u30f3\uff09\u309250\u301c60\u30c1\u30e3\u30f3\u30af\u306b\u5206\u5272\u53ef\u80fd\u3002<\/li>\n\n\n\n<li>800\u301c1000\u30c8\u30fc\u30af\u30f3\u306f\u30011\u30c1\u30e3\u30f3\u30af\u3067\u5341\u5206\u306a\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u4fdd\u6301\u3057\u3064\u3064\u3001\u691c\u7d22\u6642\u306e\u30ce\u30a4\u30ba\u3092\u6291\u3048\u308b\u3002<\/li>\n\n\n\n<li><strong>\u88dc\u8db3<\/strong>:<\/li>\n\n\n\n<li>\u65e5\u672c\u8a9e\u306f\u82f1\u8a9e\u3088\u308a\u30c8\u30fc\u30af\u30f3\u6570\u304c\u591a\u304f\u306a\u308a\u304c\u3061\u306a\u306e\u3067\u30011000\u30c8\u30fc\u30af\u30f3\u4ee5\u4e0b\u306b\u6291\u3048\u308b\u306e\u304c\u73fe\u5b9f\u7684\u3002<\/li>\n\n\n\n<li>\u5c0f\u3055\u3059\u304e\u308b\u3068\uff08\u4f8b: 500\u30c8\u30fc\u30af\u30f3\uff09\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u304c\u4e0d\u8db3\u3057\u3001\u5927\u304d\u3059\u304e\u308b\u3068\uff08\u4f8b: 2000\u30c8\u30fc\u30af\u30f3\uff09\u95a2\u9023\u6027\u304c\u8584\u308c\u308b\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">4. <strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u9577\u3055 (Context Length)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>: 2048\u30c8\u30fc\u30af\u30f3<\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>\u691c\u7d22\u7d50\u679c\u304b\u3089\u8907\u6570\u30c1\u30e3\u30f3\u30af\uff08\u4f8b: \u30c8\u30c3\u30d73\u301c5\uff09\u3092\u53c2\u7167\u3059\u308b\u5834\u5408\u3001\u5408\u8a08\u30671500\u301c2000\u30c8\u30fc\u30af\u30f3\u7a0b\u5ea6\u306b\u306a\u308b\u3002<\/li>\n\n\n\n<li>2048\u30c8\u30fc\u30af\u30f3\u306f\u591a\u304f\u306e\u30e2\u30c7\u30eb\uff08\u4f8b: Llama\u7cfb\u3084Gemma\u7cfb\uff09\u304c\u5bfe\u5fdc\u53ef\u80fd\u3067\u3001\u5b9f\u7528\u7684\u306a\u4e0a\u9650\u3002<\/li>\n\n\n\n<li><strong>\u88dc\u8db3<\/strong>: \u9ad8\u6027\u80fd\u30e2\u30c7\u30eb\uff08\u4f8b: GPT-4o, 128K\u30c8\u30fc\u30af\u30f3\u5bfe\u5fdc\uff09\u3092\u4f7f\u3046\u5834\u5408\u30014096\u30c8\u30fc\u30af\u30f3\u3082\u691c\u8a0e\u53ef\u80fd\u3060\u304c\u3001\u30ed\u30fc\u30ab\u30eb\u3067\u306f\u8ca0\u8377\u304c\u5897\u5927\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">5. <strong>\u30c8\u30c3\u30d7K (Top K)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>: 5<\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>100K\u6587\u5b57\u304b\u308950\u301c60\u30c1\u30e3\u30f3\u30af\u304c\u751f\u6210\u3055\u308c\u308b\u3068\u4eee\u5b9a\u3057\u3001\u4e0a\u4f4d5\u4ef6\u3067\u5341\u5206\u306a\u95a2\u9023\u6027\u3092\u78ba\u4fdd\u3002<\/li>\n\n\n\n<li>5\u306f\u7cbe\u5ea6\u3068\u60c5\u5831\u91cf\u306e\u30d0\u30e9\u30f3\u30b9\u304c\u826f\u304f\u3001\u751f\u6210\u6642\u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u904e\u591a\u3092\u9632\u3050\u3002<\/li>\n\n\n\n<li><strong>\u88dc\u8db3<\/strong>: \u5e45\u5e83\u3044\u60c5\u5831\u3092\u6c42\u3081\u308b\u5834\u5408\u300110\u307e\u3067\u5897\u3084\u3057\u3066\u3082\u53ef\u3002\u305f\u3060\u3057\u3001\u30ce\u30a4\u30ba\u304c\u5897\u3048\u308b\u30ea\u30b9\u30af\u3092\u8003\u616e\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">6. <strong>\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306e\u524d\u51e6\u7406<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>:<\/li>\n\n\n\n<li>\u30c6\u30ad\u30b9\u30c8\u3092\u4e8b\u524d\u306b\u6574\u5f62\uff08\u4f59\u5206\u306a\u7a7a\u767d\u3084\u6539\u884c\u3092\u524a\u9664\uff09\u3002<\/li>\n\n\n\n<li>\u6bb5\u843d\u3054\u3068\u306b\u660e\u793a\u7684\u306a\u533a\u5207\u308a\uff08\u4f8b: <code>---<\/code>\uff09\u3092\u633f\u5165\u3002<\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>100K\u6587\u5b57\u306f\u69cb\u9020\u5316\u3055\u308c\u3066\u3044\u306a\u3044\u5834\u5408\u304c\u591a\u304f\u3001\u524d\u51e6\u7406\u3067\u691c\u7d22\u7cbe\u5ea6\u3092\u5411\u4e0a\u3002<\/li>\n\n\n\n<li>\u65e5\u672c\u8a9e\u7279\u6709\u306e\u66d6\u6627\u306a\u53e5\u8aad\u70b9\u3092\u6574\u7406\u3059\u308b\u3053\u3068\u3067\u3001\u30c1\u30e3\u30f3\u30af\u5206\u5272\u304c\u81ea\u7136\u306b\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">7. <strong>\u751f\u6210\u30e2\u30c7\u30eb (LLM)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6700\u9069\u5024<\/strong>:<\/li>\n\n\n\n<li>\u30ed\u30fc\u30ab\u30eb: <code>gemma2:9b<\/code>\uff089B\u30d1\u30e9\u30e1\u30fc\u30bf\u3067\u9ad8\u7cbe\u5ea6\u304b\u3064\u4e2d\u898f\u6a21\u30c7\u30fc\u30bf\u306b\u9069\u5fdc\uff09\u3002<\/li>\n\n\n\n<li>\u30af\u30e9\u30a6\u30c9: <code>gpt-4o-mini<\/code>\uff08\u30b3\u30b9\u30c8\u52b9\u7387\u3068\u6027\u80fd\u306e\u30d0\u30e9\u30f3\u30b9\uff09\u3002<\/li>\n\n\n\n<li><strong>\u7406\u7531<\/strong>:<\/li>\n\n\n\n<li>100K\u6587\u5b57\u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u7406\u89e3\u3057\u3001\u81ea\u7136\u306a\u65e5\u672c\u8a9e\u3067\u56de\u7b54\u3059\u308b\u306b\u306f\u3001\u4e2d\u301c\u5927\u898f\u6a21\u30e2\u30c7\u30eb\u304c\u5fc5\u8981\u3002<\/li>\n\n\n\n<li><code>gemma2:9b<\/code>\u306f\u30ed\u30fc\u30ab\u30eb\u3067\u5b9f\u884c\u53ef\u80fd\u306a\u9ad8\u6027\u80fd\u30e2\u30c7\u30eb\u3001<code>gpt-4o-mini<\/code>\u306fAPI\u5229\u7528\u6642\u306e\u6700\u9069\u89e3\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u5177\u4f53\u7684\u306a\u8a2d\u5b9a\u4f8b<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u57cb\u3081\u8fbc\u307f\u30e2\u30c7\u30eb<\/strong>: <code>bge-m3<\/code><\/li>\n\n\n\n<li><strong>\u518d\u30e9\u30f3\u30ad\u30f3\u30b0<\/strong>: <code>cross-encoder\/ms-marco-MiniLM-L-12-v2<\/code><\/li>\n\n\n\n<li><strong>\u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba<\/strong>: 1000\u30c8\u30fc\u30af\u30f3<\/li>\n\n\n\n<li><strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u9577\u3055<\/strong>: 2048\u30c8\u30fc\u30af\u30f3<\/li>\n\n\n\n<li><strong>\u30c8\u30c3\u30d7K<\/strong>: 5<\/li>\n\n\n\n<li><strong>\u524d\u51e6\u7406<\/strong>: \u6574\u5f62\u6e08\u307f\u30c6\u30ad\u30b9\u30c8\u3001\u6bb5\u843d\u533a\u5207\u308a\u4ed8\u304d<\/li>\n\n\n\n<li><strong>\u751f\u6210\u30e2\u30c7\u30eb<\/strong>: <code>gemma2:9b<\/code>\uff08\u30ed\u30fc\u30ab\u30eb\uff09\u307e\u305f\u306f<code>gpt-4o-mini<\/code>\uff08\u30af\u30e9\u30a6\u30c9\uff09<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u60f3\u5b9a\u3055\u308c\u308b\u52d5\u4f5c<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u30c1\u30e3\u30f3\u30af\u6570<\/strong>: 100K\u6587\u5b57 \u00f7 1000\u30c8\u30fc\u30af\u30f3 \u2248 50\u30c1\u30e3\u30f3\u30af\u3002<\/li>\n\n\n\n<li><strong>\u691c\u7d22\u6642\u9593<\/strong>: \u57cb\u3081\u8fbc\u307f\u751f\u6210\u3068\u518d\u30e9\u30f3\u30ad\u30f3\u30b0\u3067\u6570\u79d2\u301c\u5341\u6570\u79d2\uff08\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u4f9d\u5b58\uff09\u3002<\/li>\n\n\n\n<li><strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u30b5\u30a4\u30ba<\/strong>: \u30c8\u30c3\u30d75 \u00d7 1000\u30c8\u30fc\u30af\u30f3 = \u7d045000\u30c8\u30fc\u30af\u30f3\uff082048\u306b\u5236\u9650\u3055\u308c\u308b\u305f\u3081\u3001\u5b9f\u8cea\u4e0a\u4f4d2\u301c3\u30c1\u30e3\u30f3\u30af\u304c\u4f7f\u7528\u3055\u308c\u308b\uff09\u3002<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u8abf\u6574\u306e\u30dd\u30a4\u30f3\u30c8<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u7cbe\u5ea6\u4e0d\u8db3\u306e\u5834\u5408<\/strong>: \u30c8\u30c3\u30d7K\u30923\u306b\u6e1b\u3089\u3057\u3001\u518d\u30e9\u30f3\u30ad\u30f3\u30b0\u30e2\u30c7\u30eb\u306e\u7cbe\u5ea6\u3092\u4e0a\u3052\u308b\uff08\u4f8b: <code>L-12-v2<\/code> \u2192 <code>Electra<\/code>\uff09\u3002<\/li>\n\n\n\n<li><strong>\u901f\u5ea6\u4e0d\u8db3\u306e\u5834\u5408<\/strong>: \u30c1\u30e3\u30f3\u30af\u30b5\u30a4\u30ba\u30921200\u306b\u5897\u3084\u3057\u3001\u30c1\u30e3\u30f3\u30af\u6570\u3092\u6e1b\u3089\u3059\u3002<\/li>\n\n\n\n<li><strong>\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u4e0d\u8db3\u306e\u5834\u5408<\/strong>: \u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u9577\u30924096\u306b\u62e1\u5f35\uff08\u5bfe\u5fdc\u30e2\u30c7\u30eb\u304c\u5fc5\u8981\uff09\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u3053\u306e\u8a2d\u5b9a\u306a\u3089\u3001100K\u6587\u5b57\u7a0b\u5ea6\u306e\u30c6\u30ad\u30b9\u30c8\u3092RAG\u3067\u52b9\u7387\u7684\u306b\u691c\u7d22\u3057\u3001\u9ad8\u7cbe\u5ea6\u306a\u56de\u7b54\u3092\u751f\u6210\u3067\u304d\u308b\u306f\u305a\u3067\u3059\u3002\u5b9f\u969b\u306e\u30c7\u30fc\u30bf\u3084\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u306b\u5fdc\u3058\u3066\u5fae\u8abf\u6574\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5b9f\u884c\u30b9\u30af\u30ea\u30d7\u30c8 PS C:\\Users\\mars&gt; docker run -d -p 3000:8080 &#8211;e RAG_EMBEDDING_ENGINE=ollama -e RAG_EMBEDDING_ [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[21],"tags":[],"class_list":["post-2014","post","type-post","status-publish","format-standard","hentry","category-llm"],"featured_image_src":null,"author_info":{"display_name":"mars","author_link":"https:\/\/rfsec.ddns.net\/db\/?author=1"},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/posts\/2014","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2014"}],"version-history":[{"count":7,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/posts\/2014\/revisions"}],"predecessor-version":[{"id":2066,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=\/wp\/v2\/posts\/2014\/revisions\/2066"}],"wp:attachment":[{"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2014"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2014"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rfsec.ddns.net\/db\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2014"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}