Splashtop ã§ãšã³ã¿ãŒãã©ã€ãºãžã§ãã¬ãŒãã£ã AI ãžã®å®å šãªã¢ã¯ã»ã¹ãå®çŸ
ChatGPTãã¯ãããšãããžã§ãã¬ãŒãã£ãAIã®äººæ°ã®é«ãŸãã¯ãäŒæ¥ã瀟äŒã®å€é©æã®å§ãŸãã瀺ããŠããŸããAIãšæ©æ¢°åŠç¿(ML)ã¯ã以åããããžãã¹äŸ¡å€ãé«ããŠããŸããããå€§èŠæš¡èšèªã¢ãã«(LLM)ãå«ãçæAIã®çªç¶ã®åºçŸã«ããããã¹ãŠã®æ¥çã«å€åã®æ³¢ãæŒãå¯ããŠããŸãã
Open AIã®ChatGPTããAnthropicã®ClaudeãGoogleã®BardãMicrosoft Bing AIãŸã§ããžã§ãã¬ãŒãã£ãAIåéã§ã®SaaSãµãŒãã¹ã®æ¥å¢ã«äŒŽããããããèŠæš¡ã®äŒæ¥ããããã®æ°èãµãŒãã¹ã®å©çšã管çããã¬ã€ãã©ã€ã³ãšããªã·ãŒã®ç¢ºç«ãæ¥ãã§ããŸããåæã«ããã®åŒ·åã§ãããªããæ°çã®ãã¯ãããžãŒã®åœ±é¿ãã€ãŸããå人æ å ±ã®æŒæŽ©ãªã¹ã¯ã軜æžããç¥ç財ç£ãä¿è·ããæœåšçãªèª€æ å ±ãæå®³ãªã³ã³ãã³ãã«å¯ŸåŠããæå³ããªãèäœæš©äŸµå®³ãåé¿ããæ¹æ³ã«ãåãçµãã§ããŸãã
ãã®æ¥éã«é²åããç¶æ³ã«ãããŠãçµç¹ã«ãšã£ãŠç¹ã«å·®ãè¿«ã£ãåé¡ãšããŠæµ®äžããŠããã®ã¯ããžã§ãã¬ãŒãã£ãAIã§ãã©ã€ããŒãããŒã¿ãå®å šã確å®ã广çã«äœ¿çšããæ¹æ³ã§ãããŸãã«ãã®é åã§ãæè¿å°å ¥ããã Splashtop Secure Workspace ãã©ãããã©ãŒã ããæäŒãããŸãã
äŒæ¥åãã®ãã©ã€ããŒãAIã¢ãã«
確ãã«ãåçšã®ãžã§ãã¬ãŒãã£ãAI SaaSãµãŒãã¹ã®äžã«ã¯ãå ¬éã¢ãã«ã®æ¹åã«æåºãããããŒã¿ã䜿çšããªãããšãèªçŽããŠãããã®ããããŸãããããããã¹ãŠã®äŒæ¥ããèªåãã¡ãã»ãšãã©å¶åŸ¡ã§ããªãã¯ã©ãŠããµãŒãã¹ã«å人ããŒã¿ãéä¿¡ããããšã«æµæããªãããã§ã¯ãããŸãããäžéšã®çµç¹ã¯ãä»ã®å°åãŸãã¯åœã§ãã¹ããããŠãããµãŒãã¹ã®äœ¿çšã劚ãã䞻暩ãšèŠå¶ã³ã³ãã©ã€ã¢ã³ã¹ã®å¯Ÿè±¡ãšãªãå ŽåããããŸãã
ãã©ã€ããŒãAIã¢ãã«ã®æ©æµãåããä»ã®äŒæ¥ã¯ãç¬èªã®LLMã¢ãã«ããŒããããã¬ãŒãã³ã°ããããžãã¹ããŒãºãããäŒæ¥ããŸãã¯ã«ã¹ã¿ããŒãµããŒãã財åã¢ããã€ã¶ãªãŒãªã©ã®ç¹å®ã®ã¿ã¹ã¯çšã«äºåã«ãã¬ãŒãã³ã°ãããããŒã¿æ¡åŒµãšæé©åãããLLMã¢ãã«ãä¿è·ããå¿ èŠãããäŒæ¥ã§ãã
ç¬èªã®ãã©ã€ããŒãçæAIããã³MLOpsã€ã³ãã©ã¹ãã©ã¯ãã£ãæ§ç¯ããäŒæ¥ã¯ããªã³ãã¬ãã¹ã§ããããšãã©ã€ããŒãã¯ã©ãŠãã§ããããšããããã®ããŒã«ã®ãã¯ãŒãç¬èªã®ITå¶åŸ¡äžã«çœ®ãããšãã§ããããžãã¹ããŒãºãã³ã³ãã©ã€ã¢ã³ã¹ãããã³äž»æš©ã®èŠä»¶ã«åãããããšãã§ããŸãããã®èšå®ã«ãããLLM ãžã®ã¯ãšãªã®ãã¬ãŒãã³ã°ã埮調æŽããŸãã¯æ¡åŒµã«äœ¿çšãããæ©å¯ããŒã¿ãå€éšã«å ¬éãããã®ãé²ãããšãã§ããŸãã
å€§èŠæš¡ãªèšèªã¢ãã«ãå«ããã©ã€ããŒãã¢ããªã±ãŒã·ã§ã³ãžã®ã¢ã¯ã»ã¹ã®ä¿è·
ãã©ã€ããŒããªã»ããã¢ããã«ãä¿è·ãå¿ èŠã§ããèšèªã¢ãã«ãããµããŒãããããŒã¿ããŒã¹ããã©ã€ããŒãããŒã¿ãªããžããªãŸã§ãæ©æ¢°åŠç¿ã®éçšãã€ãã©ã€ã³ã®ãã¹ãŠã«ãå®å šãªããããžã§ãã³ã°ãã¢ã¯ã»ã¹ã管çãå¿ èŠã§ãã
ããã§ãSplashtop Secure Workspace ã®åºçªã§ããç§ãã¡ã¯ããã©ã€ããŒãLLMãå«ããããããã©ã€ããŒããšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ãžã®ã¢ã¯ã»ã¹ãå¶åŸ¡ããããã®ã·ã³ãã«ã§ãããªããå®å šãªæ¹æ³ãæäŸããŸãããšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ãWebããŒã¹ã®ã€ã³ã¿ãŒãã§ãŒã¹ãæäŸããå Žåã§ããã«ã¹ã¿ã ã®ãã¹ã¯ããããŸãã¯ã¢ãã€ã«ã¢ããªã±ãŒã·ã§ã³ãå¿ èŠãªå Žåã§ããåœç€Ÿã®ãã©ãããã©ãŒã ã¯ããããã¯ãŒã¯ãµãŒãã¹ããŒããå€éšã«å ¬éãããããã¡ã€ã¢ãŠã©ãŒã«ãèŠå¡ãã¹ããVPNãªã©ã®è€éãªãããã¯ãŒã¯èšå®ãå¿ èŠãšããã«ãä»»æã®ã¯ã©ã€ã¢ã³ãããã€ã¹ãããã©ãã§ãããã¹ãŠããå®å šãªã¢ã¯ã»ã¹ãå¯èœã«ããŸãã
ãã¹ãŠã®ã¬ãã«ã§ã¢ã¯ã»ã¹ãä¿è·
Splashtop Secure Workspace ã¯ãLLM ãå«ããããããã©ã€ããŒããšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ãžã®ã¢ã¯ã»ã¹ãå¶åŸ¡ããããã®è±å¯ãªãªãã·ã§ã³ã»ããããµããŒãããŠããŸããäž»ãªæ©èœã¯æ¬¡ã®ãšããã§ãã
- ã·ã³ã°ã«ãµã€ã³ãªã³(SSO)çµ±å â äžè¬çãªIDãããã€ããŒ(GoogleãMicrosoftãOktaãªã©)ãšåæããŸã
- å€èŠçŽ èªèšŒ(MFA) â ãã©ã€ããŒããšã³ã¿ãŒãã©ã€ãºLLMã®ãã£ããã€ã³ã¿ãŒãã§ã€ã¹ãå«ããSSO察å¿ã®ãã¹ãŠã®ãšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ã§ãããã³ããšã³ããŠãŒã¶ãŒãšããã¯ãšã³ããŠãŒã¶ãŒã®äž¡æ¹ã«å¯ŸããŠåŒ·åãªèªèšŒå¶åŸ¡ãå¯èœã«ããŸãã
- æ¡ä»¶ä»ãã¢ã¯ã»ã¹å¶åŸ¡ â ãžãªãã±ãŒã·ã§ã³ãäŒæ¥æ¯çµŠã®ã©ãããããã®äœ¿çšãªã©ãäž»èŠãªã³ã³ãã©ã€ã¢ã³ã¹ãšã»ãã¥ãªãã£åºæºã確èªããããšã§ãã¢ããªã±ãŒã·ã§ã³ãžã®ã¢ã¯ã»ã¹ãå¶éããŸããããšãã°ãããŒã¿äž»æš©ã«ãŒã«ãé å®ããŠããçµç¹ã¯ãåŸæ¥å¡ãæµ·å€ã«æ è¡ããŠãããšãã«ãã©ã€ããŒãLLMãžã®ã¢ã¯ã»ã¹ããããã¯ãããå ŽåããããŸãã
- å§ä»»ãããå¶åŸ¡ ã«ããç¹æš©ã¢ã¯ã»ã¹ â Splashtop ã¯ããšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ã®éèŠãªãµãã·ã¹ãã ãšããŒã¿ã管çããããã«æå®ãããç¹æš©ã¢ã«ãŠã³ããŸãã¯ãµãŒãã¹ã¢ã«ãŠã³ããå®å šã«å§ä»»ããããšã§ãã¢ã¯ã»ã¹ãå¶åŸ¡ã§ããŸããLLM ã®å Žåãããã«ãããæ©å¯æ§ã®é«ãèªèšŒæ å ±ã«äžå¿ èŠã«ãããããããšãªããã¢ãã«èªäœããã¯ãã« ããŒã¿ããŒã¹ãŸãã¯ã°ã©ã ããŒã¿ããŒã¹ãéæ§é åããŒã¿ ãªããžããªããŸã㯠ML ãã€ãã©ã€ã³ãžã®ã¢ã¯ã»ã¹ãå¶åŸ¡ããã³è¿œè·¡ã§ããŸãã
- å®å šãªãµãŒãããŒãã£ã¢ã¯ã»ã¹ â åœç€Ÿã®ãã©ãããã©ãŒã ã¯ããšã³ã¿ãŒãã©ã€ãºã¢ããªã±ãŒã·ã§ã³ãžã®äžæçãªã¢ã¯ã»ã¹ãå¿ èŠãšããå¯èœæ§ã®ãããµãŒãããŒãã£ãšã®å®å šãªã¢ã¯ã»ã¹å ±æãæäŸããŸããããã«ã¯ããªã³ãµã€ãã®ãã©ãã«ã·ã¥ãŒãã£ã³ã°ã®ããã«å®å šãªã¢ã¯ã»ã¹ãå¿ èŠãšãããã©ã€ããŒãLLMãœãªã¥ãŒã·ã§ã³ãããã€ããŒãå«ãŸããå¯èœæ§ããããŸããSecure Workspaceã¯ãç£æ»ãšã³ã³ãã©ã€ã¢ã³ã¹ã®ç®çã§ã»ãã·ã§ã³ãå®å šã«èšé²ããªããã䟿å©ãªã¢ã¯ã»ã¹ãå¯èœã«ããŸãã
- ãŒããã©ã¹ããããã¯ãŒã¯ã¢ã¯ã»ã¹(ZTNA) âãããã¯ãŒã¯ãµããããå šäœãžã®å®å šãªã¢ã¯ã»ã¹ãèš±å¯ããåŸæ¥ã®VPNãšã¯å¯Ÿç §çã«ãSplashtop Secure Workspaceã®ZTNAã¢ãããŒãã¯ãæ¿èªããããªãœãŒã¹ãžã®ãã³ãã€ã³ãã¢ã¯ã»ã¹ãèš±å¯ããæ»æå¯Ÿè±¡é åãæå°éã«æããŸãããdefault-denyãã¢ãããŒãã¯ããšã³ã¿ãŒãã©ã€ãºLLMãæ©å¯æ§ã®é«ãããŒã¿ãåŠçããå Žåã«å®å¿æãæäŸããŸãã
- APIäž»å°ã®èªåå â èªååãšDevOpsã¯ãŒã¯ãããŒã«åãçµãäŒæ¥ã¯ãSecure Workspaceãã©ãããã©ãŒã ãç·å¯ã«çµ±åããã³èªååããèœåãé«ãè©äŸ¡ããã§ãããããžã§ãã¬ãŒãã£ã AI ã®ã³ã³ããã¹ãå ã§ã¯ãSplashtop Secure Workspace ã¯ãããã MLOps ãã€ãã©ã€ã³ã«ã·ãŒã ã¬ã¹ã«é©åããäž»èŠãªãªãœãŒã¹ãžã®ã¢ã¯ã»ã¹ã®èªåããããžã§ãã³ã°ãš Secure Workspace ãã©ãããã©ãŒã èªäœã®èªåèšå®ãä¿é²ããçç£æ§ãæå€§åãã人çºçãšã©ãŒãæžãããŸãã
次ã«ãSecure Workspaceã䜿çšããŠãšã³ã¿ãŒãã©ã€ãºãžã§ãã¬ãŒãã£ãAIãžã®å®å šãªã¢ã¯ã»ã¹ãå®çŸããæ¹æ³ã瀺ããŸãããããŠããããé²ããããã«ãããªãã ãã®ãã©ã€ããŒããªLLMããŒã¹ã®ãã£ããããããã€ãŸãèªåã ãã®ChatGPTãæã«å ¥ããããšã«ãªããŸãã
ãã©ã€ããŒãLLMãã£ããããããäœæããããã®å®è·µã¬ã€ã
LLMãã£ããããããæ§ç¯ãããšããæŠå¿µã¯ãè€éãªäœæ¥ã®ããã«èããããããããŸãããããããçŸå®ã«ã¯ãããã¯ããªããæã£ãŠãããããç°¡åã§ããdstack ãšãã ãªãŒãã³ãœãŒã¹ã® MLOps ããŒã«ã䜿çšããŠã詳ããèŠãŠãããŸãããã
ãã®äŸã§ã¯ã1 ã€ã® dstack run ã³ãã³ãã§ãã¯ã©ãŠãç°å¢ã§ LLM-As-Chatbot ãããããžã§ãã³ã°ããŠèµ·åã§ããŸãã
ãã®äŸã§ã¯ãSplashtop Secure Workspace ã³ãã¯ã¿ãåæã«ããããžã§ãã³ã°ããŠããã©ã€ããŒã LLM ãã£ãããããã Secure Workspace ã«æ¥ç¶ããŸãããã®åŸãä»ã®ã¢ããªã±ãŒã·ã§ã³ãšåæ§ã«ã匷åãªèªèšŒãSSOãMFAãããã³è±å¯ãªæ¡ä»¶ä»ãã¢ã¯ã»ã¹ ããªã·ãŒã®ã»ãããå©çšããŠãå®å šãªã¯ãŒã¯ã¹ããŒã¹å ã§ã¢ã¯ã»ã¹å¶åŸ¡ãèšå®ã§ããŸãã
ããã§ã¯ããã©ã€ããŒã LLM ãžã®å®å šãªã¢ã¯ã»ã¹ãèšå®ããããã®ã¹ããã ã〠ã¹ããã ã¬ã€ãã瀺ããŸãã
1. ãªããžããªãã¯ããŒã³ãã
git clone https://github.com/yanlinw/LLM-As-Chatbot.git
cd LLM-As-Chatbot
2. dstack ã®ã€ã³ã¹ããŒã«ãšã»ããã¢ãã
pip install "dstack[aws,gcp,azure,lambda]" -U
dstack start
dstackãµãŒããŒãèµ·åãããããã°ã€ã³ããã¯ã©ãŠãã®è³æ Œæ å ±(AWSãGCPããŸãã¯Azure)ã䜿çšããŠãããžã§ã¯ããäœæããŸãã
3. dstack ãããã¡ã€ã«ãäœæãã
LLM-As-Chatbot ãã©ã«ãã®ã«ãŒãã®äžã« .dstack/profiles.yml ãã¡ã€ã«ãäœæããŸãããã®ãã¡ã€ã«ã¯ãäœæããããããžã§ã¯ããæãããªãœãŒã¹ãèšè¿°ããå¿
èŠããããŸãã
äŸïŒ
profiles:
- name: aws-llm
project: aws-llm
resources:
memory: 16GB
gpu:
count: 1
spot_policy: auto
default: True
4. åæå
dstackãµãŒããŒã«åãæ¿ããdstack configã³ãã³ããã³ããŒããŠã¿ãŒããã«ã«è²Œãä»ããŸããããã«ãããdstack ãµãŒããŒã¯ AWS ãªãœãŒã¹ããªã¢ãŒãã§ããããžã§ãã³ã°ã§ããŸããããã«ç¶ããŠãdstack init ã³ãã³ããå®è¡ããŸãã
dstack config --url http://127.0.0.1:3000 --project ssw-llm --token $MY_TOKEN
dstack init
5. ãã©ã€ããŒã LLM ã® Secure Workspace ãèšå®ãã
Splashtop Secure Workspace Connectors ã¯ããã©ã€ããŒãã¢ããªã±ãŒã·ã§ã³ãšãªãœãŒã¹ã Splashtop Secure Workspace ã«æ¥ç¶ããããã®å®å šãªãœãªã¥ãŒã·ã§ã³ãæäŸããŸããããã«ããããããã®ãã©ã€ããŒãã¢ããªã±ãŒã·ã§ã³ãäžå çã«å¶åŸ¡ã§ããŸããæ¬¡ã«ãäœæ¥äžã®ãã©ã€ããŒã LLM ã Secure Workspace ã«æ¥ç¶ããŠã¿ãŸãããã
5.1 ã³ãã¯ã¿ãäœæããã³ãã¯ã¿ ããŒã¯ã³ãã³ããŒãã
Splashtop Secure Workspace 管çè ã¢ã«ãŠã³ãã«ãã°ã€ã³ããŸãã[Deployment ] ã¡ãã¥ãŒã«ç§»åãã[Connector] ãéžæã㊠ã[Add Connector ] ãã¿ã³ãã¯ãªãã¯ããŸãã[ãããã¬ã¹/CLI] ãéžæã ãã³ãã¯ã¿åãå ¥åã㊠[次ãž] ãã¯ãªãã¯ããŸã ããLinux ããéžæã ããå®äºããã¯ãªãã¯ããŸã ã
ã³ãã¯ã¿ãäœæããããã³ãã¯ã¿ãªã¹ãããã³ãã¯ã¿åãã¯ãªãã¯ããŠè©³çްã衚瀺ããŸãã æé 6 ã§äœ¿çšããããŒã¯ã³ ãã³ããŒããŸãã
5.2 LLMã¢ããªã±ãŒã·ã§ã³ã®äœæ
ãã©ã€ããŒã LLM ãã£ããããã ãµãŒãã¹ããã©ã€ããŒã ã¢ããªã±ãŒã·ã§ã³ãšã㊠Secure Workspace ã«è¿œå ããŠããã®ãµãŒãã¹ãåŸæ¥å¡ã«ããããžã§ãã³ã°ããŸãã
ã ã¢ããªã±ãŒã·ã§ã³ã/ãã¢ããªã±ãŒã·ã§ã³ ãã»ã¯ã·ã§ã³ã«ç§»åããã ã¢ããªã±ãŒã·ã§ã³ã®è¿œå ã/ããã©ã€ããŒãã¢ããªã±ãŒã·ã§ã³ ã®è¿œå ããã¿ã³ãã¯ãªãã¯ããŸããã¢ããªã±ãŒã·ã§ã³ãã©ãŒã ã«ã¢ããªã±ãŒã·ã§ã³åãå ¥åãããã¹ããšã㊠ãlocalhostããããŒããšããŠã6006ã ãå ¥åãããããã³ã«ãšã㊠HTTP ãéžæã ã以åã«äœæããã³ãã¯ã¿åãéžæãããã®ã¢ããªã±ãŒã·ã§ã³ã«é©åãªã°ã«ãŒããå²ãåœãŠãŠã[ä¿å]ãã¯ãªãã¯ããŸã ã
Secure Workspace ã¯ããã©ã€ããŒã LLM ã¢ããªã±ãŒã·ã§ã³ã®å®å šä¿®é£Ÿãã¡ã€ã³åãçæããŸãã
6.ã¯ã©ãŠãã§ã¢ããªãå®è¡ããŸã
LLM-As-Chatbot ãã©ã«ãã§ã dstack run ã³ãã³ãã䜿çšããŠãã¯ã©ãŠãå
ã®ãã©ã€ããŒã LLM ãšã»ãã¥ã¢ ã¯ãŒã¯ã¹ããŒã¹ãããããžã§ãã³ã°ããŸã ($token ãã¹ããã 5.1 ã®ã³ãã¯ã¿ ããŒã¯ã³ã«çœ®ãæããŸã )ã
dstack run . -f ssw-private-llm.yml $token
ãã®ã³ãã³ãã¯ãã¯ã©ãŠãã§LLM-As-Chatbotãããããžã§ãã³ã°ããŠå®è¡ããŸãããŸããSecure Workspace ã³ãã¯ã¿ ã€ã³ã¹ã¿ã³ã¹ãšãã©ã€ããŒã LLM ãéå§ãããŸãã
ãã©ã€ããŒã LLM ãµãŒãã¹ãå®å šã«éå§ããããšãäœæãããã©ã€ããŒã LLM ã¢ããªã±ãŒã·ã§ã³ã®å®å šä¿®é£Ÿãã¡ã€ã³åã䜿çšããŠããã©ã€ããŒã LLM ã«ã¢ã¯ã»ã¹ã§ããŸãããã®éããã®ã¢ããªã±ãŒã·ã§ã³ã®ãšã³ã¿ã€ãã«ã¡ã³ã ããªã·ãŒãšæ¡ä»¶ä»ãã¢ã¯ã»ã¹ ããªã·ãŒãèšå®ã§ããŸãã
çµè«
äŒæ¥ãæ°éã®ãžã§ãã¬ãŒãã£ãAIãLLMãæ¡çšããã«ã€ãããããã®é©æ°çãªã·ã¹ãã ãžã®ã¢ã¯ã»ã¹ãä¿è·ããããšãæéèŠèª²é¡ãšãªã£ãŠããŸãã
Splashtop Secure Workspace ã¯ãæ¢åã®ã€ã³ãã©ã¹ãã©ã¯ãã£ãšã·ãŒã ã¬ã¹ã«çµ±åããªãããããžãã¹ã¯ãªãã£ã«ã«ãªã·ã¹ãã ãžã®ãªã¢ãŒãã¢ã¯ã»ã¹ãä¿è·ããŸãã
ãã®èšäºã§æŠèª¬ããæé ã«åŸãããšã§ããã©ã€ããŒã LLM ã®å®å šãªã¯ãŒã¯ã¹ããŒã¹ãèšå®ããã³ç®¡çããéçšå¹çãç¶æããªããäŒç€Ÿç¬èªã®ããŒã¿ãä¿è·ã§ããŸãã
ãžã§ãã¬ãŒãã£ãAIãšã»ãã¥ã¢ã¢ã¯ã»ã¹ã·ã¹ãã ã®çµã¿åããã¯ãããžãã¹ãªãã¬ãŒã·ã§ã³ã®æªæ¥ã圢äœãç¶ãããããã®ã·ã¹ãã ã®æ¡çšãšå®å šãªç®¡çã«ç©æ¥µçã«åãçµãããšã§ãäŒæ¥ã¯ãã®å€é©ã®æåç·ã«ç«ã€ããšãã§ããŸãã