From c87484f1ffb63e189c2b467e2717272abcf600ec Mon Sep 17 00:00:00 2001 From: nai-degen Date: Sat, 7 Oct 2023 21:33:53 -0500 Subject: [PATCH] adds AWS console screenshot to docs --- docs/assets/aws-request-model-access.png | Bin 0 -> 4349 bytes docs/aws-configuration.md | 17 +++++++++++++---- 2 files changed, 13 insertions(+), 4 deletions(-) create mode 100644 docs/assets/aws-request-model-access.png diff --git a/docs/assets/aws-request-model-access.png b/docs/assets/aws-request-model-access.png new file mode 100644 index 0000000000000000000000000000000000000000..9802509d9455389dc5e43ed7ab66ebcca8ce993b GIT binary patch literal 4349 zcma)Ac{J2-+aH9GkVbyVntf1&vQ81QulZ&hRJO^I?E6xd5Yi0EGTD+PV`uCn%h+XP z7<<;jFt%wdkIuXN@t)_L_xa<#&wX9zTz}lxb$^y~zcw<^VrIO`2m*nawIAF!0fDHv z&(1;Tsn7PV(XX>05NoIQ{d;Equ#K!^Q+6kwwquA)m3p*~8XW`n?mx|e7uKtBiYsqY zGt9HN@>Aij;6;a{rq!Q;pj=7w0vy*yRt%85pZ}s7M@?@+yN>H%$mV;?CwQ-ZaY@h7 zSu>S)e;@DUSB2N_*eMSeoE=hzzH&mX;EBZGohH}lEoBZ6s5!l`9|W?)h6A9FP!gS% zCf~ite2+*nBWRbti5hfFg$CUXYlDD>d5Pk=7|*KhI*+HVsV(3XMNgHldr6gj)l@JI zS;Fud?;%>|%G`Wl^ep6vXr2Q2>J5!R%P^AYu79oQ0eEvOkPwfOryi>k?Zg4uu9*)Jh2bL_M&Zka@s zooDtuO%8JKyEEC?peESZS5SIuz}Zt%H@%0dK|r?iSbY^ay%sz?{l!;1Tk-e4dyKk; zm*U7mLaI!svP+}6$>c;yf2ePIOWAprSW3(=q(-AXrE=Lj_ggwcpE9ONPL*GwB*hpu z+;*JTcfo8K>`;3#_=z0XW4~D=M?>VWO%AQoH+m1ptqzx!EvSO&=!DWIiCcdBo4iDw zh{nT*><+TV=u~B67-J948;+-Jbg+D1dFVk7O4llhM&M0_o&wGb#=WX#Z{MUVDWGS1 z2+<8cEXQsZOUS>QtJ`gtbWo-0JZ7(j&HvcRmtqfZsk-5rZH+bjIDXpurKv|I`(*G_ zakQ4Zi_F)hhp>Pcie>RL%jo9E3T$PxKVp-AaeLN`nbqtT>Ane|Guopv98L-yGeGIW z;}AwRIn2tjb!o)-+3l8;kk3IZp(3yM#*WJ|pEhG^Pf*<<$YBrXXJu%YP+3J)RYjRQ zcUA-9m{@es_(GoDujQpPheOA1Z>+ya)s@<22R4M3s;58h-445^zBNy*v)*`X+}dbx z_3vnpRuwRl#Dz7U+JLZ2%?tU}#tXti-?9C592pCb*)O?V*Owghcv`MejTr6o9IV7W zd$&6A^YBqsgiN8$RZZsVD-t=W8_IASyZj1&_1mO0t?$P5@1;aC(PVHHO0<6-bm*wZEV zJK5ic>_pxAl<|DQCVSRXPT*6i@#d+SpRmkgtt(em@1`Ht3?n9X`~iy-kAl|a<)cfK zdKvbIzaGMby@7M#pG1>ACqzWF-g1-{>Z&{GoOrJW8PB z4$I37w4M#}@}PF8fNA;d1>n5)h4RFfo-;|^>Pr4iBNXWuWnK>8Q8h2BUM|iq(Z3b+ zmrV-wL%f3<&a+%!T)d9!_B~wjm_F%t?4JAhrGcoA(rs^EZ+g09oXfRx~^$2bc9^FkSEPtNDG+R#ly=M1gL1XTUf?0N^! z+Fr^rbe_q%{)WON|K)d$m)jt-C+j-VD1h)v*oZV3EH2dg@My%QDKYmpLK@3e;YQY7 z{rT0cw7;Y!SB?&Dx`uGwVXKD7zHHtp7@)*$&bhqi-JMcB%CySI;cTUPLi8s{MDm&z zcKbfTwASV&Fjz@L_?5MCV*JvQLXs+bf{-t4$jXXxWzj~o5 zct5?%4|S{GP=6`~`Fb?^8)@wo&A<`3xmkQjwg=uj3HV1X8xkUaB3rbsw>PLMwUDtE zq#*aoz~cvGP)nrH+d^*Myv^NrT6us@5C#D#^hloL4LhCR+~6`EtnF7v+Vn^gbv(uf z=fV_)hK$qL?21dJcT-BCNJQ%Vu4mUJ^?oI})ekc;xg`tP0if}s$^{o(+RoP@pmtzPd)<8BOV10czXXmju?ma2 zp$e(jXG?|Y+~2AI~sx@>e`eauVLKX5)fK#%d1)VA;CY+t)# zt)ysHPtv{!ePdnxGc6J+6xJ9u9=cd(=ylO``p|bI&1cUxo6t8T{{sEuqD>i^yxw7O z;;QZ(@bSgaFXy-9dEj%=hlV&3GD~7AkZi4?Z&Ni8aJs|RTQcI2^f3Q}TgwXS3u zBzunlJtOh1t?3uv5ONmFI?=u5>#itUVMYIsGG&QT#JG*)zGy+lEcy@f0Q?}1`1Xt+J%Y9+P(YP_;YeVMyv$24PX^(Q~i?Mrc_ zwh^nsQH;T$q=s(g_U4W{rb#|{GWd}3#4&?16E!;@R$L+JwE{DP5#iPI2&2#^qfpeHD>%P8@rRM2kpI7SZf`+SEZYHZ(1TPpRg96{CXnFD-cHWo@HINJZ^zrz^nG zqS$U{uLpNeJ9N+l%+bzLPj`&6731|{AVW(kg;_jLSp&a~sEi!AJ012#PzBUBo8(Q{ z>MM0FYTib`RIJXF5(9WeVwQ1xb?hlWGVjrYZ_#Ymk1zvEp}W%^Bxk4H-)CL^etBI@-h(>`kfZsWe%f#sy8q)C{*8(F_o)~HgmV8BHNE-4 zQi5Iugbufe7=|={Cx2|T+DK9Mnb@e}`D3>ZQ~4kL&Q{(GvQ2|M!-?@+BPN_F{$%c% zJMeN$&jj?sHhOlp1Z#s{A@6?9Fn;C}yPxNk=1?&3g_k}y@ts(s;eCl+( zl-dXa{mp++Qv*T{?jU&86X(9hIwbxChG(?>l;BxG5FfduWxTu;6%4xLv+6Ep=YsKx zc$*lfv9xw5DE8>4k{OcJlrAIGB_cSgS;5VhaNY||30UB4$Q*% z%+N!WiFFvLX;q5|p{OJbq3r(B(r3hxc||sw^8*(Eu5Gjq5uNVQjSc}O*w|oVUNqs< z6k%R>Q%A^h$#@b>Hhs9^;+NS~hNi##8MO^oKUm;;Yhs`Q%8O9A;2#wb9Ee z)1+D4^1H-?v^ZEmmaQw>0pQH+V(I6}DYt;JML3?tHTa5Zg}kwLw{p&*X2T!xD;!7o zC!>kjQ2Ue}#mwR-5A57&U}Vk)i{w;ic_Uc^gxCs~RNe8|j`LMR3zctN1I`R}H^mj@ zL?HT^vw=fpY;X-B_X$*u<%a`e1DlOZmt>7&S@I{jPaC_Ff{eGL;M`68%?x}Je7o4q z=iU<=@c5rac_k%NYi8q_7Q#zlI+dIkd$d8NownS@HtM8|XKgRjVo&^IYzXH*_dAF* zu-z==-;K))%H5hC{F6pwA%F(ittSV`iTr)XRR1|77`)C3%|U++_wqdQlHh}6Z@rtg zXP|q90S>>ar!#@RU+|{|{h|3^AkKk7t1SOn3IpuFK7lq)FPV&|d$vLB%>UljTXl8Q zyiw4Q+m})rqx!x9Fq|wyBINhQt3;A0Gd~J`Sk`p1(l4vNf)zp>&z(Ht* zX=cX8F+&Lbz#~pT=TjQQOYYXU^>7v<USh@ za*{OJ(gnbb{g3HlzKwG`ah@y_SBoudH2x+NQDe%|v~Ex@{mF2O zkG@UcPhCapk639Gi~iWE$XHqrP7 z@4^$Fq{E`2U=*Zl;(tG9>-0!LFH^EA8 zE!Frhf6tyV;^4bb4%d!WV>k%nL_yn|;Mgi7G4hwkDz?(Hx68y`wc4XF-q&wf)NGjq z3K@hy5`oe9ZI=j(Jg*5RwguvR6J( zwSl56y&94p#@Z{LMB0zcY*kd;v>lL`L$*B{P;$gp+qt#-Wzo3PN$x9ho!}rBw)G2~ zy>t0R{g-?~D>MkUIdb_f)8FjJVpl?qKb*xl$L`VP1d|xx>T$;jW0s2W#^+9@Yh}_g zrk)py+96xz{>eRCS>?d2tNbX$z}s`{dBQwU90|a>(=0+MB_L+;5~d$i0&Ngp_1jFN zmj*`DIUTU~3>~KoC6hjFi*AX{IBV+GM;VV4DOk8Hto~MM)cg!a*4u}T!(GM}e6BY< zO|XIwSo7;Y)0{|n*tzmG#OwBIxUjTcLdH?_b literal 0 HcmV?d00001 diff --git a/docs/aws-configuration.md b/docs/aws-configuration.md index f89a105..7039332 100644 --- a/docs/aws-configuration.md +++ b/docs/aws-configuration.md @@ -34,12 +34,21 @@ Use the IAM console or the AWS CLI to attach these policies to the principal ass AWS does not automatically provide accounts with access to every model. You will need to provision the models you want to use, in the regions you want to use them in. You can do this from the AWS console. -The account must have access to _all_ of the following models or the proxy can't use those credentials. +⚠️ **Models are region-specific.** Currently AWS only offers Claude in a small number of regions. Switch to the AWS region you want to use, then go to the models page and request access to **Anthropic / Claude**. -- `anthropic.claude-v1` -- `anthropic.claude-v2` +![](./assets/aws-request-model-access.png) -⚠️ **Models are region-specific.** Currently AWS only offers Claude in a small number of regions. +Access is generally granted more or less instantly. Once your account has access, you can enable the model by checking the box next to it. + +You can also request Claude Instant, but support for this isn't fully implemented yet. + +### Supported model IDs +Users can send these model IDs to the proxy to invoke the corresponding models. +- **Claude** + - `anthropic.claude-v1` (~18k context) + - `anthropic.claude-v2` (~100k context) +- **Claude Instant** + - `anthropic.claude-instant-v1` ## Note regarding logging