minus-squarefubarx@lemmy.worldtoSelfhosted@lemmy.world•Do you host your own AI?linkfedilinkEnglisharrow-up2·16 hours agoFound vLLM to be the most efficient local runtime service. And “ray” as a good (but complicated) way to distribute the load: https://docs.ray.io/ linkfedilink
fubarx@lemmy.world to Oakland@lemmy.worldEnglish · 4 months agoBay Area’s Alysa Liu a symbol of joy as she ends U.S. women’s gold medal droughtplus-squarewww.sfchronicle.comexternal-linkmessage-square0linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkBay Area’s Alysa Liu a symbol of joy as she ends U.S. women’s gold medal droughtplus-squarewww.sfchronicle.comfubarx@lemmy.world to Oakland@lemmy.worldEnglish · 4 months agomessage-square0linkfedilink
fubarx@lemmy.world to Parenting@lemmy.world · 5 months agoOur job as parents is to be hype-mastersplus-squaremessage-squaremessage-square0linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareOur job as parents is to be hype-mastersplus-squarefubarx@lemmy.world to Parenting@lemmy.world · 5 months agomessage-square0linkfedilink
fubarx@lemmy.world to Machine Learning@lemmy.ml · 1 year agoBreaking GPT-5 News!plus-squaremessage-squaremessage-square0linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareBreaking GPT-5 News!plus-squarefubarx@lemmy.world to Machine Learning@lemmy.ml · 1 year agomessage-square0linkfedilink
Found vLLM to be the most efficient local runtime service. And “ray” as a good (but complicated) way to distribute the load: https://docs.ray.io/