• 7 Posts
  • 3 Comments
Joined 5 years ago
cake
Cake day: February 3rd, 2021

help-circle
  • I’ve been testing coding capabilities a bit (mostly scripts - so that work done by ai is reproducible).

    1. Context size is very much a required thing along with model capabilities.
    2. Local model can generate good enough script in one shot - but reiterations r crazy
    3. Use git to keep files tracked (easy to revert) and make a modular script - main script calls function a, function b etc where functions are relatively self contained (no need to look at others) when u need new capability add function c
    4. If something need changing- try to do it urself (unless it’s whole architectural change, then just start new project)

    As for image gen + chat . as long as chat model + context + image model fits, u should be fine.


  • rando@lemmy.mltoSelfhosted@lemmy.worldDo you host your own AI?
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    7 days ago

    Bought b70 with egpu enclosure and usb4 connection wasn’t really planning to actually run anything but now ended up with llama.cpp with openwebui - kids/parents want to/have to use chat, might as well provide local solution than them using industry options. Also started with ollama and Gemma 4 26b a4b - asked it to write script to setup llama.cpp in container.