• 21 Posts
  • 83 Comments
Joined 3 years ago
cake
Cake day: July 9th, 2023

help-circle

  • Yes, I run Ollama on a NVIDIA 1080 Ti at home. I run granite4:3b for my Home Assistant assistant for my voice assistant, paperless-ngx, OpenWebUI for chat, and a few other things. For speech to text, I run a custom-built hybrid speech-to-phrase + parakeetTTS (requests that match speech-to-phrase take priority over parakeet.) I run GOModel to route requests to my local Ollama instance, or DeepInfra (cloud-based for larger models), or Tinfoil (cloud-based for encrypted LLM chats.)

    As much as I love to use local-everything, only my smarthome+basic chats go local. Trying to fit both the STT and LLM models on the same GPU at the same time while also using this computer as a media console is challenging. I’ve recently started looking at the Hailo m.2 accelerator board to see if I can shift the STT to it.





  • Where should i buy my domain and are there any things i should be careful about?

    Just becareful about renewals. Sometimes a domain will be cheap year one, but crazy expensive year 2+. I personally use Porkbun

    does the end of my domain (idk the specific name but .XYZ) matter at all?

    Sometimes it can matter. If you host email, some TLDs are classed as higher risk and could be wholesale blocked or classed as higher risk.

    Am i willing to self host too much stuff?

    That’s a question of how much time do you mind spending configuring, maintaining, and upgrading. I run way too many services. Some of them require more effort than others. Forgejo requires more effort to get working than Immich for me trying to get Forgejo Actions working well.












  • I looked quickly, but didn’t see an answer. Does Sure.am let you download your transactions into something like Actual or Firefly-iii or is it all within the hosted platform? I saw an option to self host, but didn’t see the integrations.

    I’m trying to find something to pull into my firefly-iii instance and am currently abusing the Monarch API but it has some issues. I also wrote my own scrapers but they are fragile and I’d rather just integrate directly with plaid.








  • We’re going to have to start treating it like email with anti spam filtering and reputation. Things like rspamd are very advanced with a lot of signals that it uses.

    Right now, the best part of the Fediverse is its weakest point: federation. I can easy spin up my own instance, connect it to lemmy.world and start posting. I can create accounts to make it look legitimate and it takes admins on one or more instance to first start banning individual accounts, then realize the entire instance should be banned. I can then create more domains if I want to. Lemmy.world uses CloudFlare’s anti-bot (which has its privacy ramifications) but that can be trivially be bypassed with federation.

    I’ve been thinking Lemmy needs automated anti spam (content filtering) that then feeds into user and instance reputation to automatically flag domains, IPs, etc.

    Look at the recent posts about Reddit’s anti-spam practices, it has the advantage of a single system able to collect a lot of metrics. Unfortunately you kind of need it to fight advanced spammers.



  • Partially. I started with hosting my own llama3.2 + granite4 models using Ollama for my Home Assistant smart home and for general chat with OpenWebUI. I also run whisper for speech-to-text locally on my 1080 Ti GPU. I like the privacy and ownership of my self-hosted models, but I started to run into limitations with the small weights. So I built some tools that allow me to selectively route traffic to larger models hosted on DeepInfra depending on my need. For example, to GLM/Kimi models for code reviews or for my custom harnesses or harder problems.