Seems to make sense for maximum privacy. Put together a large enough model to answer health queries, have OCR and image recognition to read exams, give it web access to search for medication details and, of course, gather raw data from any devices you use to measure weight, heart rate, etc.

But that’s just in theory and we all know things are hard to put together. In practice, have you had any experience getting anything like this working locally?

  • rkd@sh.itjust.worksOPEnglish
    2·
    4 days ago

    For sure, context rot is a problem, but that’s also the easiest thing to control for in this case. If sensor data is relevant to you, having some code to process and reduce it to a dashboard you can read is always a good idea, independently of getting an LLM into the loop.

    This becomes more complicated with data you can’t really understand like results from blood tests, for example. But maybe you just don’t summarize any of that.

    • hendrik@palaver.p3x.deEnglish
      2·
      3 days ago

      It wasn’t really clear to me where you want to go with this. I mean judging by conversations with my friends, there’s a 3h conversation to be had about every nuance of health. The diet, how to work out, how much to eat and drink. There’s rules of thumb. But in reality it’s a very individual thing. And also changes with the situation, for example if you go to the gym or running and want to progress, it’d be an entirely different story a few months later. Also some people have office jobs, some do 18,000 steps each day… And don’t get me started on mental health.

      Diagnosing medical conditions is hard for AI. We got some news on that a few days ago. It’s good at exam questions. But doesn’t perform in reality. So I wouldn’t call it health agent considering those kinds of questions. More a shaman. Or alternative practitioner / healer. (Or it’d need to stick to specific things. Or we need a few more years of progress in AI.)

      I mean, I think the available tools aren’t even half bad? There’s smart watches with all kinds of features, apps, dashboards… Training modes and advise. They can help you define goals, track your period if you have that… Water intake, activity levels. It’s not AI, but there will be summaries, achievements, reminders…
      Just the privacy part is a bit tricky, as most of these ecosystems come as cloud services.