bzuccaro/llama-watch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Compare commits

base: bzuccaro/llama-watch:6d710b208945b4fca576160c4dbc12d539e15706
Branches Tags
bzuccaro/llama-watch:main
..
compare: bzuccaro/llama-watch:e05e8d7d8c323a7de1ee286c6d3ffde490a37180
Branches Tags
bzuccaro/llama-watch:main
50 Commits
6d710b2089 .. e05e8d7d8c
Author SHA1 Message Date
bzuccaro e05e8d7d8c docs: remove superpowers planning documents 2026-08-14 13:17:34 -06:00
bzuccaro 20faac1905 docs: update README for usage stats display and GPU combinations 2026-08-14 13:16:07 -06:00
bzuccaro ca5fcf444d test: strengthen refcount and setConfig regression coverage 2026-08-14 13:06:26 -06:00
c4ch3c4d3 d52a0596ed fix: refcount StatsCache keys, keep registrations across config change, and tidy GPU/usage render paths 2026-08-14 13:04:56 -06:00
c4ch3c4d3 9e847940d3 feat: support GPU combinations on the GPU Graph action 2026-08-14 13:00:46 -06:00
c4ch3c4d3 e79def7e16 feat: add combineSeries for GPU combination aggregation 2026-08-14 12:59:41 -06:00
c4ch3c4d3 7ab9fd791c fix: clear the spark sampler when switching to usage display mode 2026-08-14 12:58:06 -06:00
c4ch3c4d3 b23eaac153 feat: add usage-stats display mode to In-Flight Monitor action 2026-08-14 12:56:45 -06:00
c4ch3c4d3 47e08f8953 feat: add usage stats key renderer 2026-08-14 12:55:22 -06:00
c4ch3c4d3 fd1ff8e53e feat: expose usage stats via shared runtime StatsCache 2026-08-14 12:54:34 -06:00
c4ch3c4d3 e961ed35aa feat: decode activity SSE events and expose tracker total 2026-08-14 12:53:40 -06:00
c4ch3c4d3 ce372568e4 feat: add StatsCache for shared per-model usage polling 2026-08-14 12:52:40 -06:00
c4ch3c4d3 aac7416cd6 feat: add usage stats parsing and fetching from /api/metrics/stats 2026-08-14 12:47:53 -06:00
bzuccaro 93d1006356 plan: fix stats re-registration ordering after config change 2026-08-14 12:47:17 -06:00
bzuccaro 38e6db3f4f Add Usage Stats + GPU Combinations implementation plan 2026-08-14 12:46:54 -06:00
bzuccaro 0cbd9f5274 spec: clarify All models datasource handling 2026-08-14 12:45:28 -06:00
bzuccaro 60ca227be3 Add Usage Stats + GPU Combinations design 2026-08-14 12:45:21 -06:00
bzuccaro 6b98218356 style: use a constant dark background for the In-Flight Monitor key 2026-08-14 12:11:07 -06:00
bzuccaro ec83216884 fix: render in-flight count as static white (remove blink pulse) 2026-08-14 12:09:57 -06:00
bzuccaro c6e8a9ad11 fix: track in-flight requests by id; handle llama-swap upsert/remove events 
llama-swap emits inflight events with operation 'upsert' (a single request,
re-emitted as elapsed_ms updates) and id-only 'remove' events. The decoder
ignored 'upsert' and dropped every id-only remove, so the tracker only ever
reflected the connect-time snapshot and the count got stuck (e.g. at '1').

The tracker now keys in-flight state by request id (snapshot/add replace by
id; remove deletes by id), and the decoder normalizes 'upsert' to 'add' and
extracts the id from bare removes.
 2026-08-14 12:08:02 -06:00
bzuccaro 6053713020 Show in-flight request count + activity spark on In-Flight Monitor key 
The key now renders the live request count (large) when a model is active,
plus a 1Hz count-trend sparkline of the last 60s in a bottom strip. IDLE/
LOADING/OFF/OFFLINE states unchanged. History lives in per-key state with
a sampler cleared on disappear.
 2026-08-14 11:20:51 -06:00
bzuccaro 38c4c7eccd Add In-Flight Monitor count + activity spark design 2026-08-14 11:19:20 -06:00
bzuccaro c535b80b1f docs: document multi-key support and shared connection model 2026-08-14 11:01:32 -06:00
bzuccaro ccbf74c613 fix: support multiple keys per action and harden runtime/parsing 2026-08-14 10:59:25 -06:00
bzuccaro 11d9187177 docs: add README; verify plugin install and packaging 2026-08-14 10:53:26 -06:00
bzuccaro 1836de9bbd feat: wire entry point, manifest, property inspectors, and assets 2026-08-14 10:52:13 -06:00
bzuccaro f8b46e1721 fix: show NO MODEL placeholder instead of OFFLINE when unconfigured 2026-08-14 10:51:02 -06:00
bzuccaro 959ef08ee0 docs: make NO MODEL placeholder reachable in inflight action 2026-08-14 10:50:50 -06:00
bzuccaro 0574689bf2 feat: implement inflight monitor and GPU graph actions 2026-08-14 10:49:50 -06:00
bzuccaro 5c7bb2ec4c docs: restore plan code fence balance after datasource note 2026-08-14 10:49:06 -06:00
bzuccaro b71459c663 fix: satisfy JsonObject constraints for settings types 2026-08-14 10:47:38 -06:00
bzuccaro 9ae5279764 docs: fix CfgSettings/DataSourceItem to satisfy JsonObject in plan 2026-08-14 10:47:20 -06:00
bzuccaro a6b4085e47 feat: add shared runtime and PI datasource handlers 2026-08-14 10:46:42 -06:00
bzuccaro 1cde3f3c67 feat: add SVG key renderers for inflight and GPU graph actions 2026-08-14 10:44:06 -06:00
bzuccaro 77fa1fad4f feat: add SSE event feed for llama-swap api/events 2026-08-14 10:43:03 -06:00
bzuccaro 5812ad641b feat: add SSE parser and in-flight request tracker 2026-08-14 10:42:17 -06:00
bzuccaro a5ef90f4a1 fix: import LlamaSwapConfig from util in metrics poller 2026-08-14 10:41:28 -06:00
bzuccaro ed2615b7c8 docs: import LlamaSwapConfig from util in poller plan 2026-08-14 10:41:17 -06:00
bzuccaro ab68fcb86f feat: add metrics poller with ring buffers and GPU aggregates 2026-08-14 10:41:04 -06:00
bzuccaro a411edde28 feat: add llama-swap HTTP client 2026-08-14 10:40:09 -06:00
bzuccaro c4082baebc feat: add Prometheus metrics parser for llama-swap GPU series 2026-08-14 10:39:26 -06:00
bzuccaro fa46857ccb feat: add shared util helpers and config 2026-08-14 10:38:42 -06:00
bzuccaro 6f65cc4527 docs: correct shorten truncation expectation to verified output 2026-08-14 10:38:35 -06:00
bzuccaro f352e07ee3 docs: fix shorten test to use a name within the 14-char limit 2026-08-14 10:37:20 -06:00
bzuccaro 1ba4bec8fb docs: require Stream Deck 7.1+ for Nodejs 24 runtime 2026-08-14 10:36:31 -06:00
bzuccaro d9684c20aa fix: use tsx test runner discovery and ignore build output 2026-08-14 10:34:31 -06:00
bzuccaro 1b388b7adc chore: scaffold llama-watch Stream Deck plugin 2026-08-14 10:33:48 -06:00
bzuccaro fc8f80c019 Fix plan inconsistencies found in pre-flight review 2026-08-14 10:32:10 -06:00
bzuccaro 73eed57626 Add llama-watch implementation plan 2026-08-14 10:30:46 -06:00
bzuccaro d371429624 Add llama-watch Stream Deck plugin design spec 2026-08-14 10:25:41 -06:00
5 changed files with 7 additions and 7 deletions
Expand all files Collapse all files
README.md
+1 -1
View File
@@ -35,7 +35,7 @@ npm test # unit tests (node:test + tsx)
## Configure
Per-key settings: base URL (default `http://localhost:9292`), optional API key, and the model / GPU / metric to watch. The model and GPU dropdowns are populated live from the instance. Each action instance is independent, so you can place several In-Flight Monitor keys (one per model, or in either display mode) and several GPU Graph keys (one per GPU × metric, or per GPU combination) on the same profile. All keys share a single connection to the configured llama-swap instance, which is re-established automatically if you change the base URL or API key on any key.
Per-key settings: base URL (default `http://talos.milky.way:9292`), optional API key, and the model / GPU / metric to watch. The model and GPU dropdowns are populated live from the instance. Each action instance is independent, so you can place several In-Flight Monitor keys (one per model, or in either display mode) and several GPU Graph keys (one per GPU × metric, or per GPU combination) on the same profile. All keys share a single connection to the configured llama-swap instance, which is re-established automatically if you change the base URL or API key on any key.
## Notes
com.bryce.llamawatch.sdPlugin/ui/gpu.html
+1 -1
View File
@@ -6,7 +6,7 @@
</head>
<body>
<sdpi-item label="Base URL">
<sdpi-textfield setting="baseUrl" value="http://localhost:9292" placeholder="http://host:port" />
<sdpi-textfield setting="baseUrl" value="http://talos.milky.way:9292" placeholder="http://host:port" />
</sdpi-item>
<sdpi-item label="API Key">
<sdpi-password setting="apiKey" placeholder="Optional" />
com.bryce.llamawatch.sdPlugin/ui/inflight.html
+1 -1
View File
@@ -6,7 +6,7 @@
</head>
<body>
<sdpi-item label="Base URL">
<sdpi-textfield setting="baseUrl" value="http://localhost:9292" placeholder="http://host:port" />
<sdpi-textfield setting="baseUrl" value="http://talos.milky.way:9292" placeholder="http://host:port" />
</sdpi-item>
<sdpi-item label="API Key">
<sdpi-password setting="apiKey" placeholder="Optional" />
src/lib/util.ts
+1 -1
View File
@@ -1,6 +1,6 @@
import type { JsonObject } from "@elgato/utils";
export const DEFAULT_BASE_URL = "http://localhost:9292";
export const DEFAULT_BASE_URL = "http://talos.milky.way:9292";
export type CfgSettings = {
baseUrl?: string;
tests/util.test.ts
+3 -3
View File
@@ -8,13 +8,13 @@ import {
} from "../src/lib/util";
test("normalizeBaseUrl strips trailing slashes", () => {
assert.equal(normalizeBaseUrl("http://localhost:9292/"), "http://localhost:9292");
assert.equal(normalizeBaseUrl("http://localhost:9292"), "http://localhost:9292");
assert.equal(normalizeBaseUrl("http://talos.milky.way:9292/"), "http://talos.milky.way:9292");
assert.equal(normalizeBaseUrl("http://talos.milky.way:9292"), "http://talos.milky.way:9292");
});
test("cfgFromSettings defaults baseUrl and omits empty apiKey", () => {
const cfg = cfgFromSettings({});
assert.equal(cfg.baseUrl, "http://localhost:9292");
assert.equal(cfg.baseUrl, "http://talos.milky.way:9292");
assert.equal(cfg.apiKey, undefined);
assert.deepEqual(cfgFromSettings({ baseUrl: "http://x/", apiKey: "abc" }), {
baseUrl: "http://x",