Trial metrics count a composite action and its steps as separate game writes #144

New issue

Closed

opened 2026-10-17 04:31:49 -04:00 by vinny · 0 comments

vinny commented

2026-10-17 04:31:49 -04:00

Owner

cmonet.evaluation.extract counts every action job whose operation is a game write. A composite (navigation.go_to, forces.strike_package, the library composites) is a game write in the registry, and so is each step it sends, which has an action record of its own. Every composite was therefore counted with its steps.

Live 2026-10-17, trial tpl-subsurface-offensive-patrol.20261017T065733Z: four navigation.go_to calls to submarines out of comms were refused at their navigation.set_route step. Each counted as one failed write (the go_to, composite_incomplete) and one invalid write (its step, validation_failed): 127 writes with 6 failed and 4 invalid, where 117 writes with 2 failed and 4 invalid happened. A verified go_to counted as three writes.

Expected: a composite counts through its steps; one that stopped before any step went out counts once. Runs already recorded need their metrics derived again from the databases they kept.

`cmonet.evaluation.extract` counts every action job whose operation is a game write. A composite (`navigation.go_to`, `forces.strike_package`, the library composites) is a game write in the registry, and so is each step it sends, which has an action record of its own. Every composite was therefore counted with its steps. Live 2026-10-17, trial tpl-subsurface-offensive-patrol.20261017T065733Z: four `navigation.go_to` calls to submarines out of comms were refused at their `navigation.set_route` step. Each counted as one failed write (the go_to, `composite_incomplete`) and one invalid write (its step, `validation_failed`): 127 writes with 6 failed and 4 invalid, where 117 writes with 2 failed and 4 invalid happened. A verified go_to counted as three writes. Expected: a composite counts through its steps; one that stopped before any step went out counts once. Runs already recorded need their metrics derived again from the databases they kept.

vinny referenced this issue from a pull request that will close it,

2026-10-17 04:32:11 -04:00

Count a composite action through its steps in trial metrics #145

vinny referenced this issue from a commit

2026-10-17 04:32:26 -04:00

Count a composite action through its steps in trial metrics

vinny closed this issue

2026-10-17 04:32:26 -04:00