ignition-monorepo / backend-tfjs/src / QTableAgent
Class: QTableAgent
Defined in: backend-tfjs/src/agents/qtable.ts:23
Implements
Constructors
Constructor
new QTableAgent(
config):QTableAgent
Defined in: backend-tfjs/src/agents/qtable.ts:42
Parameters
config
Returns
QTableAgent
Accessors
tableSize
Get Signature
get tableSize():
number
Defined in: backend-tfjs/src/agents/qtable.ts:180
Nombre d’états visités.
Returns
number
currentEpsilon
Get Signature
get currentEpsilon():
number
Defined in: backend-tfjs/src/agents/qtable.ts:185
Taux d’exploration courant.
Returns
number
Methods
getAction()
getAction(
state,greedy?):Promise<number>
Defined in: backend-tfjs/src/agents/qtable.ts:123
Sélectionner une action par politique epsilon-greedy. Exploration : action aléatoire (prob. ε) Exploitation : argmax Q(s, ·)
Parameters
state
number[]
greedy?
boolean
Returns
Promise<number>
Implementation of
remember()
remember(
experience):void
Defined in: backend-tfjs/src/agents/qtable.ts:136
Stocker l’expérience pour le prochain appel à train().
Parameters
experience
Returns
void
Implementation of
train()
train():
Promise<void>
Defined in: backend-tfjs/src/agents/qtable.ts:147
Effectuer une mise à jour Q-Learning sur la dernière expérience.
Q(s,a) ← Q(s,a) + α·[r + γ·max_{a’} Q(s’,a’)·(1−done) − Q(s,a)]
Décroît epsilon après chaque update.
Returns
Promise<void>
Implementation of
getState()
getState():
Record<string,unknown>
Defined in: backend-tfjs/src/agents/qtable.ts:191
Serialize internal state (epsilon, stepCount, etc.) for checkpointing.
Returns
Record<string, unknown>
Implementation of
setState()
setState(
state):void
Defined in: backend-tfjs/src/agents/qtable.ts:197
Restore internal state from a serialized object.
Parameters
state
Record<string, unknown>
Returns
void
Implementation of
save()
save(
modelId,metadata?):Promise<string>
Defined in: backend-tfjs/src/agents/qtable.ts:205
Serialize the Q-table to a JSON-compatible object. Stores in localStorage under the given modelId.
Parameters
modelId
string
metadata?
Record<string, unknown>
Returns
Promise<string>
Implementation of
load()
load(
modelId):Promise<void>
Defined in: backend-tfjs/src/agents/qtable.ts:229
Load a previously saved model and state.
Parameters
modelId
string
Returns
Promise<void>