Obtain information about the current task and episode

Opens the interaction object. Note: Assumes object is closed and agent is at its location. Objects like fridges, cab

Obtain information about the current task and episode

Args: filepath (str): a string that contains the absolute path, including the file name, where the visualized ima

forward the model for a single time-step (used for real-time execution during eval)

rgb: RGB image depth: depth image camX0_T_camX: rotation pose matrix to go from reference frame to current frame

Apply the sigmoid operation.

Encode the mask to vector of vec_dim or specific dimention.

get simulator by name and initialize it with kwargs

Return objects augmented by custom properties :param event: Simulator event to be used to obtain object properties, usually self.cont

Add predictions and labels of a single image and matches predictions to ground truth boxes :param predictions: dictionary of predicti

Main function to return individual id based action

Compute AP/MR for all classes, then averages

Return True if two actions are equal.

Save episode to file :param file_name: File name to save episode to; if None, a random file name is assigned

intput: dct_vector numpy [N,dct_dim] output: mask_rc mask reconstructed [N, mask_size, mask_size]

Main function to return individual playwright action

Return a valid action object that does nothing.

r"""Alias of `simulate()` to conform to base-class and expected API

Closes the interaction object. Note: Assumes object is open and agent is at its location. Objects like fridges, cabi

Get transformation matrix between first position (camX0) and current position (camX)

Turn on record mode

Original function copy with the self.lock call.

Return the string representation of an action sementic_element: the semantic information of the element such as a line in an accessibility tr

Roll out the agent using teacher forcing actions

get centroids and labels in memory object_cat: object category string or list of category strings

image: 3*H*W mask: H*W or len(objects)*H*W (if hard) or None objects: list of object id, in corresponding order as the mask

Checks if the InteractionObject's object_instance has an attribute with a specified value. Args: attribute (str): Attribute

Args: filepath (str): a string that contains the absolute path, including the file name, where the visualized ima

Get the object matching the id. :param m: output of get_objects() :param obj_id: id to match

:param all_objects_cur_state: List of dictionaries, each of which has key, value pairs corresponding to current properties of an obje

Navigates to the object. Returns: bool: True if action successful, otherwise False.

Update custom properties

Return a valid action object with type CLICK. Keep compatible with the old version.

Gets current state in textual format

Returns: ndarray: the visualized image of shape (H, W, 3) (RGB) in uint8 type. The shape is scale

Return objects held in hand by agents :param event: Simulator event to be used to obtain object properties, usually self.controller.l

Map the urls to their real world counterparts