ɯwg\ddlZddlmZmZddlmZmZd defdZ d dZ dZ d Z d d Z d Zy)N) tree_flattentree_unflatten)add_step_closurerun_step_closuresdevicecptjjj|g|t y)aVTriggers a mark step, which amounts to - collecting a group of 'live' lazy tensors to index into the compilation cache (lowering/compiling their IR graphs if not cached) - kicking off execution of the compiled function - (optionally, wait=True) waiting for cpu-side execution to complete (does not sync the accelerator) )waitN)torch_C_lazy _mark_stepr)rr s Y/home/mcse/projects/flask/flask-venv/lib/python3.12/site-packages/torch/_lazy/__init__.py mark_stepr s' HHNNfbt4c`|g}tjjj|y)zWaits for all the async operations on the given devices to complete. Args: devices (string..., optional): The devices whose async ops need to be waited for. If empty, all the local devices will be waited for. Ndevices)r r r _wait_device_opsrs rwait_device_opsrs'  HHNN##G#4rcXtjjj||y)z Sync the list of lazy tensors so there IR get lowered for the activate backend and the compiled computation graph get cached. N)r r r _sync_multi)tensorsrs r sync_multir!s  HHNNw0rcTtjjj|S)z7Return a unique id of the lazy tensor maintained by LTC)r r r _get_tensor_id)tensors r get_tensor_idr)s 88>> ( ( 00rc|xsdg}t|\}}t||t|Dcgc]}|jdc}|Scc}w)Nlazycpu)rrrto)rr flattenedspects rto_cpur&.sI!&G"7+OIty'"  :1144;:D AA:sA cHtjt|g|i|yN)r saver&)rargskwargss rr)r)6s JJvg000r)Fr()torch._C._lazyr torch.utils._pytreerrclosurerrstrrrrrr&r)rrr2s6<8 c 511 B1r