a h@sddlZddlZddlZddlmZddlmZmZddlm Z ddl m Z m Z ddgZ ee e fZeeeedffZd d Zeeeeeed d d ZeedddZdeeeedddZeeeeedddZdS)N) Collection)OptionalUnion)dill_available) IterDataPipe MapDataPipetraverse traverse_dps DataPipeGraphcCsdS)NZSTUBr r r D/var/www/auris/lib/python3.9/site-packages/torch/utils/data/graph.py_stub_unpicklersr )scan_obj only_datapipecachereturnc s<t}t|}tr.ddlm}||}nd}gdd}fdd}ttf} z| D]} | ||r\| |q\z| Wn.tj t t fytr| nYn0W| D]} | d|r| dqtrddlm} | dn@| D]} | d|r| dqtr6ddlm} | d0S) Nr)PicklercSsd}t|tr>i}|D] \}}t|tttfr|||<qnLt|ttfrvg}|D]}t|tttfrT||qTnt|tttfr|}|S)N) isinstancedictitemsrrrtuplelistappend)Z ori_statestatekvr r r getstate_hook's  z0_list_connected_datapipes..getstate_hookcs>|kst|vrtn |t|tdfSdS)Nr )idNotImplementedErrorraddr )objrZcaptured_connectionsrr r reduce_hook7s  z._list_connected_datapipes..reduce_hook)extendF)ioBytesIOpicklerrZdillrrZset_reduce_ex_hookZset_getstate_hookdump PickleErrorAttributeError TypeErrorr#) rrrfpZ dill_Picklerdrr"Zdatapipe_classesclsZ dill_extendr r!r _list_connected_datapipessL               r/)datapipercCst}t|d|dS)a Traverse the DataPipes and their attributes to extract the DataPipe graph. This only looks into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Args: datapipe: the end DataPipe of the graph Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph T)rr)set_traverse_helper)r0rr r r r Zs)r0rrcCs:d}|s|d7}t|t|dur(d}t}t|||S)a6 Traverse the DataPipes and their attributes to extract the DataPipe graph. [Deprecated] When ``only_dataPipe`` is specified as ``True``, it would only look into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Note: This function is deprecated. Please use `traverse_dps` instead. Args: datapipe: the end DataPipe of the graph only_datapipe: If ``False`` (default), all attributes of each DataPipe are traversed. This argument is deprecating and will be removed after the next release. Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph zV`traverse` function and will be removed after 1.13. Please use `traverse_dps` instead.zM And, the behavior will be changed to the equivalent of `only_datapipe=True`.NF)warningswarn FutureWarningr1r2)r0rmsgrr r r rls )r0rrrcCst|ttfs"tdt|dt|}||vr6iS||t|||}||ifi}|D]"}||d t |||q`|S)Nz.Expected `IterDataPipe` or `MapDataPipe`, but z is found) rrr RuntimeErrortyperrr/copyupdater2)r0rrZdp_idrr-itemr r r r2s   r2)N)r$r&r3collections.abcrtypingrrZtorch.utils._import_utilsrZ#torch.utils.data.datapipes.datapiperr__all__ZDataPiperintrr r boolr1rr/r rr2r r r r s$     C#