o wZh17@s,dZddlmZddlZddlZddlZddlmZmZddlm Z ddl Z ddl m Z ddl m Z ddlmZed Zd d hZejGd d d ZddddNddZdddOdd ZdPd!d"Z #dQdRd0d1Zd2d3ZdSd6d7ZdTdd?ZdVdAdBZdWdEdFZdXdHdIZdXdJdKZ dXdLdMZ!dS)YzFUtilities for manipulating the torch.Graph object and the torchscript.) annotationsN)IterableSequence)Any)_C)GLOBALS) registrationz^(.+)_(([ifstgz])|(ty))$Zinplaceatenc@seZdZUdZded<ded<ded<ded <d ed <d ed <ded<ejedZded<d*ddZ ddd+dd Z d!d"d,d%d&Z e Z ddd-d'd(Z d)S). GraphContextaExtra context for symbolic functions with all methods from torch.Graph. NOTE: This class is not meant for external consumption. Please do not depend on it outside of torch.onnx as the interface may evolve. Attributes: graph: The _C.Graph being constructed. block: The current _C.Block being constructed. opset: The opset version. original_node: Current node that is being converted from. params_dict: Mapping from graph initializer name to IValue. env: Mapping from Torch domain graph Value to ONNX domain graph Value. values_in_env: Set of all values in env, for constant-time lookups. new_nodes: List that tracks all new nodes that are added (used to make sure metadata is propagated to all new nodes). z_C.Graphgraphz_C.Blockblockintopset_C.NodeZ original_nodezdict[str, _C.IValue] params_dictzdict[_C.Value, _C.Value]envz set[_C.Value]Z values_in_env)default_factoryz list[_C.Node] new_nodesnamestrreturnrcCs t|j|SN)getattrr )selfrrM/var/www/auris/lib/python3.10/site-packages/torch/onnx/_internal/jit_utils.py __getattr__7s zGraphContext.__getattr__outputsopnameraw_argstorch.Tensor | _C.ValuercOst||g|Rd|i|S)aCreates an ONNX operator "opname", taking "raw_args" as inputs and "kwargs" as attributes. The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md Args: opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). r)_add_op)rr rr!kwargsrrrop:s#zGraphContext.op) overload_nameoperatorr'cOs|jdg|R||d|S)z~Generates an ONNX ATen op node. This function is for backward compatibility with the old symbolic functions. z aten::ATen)Z operator_sZoverload_name_s)r%)rr(r'argsr$rrraten_op_szGraphContext.aten_opcOsH|jjd|j}|jj}t|||t||g|Rd|i|S)aCreates an ONNX operator from onnx-script function, taking "raw_args" as inputs and "kwargs" as attributes. onnx-script repository: https://github.com/microsoft/onnx-script Args: onnx_fn: ONNXFunction from onnx-script; An example can be found at https://github.com/microsoft/onnx-script#example raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). ::r)rdomainrversionrZcustom_onnx_symbolicr#)rZonnx_fnrr!r$Z symbolic_name opset_versionrrr onnxscript_opps#zGraphContext.onnxscript_opN)rrrr)r rr!r"rr )r(rr'r)r!r"rr )__name__ __module__ __qualname____doc____annotations__ dataclassesfieldlistrrr%r*atr/rrrrr s"  %r r)rn_blocks graph_contextr rinputs_C.Valuerr r9r-tuple[Any, tuple[GraphContext, ...], _C.Node]c Os||j|g|Rd|i|}t|tr|d}n|}g}t|D]} |} tj|| d} || q$|t ||fS)aPCreates an ONNX operator "opname", taking inputs and attributes. Args: graph_context: The context for the current graph. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. inputs: The inputs to the operator. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. n_blocks: The number of sub-blocks to create in the node. attributes: The attributes of the ONNX operator. Returns: A tuple of (output_values, new_contexts, node) where: output_values: One or more output value of this operator (see the `outputs` keyword argument for multi-return nodes). new_contexts: A tuple of new graph contexts for each sub-block. node: The node representing the operator. rr)r ) r% isinstancernoderangeZaddBlockr5replaceappendtuple) r:r rr9r; attributesZ output_valuesr?Z new_contexts_Z new_blockZ new_contextrrradd_op_with_blockss   rFrr)r"c s|fdd|D}dd|D}d|vrd|}tj|||jj|tjd}j||dkr8| St | S) a@Creates an ONNX operator "opname", taking "args" as inputs and attributes "kwargs". The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md This function is monkey-patched onto Graph. Args: graph_context: The Torch Graph or Block. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: (Union[_C.Value, Tuple[_C.Value, ...]]) The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). csg|]}t|qSr)_const_if_tensor).0argr:rr sz_add_op..cSsi|] \}}|dur||qSrr)rHkvrrr sz_add_op..r+zonnx::)rr. n_outputsshape_inferencer) items _create_noder rrrZonnx_shape_inferencerrBoutputrCr)r:r rr)r$r;rDr?rrJrr#s$&  r#cCs*|dur|St|tjr|St|d|dS)Nzonnx::Constant)Zvalue_z)r>rValuer#)r:rIrrrrG s  rGTgraph_or_block_C.Graph | _C.Block domain_oprrDdictrr.rOrPboolrcCst|tjr|}||||} || } nt|tjr3|} | ||} |dkr3td|D]} | q,t | } t | |ksAJ| d} t |D]\}}|tvrUqLt| ||| dqL|rgt| ||| S)z:Creates an node 'domain_op', taking inputs and attributes.rzaten::)r )r>rZGraphcreateZ insertNodeZBlockZaddNoder@Z addOutputrCrlen startswithsortedrQ_SKIP_NODE_ATTRIBUTES_add_attributeZ(_jit_pass_onnx_node_shape_type_inference)rUrWr;rDrr.rOrPr r?r rEZ node_outputsr keyvaluerrrrRs(       rRcCst|tot|tttjf Sr)r>rrbytestorchZTensor)rarrr _is_onnx_list9s  rdx torch.TensorcCs|dksJ|dS)z,Convert a scalar tensor into a Python value.rr)Znumelrerrr_scalar?srhr?r`rarcCs^t|}|durtd|d|d|d}}t|r$|d7}t||d||S)z7Initializes the right attribute based on type of value.NzInvalid attribute specifier 'z<' names must be suffixed with type, e.g. 'dim_i' or 'dims_i'rsrE) _ATTR_PATTERNmatch ValueErrorgrouprdr)r?r`rar mrkindrrrr_Es  r_cCs|tjSr)typeZ isSubtypeOfr TensorTypegetrgrrr _is_tensorUsrttorch.device | NonecCs&t|sdSttj|}|Sr)rttypingcastrrrrqZdevice)raZ tensor_typerrrget_device_from_valueYsrxrptuple[str, str]cCsHd|vr td|d|dd\}}d|vr td|d||fS)z(Parse node kind into domain and Op name.r+z Node kind: z& is invalid. '::' is not in node kind.rz) is invalid. '::' should only apear once.)rmsplit)rpr,r rrrparse_node_kind`s r{r,cC|dkS) Check if the domain is official.r rr,rrris_atenjrcCr|)r}Zprimrr~rrris_primorrcCr|)r}Zonnxrr~rrris_onnxtrr) r:r r rr;r<rr r9r rr=)r:r r rr)r"rr )r:r )T)rUrVrWrr;rrDrXrrXr.r rOr rPrYrr)rerf)r?rr`rrarr rY)rer<rrY)rar<rru)rprrry)r,rrrY)"r3 __future__rr5rervcollections.abcrrrrcrZtorch.onnx._globalsrZtorch.onnx._internalrcompilerkr^ dataclassr rFr#rGrRrdrhr_rtrxr{rrrrrrrsB      3 ? '