o vZh@s~ddlZddlZddlZddlZddlmZmZddlZddlZ ddl m Z ddl m Z mZmZddlmZddlmZddlmZddlmZdd lmZd d lmZd d lmZmZgd Ze e!Z"de#de$fddZ%de$de#fddZ&dej'de(e$fddZ)dej'de(e#fddZ*dej'de(efddZ+iej,dde)fej-dde)fej.dde)fej/dd e+fej#dd e+fej0d!d"e+fej1d!d"e+fej2d#d$e+fej3d%d$e+fej4d%d$e+fej5d&d$e+fej6d&d$e+fej$d'd$e+fej7d'd$e+fej8d'd$e+fej9d(d)e+fej:d*d+e*fej;d*d+e*fejd-d.e+fej?d/d0e*fej@d/d0e*fej3d%d1e+fejAd%d1e+fejBd%d1e+fi ZCd2d3ZD 4 4 5dhd6d7ZEdid8d9ZFdjd;d<ZGd=d>ZHd?d@ZIdkdAdBZJdkdCdDZKdldFdGZL dmdIdJZMdkdKdLZNdndMdNZOdodPdQZPdRdSZQdpdUdVZRdWdXZSdYdZZT dqd\d]ZUdqd^d_ZVdrd`daZWdbdcZXdddeZY drdfdgZZdS)sN)AnyOptional) struct_pb2)HistogramProtoSummarySummaryMetadata) TensorProto)TensorShapeProto) layout_pb2)PrCurvePluginData)TextPluginData)make_np)_prepare_videoconvert_to_HWC) half_to_int int_to_halfhparamsscalar histogram_raw histogrammake_histogramimage image_boxes draw_boxes make_imagevideo make_videoaudiocustom_scalarstext tensor_proto pr_curve_rawpr_curve compute_curvemeshfreturncCtd|}td|dS)aACasts a half-precision float value into an integer. Converts a half precision floating point value, such as `torch.half` or `torch.bfloat16`, into an integer value which can be written into the half_val field of a TensorProto for storage. To undo the effects of this conversion, use int_to_half(). r&irstructpackunpack)r&bufr/N/var/www/auris/lib/python3.10/site-packages/torch/utils/tensorboard/summary.pyr6s rr)cCr()zCasts an integer value to a half-precision float. Converts an integer value obtained from half_to_int back into a floating point value. r)r&rr*)r)r.r/r/r0rCs rtcCsdd|DS)NcSsg|]}t|qSr/)r.0xr/r/r0 Nz'_tensor_to_half_val..flattentolistr1r/r/r0_tensor_to_half_valMsr;cCst|SN)torchZ view_as_realr8r9r:r/r/r0_tensor_to_complex_valPsr>cCs |Sr<r7r:r/r/r0_tensor_to_listSs r?ZDT_HALFZhalf_valZ DT_BFLOAT16DT_FLOAT float_val DT_DOUBLE double_valZDT_INT8Zint_valZDT_UINT8ZDT_INT16ZDT_INT32ZDT_INT64Z int64_valZ DT_COMPLEX32Z scomplex_valZ DT_COMPLEX64ZDT_BOOLZbool_valZ DT_COMPLEX128Z dcomplex_valZ uint32_valcCs,t|tjs |n|}|jtjkrdSdS)Nr ) isinstancenpZndarraynumpydtypeuint8)tensorZ convertedr/r/r0_calc_scale_factorusrKblackc Csddlm} m} | } | |} ||||f\} }}}| j| |f| |f||f||f| |fg||d|ru|}| |\}}}}||||}}td|}| j | ||d|f| ||fg|d| j | ||||f||| d|S)Nr) ImageDraw ImageFont)widthfillg?rM)rQ)rQfont) PILrNrOZ load_defaultZDrawlineZgetbboxrFceilZ rectangler )rZxminZyminZxmaxZymax display_strcolorZ color_textZ thicknessrNrOrRZdrawleftrighttopbottomZ text_bottom_left_top_right_bottom text_widthZ text_heightmarginr/r/r0_draw_single_boxzs6    rbcsjddl}ddlm}m}m}mmm}ddlm }m } m } m } m } ddlm} m}m}tts:tdtdt|tsHtdtd|pKi}t|tsUtd|D]$\}vsrt|trrtfd d |Ds}td d d qYg}|}D]\}|durqt|ttfr||j_|vrtjdd|Dd}nd}| ||!d|dqt|t"r||j_#|vrtjdd|Dd}nd}| ||!d|dqt|t$r||j_%|vr tjdd|Dd}nd}| ||!d|dqt||j&r;t'|d}||j_| ||!ddqt(d| || d}t)t)j*| |+dd}t,t,j!| |dgd}fdd|-D}|||d}| || d }t)t)j*| |+dd}t,t,j!||dgd}||!d!d"}| || d#}t)t)j*| |+dd}t,t,j!| |dgd}|||fS)$a2Output three `Summary` protocol buffers needed by hparams plugin. `Experiment` keeps the metadata of an experiment, such as the name of the hyperparameters and the name of the metrics. `SessionStartInfo` keeps key-value pairs of the hyperparameters `SessionEndInfo` describes status of the experiment e.g. STATUS_SUCCESS Args: hparam_dict: A dictionary that contains names of the hyperparameters and their values. metric_dict: A dictionary that contains names of the metrics and their values. hparam_domain_discrete: (Optional[Dict[str, List[Any]]]) A dictionary that contains names of the hyperparameters and all discrete values they can hold Returns: The `Summary` protobufs for Experiment, SessionStartInfo and SessionEndInfo rN)DataType Experiment HParamInfo MetricInfo MetricNameStatus)EXPERIMENT_TAGPLUGIN_DATA_VERSION PLUGIN_NAMESESSION_END_INFO_TAGSESSION_START_INFO_TAG)HParamsPluginDataSessionEndInfoSessionStartInfoz>parameter: hparam_dict should be a dictionary, nothing logged.z>parameter: metric_dict should be a dictionary, nothing logged.zIparameter: hparam_domain_discrete should be a dictionary, nothing logged.c3s"|] }t|tVqdSr<)rEtyper3d) hparam_dictkr/r0 s zhparams..z"parameter: hparam_domain_discrete[z/] should be a list of same type as hparam_dict[z].cSg|]}tj|dqS)) number_valuerValuerrr/r/r0r5 zhparams..)valuesZDATA_TYPE_FLOAT64)namerqdomain_discretecSrw)) string_valueryrrr/r/r0r5r{ZDATA_TYPE_STRINGcSrw)) bool_valueryrrr/r/r0r5(r{ZDATA_TYPE_BOOL)r}rqz=value should be one of int, float, str, bool, or torch.Tensor)Zsession_start_infoversion plugin_namecontent plugin_data)tagmetadatavaluecsg|] }|ddqS)r)r}r/)r3ru)rfrgr/r0r5J)Z hparam_infosZ metric_infos)Z experimentrZSTATUS_SUCCESS)status)Zsession_end_infor).r=Z#tensorboard.plugins.hparams.api_pb2rcrdrerfrgrhZ$tensorboard.plugins.hparams.metadatarirjrkrlrmZ+tensorboard.plugins.hparams.plugin_data_pb2rnrorprEdictloggerwarning TypeErroritemslistallintfloatrrxrZ ListValueappendrzstrrboolrTensorr ValueErrorr PluginDataSerializeToStringrkeys)rtZ metric_dictZhparam_domain_discreter=rcrdrerhrirjrkrlrmrnrorpvZhpsZssir~rsmdZmtsexpZseir/)rfrgrtrur0rs                   rFc Cst|}|jdksJd|jd|jdt|}|rEt|gdd}|r.t|gdd}tjd d }t|d }ttj |||d gd Sttj ||dgd S)aOutput a `Summary` protocol buffer containing a single scalar value. The generated Summary has a Tensor.proto containing the input Tensor. Args: name: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: A real numeric Tensor containing a single value. collections: Optional list of graph collections keys. The new summary op is added to these collections. Defaults to `[GraphKeys.SUMMARIES]`. new_style: Whether to use new style (tensor field) or old style (simple_value field). New style could lead to faster data loading. Returns: A scalar `Tensor` of type `string`. Which contains a `Summary` protobuf. Raises: ValueError: If tensor has the wrong shape or type. rzBTensor should contain one element (0 dimensions). Was given size: z and z dimensions.r@)rArHrB)rCrHZscalarsrrrrJrr)rZ simple_value) rsqueezendimsizerrrrrrz) r}rJ collections new_styleZdouble_precisionrr!rrr/r/r0rbs(     rc Cs||jdkr td|jtvr3t|j\}}}tdid|dtdd|jDd|||i}n t|d|jtj d d }t|d }t t j |||d gd S)aOutputs a `Summary` protocol buffer containing the full tensor. The generated Summary has a Tensor.proto containing the input Tensor. Args: tag: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: Tensor to be converted to protobuf Returns: A tensor protobuf in a `Summary` protobuf. Raises: ValueError: If tensor is too big to be converted to protobuf, or tensor data type is not supported lzAtensor is bigger than protocol buffer's hard limit of 2GB in sizerH tensor_shapecSrw)r)r Dimr2r/r/r0r5sz tensor_proto..dimz has unsupported tensor dtype rJrrrrrJrNr/) ZnumelitemsizerrH_TENSOR_TYPE_MAPrr shaperrrrz)rrJrH field_nameZ conversion_fnr!rrr/r/r0r!s$    r!c Cs,t|||||||d}ttj||dgdS)aOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. min: A float or int min value max: A float or int max value num: Int number of values sum: Float or int sum of all values sum_squares: Float or int sum of squares for all values bucket_limits: A numeric `Tensor` with upper value per bucket bucket_counts: A numeric `Tensor` with number of values per bucket Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. minmaxnumsum sum_squaresZ bucket_limitZbucketrZhistor)rrrz) r}rrrrrZ bucket_limitsZ bucket_countshistr/r/r0rs rcCs0t|}t|t||}ttj||dgdS)adOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. This op reports an `InvalidArgument` error if any value is not finite. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. values: A real numeric `Tensor`. Any shape. Values to use to build the histogram. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rr)rrastyperrrz)r}r|binsmax_binsrr/r/r0rsrc Cs|jdkr td|d}tj||d\}}t|}|dure||kre||}||}|dkr=tj|d||ggddd}|d|jdd}t|jd f|j }|dd||dd<|d|d<|}t t |d} tj | d| dd gd d \} } t | } t | d } ~ | dkr|| d | n tdg|d| g}|| | d }|jdks|jdkrtd ||} t||t||| ||d S)zDConvert values into a histogram proto using logic from histogram.cc.rzThe input has no element.)rNZconstant)Z pad_widthmodeZconstant_values)Zaxisr rY)Zsidez1The histogram is empty, please file a bug report.r)rrreshaperFrlenpadremptyrHcumsumZgreaterZ searchsortedrZ concatenatedotrrrr9) r|rrcountsZlimitsZnum_binsZ subsamplingZsubsampling_remainderZ new_limits cum_countsstartendZsum_sqr/r/r0rsP      . rNCHWcCs`t|}t||}t|}|tj}||ddtj}t||d}t t j ||dgdS)aJOutput a `Summary` protocol buffer with images. The summary has up to `max_images` summary values containing images. The images are built from `tensor` which must be 3-D with shape `[height, width, channels]` and where `channels` can be: * 1: `tensor` is interpreted as Grayscale. * 3: `tensor` is interpreted as RGB. * 4: `tensor` is interpreted as RGBA. The `name` in the outputted Summary.Value protobufs is generated based on the name, with a suffix depending on the max_outputs setting: * If `max_outputs` is 1, the summary value tag is '*name*/image'. * If `max_outputs` is greater than 1, the summary value tags are generated sequentially as '*name*/image/0', '*name*/image/1', etc. Args: tag: A name for the generated node. Will also serve as a series name in TensorBoard. tensor: A 3-D `uint8` or `float32` `Tensor` of shape `[height, width, channels]` where `channels` is 1, 3, or 4. 'tensor' can either have values in [0, 1] (float32) or [0, 255] (uint8). The image() function will scale the image values to [0, 255] by applying a scale factor of either 1 (uint8) or 255 (float32). Out-of-range values will be clipped. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rrD)rescalerrr) rrrKrrFfloat32cliprIrrrz)rrJr dataformats scale_factorrr/r/r0r s   rCHWcCsdt|}t||}t|}|tjt|}t|ddtj|||d}t t j ||dgdS)z/Output a `Summary` protocol buffer with images.rrD)rroislabelsrr) rrrrFrrKrrrIrrz)rZ tensor_imageZ tensor_boxesrrrrr/r/r0rEs rc Csf|jd}t|}|D]%}t|||df||df||df||df|dur)dn||dd}q |S)Nrr rMRed)rVrW)rrangerb)Z disp_imageZboxesrZ num_boxesZlist_gtr)r/r/r0rVs      rcCsddlm}|j\}}}t||}t||} ||} |dur(t| ||d} |jj} | | |f| } ddl } | } | j | dd| }| tj||||dS)z=Convert a numpy representation of an image to Image protobuf.r)ImageN)rZPNG)formatheightrPZ colorspaceZencoded_image_string)rSrrrZ fromarrayrZ ResamplingZLANCZOSresizeioBytesIOsavegetvaluecloser)rJrrrrrrPZchannelZ scaled_heightZ scaled_widthrZ ANTIALIASroutputZ image_stringr/r/r0rgs(     rcCs\t|}t|}t|}|tj}||ddtj}t||}t t j ||dgdS)NrrDrr) rrrKrrFrrrIrrrz)rrJfpsrrr/r/r0rs  rc Cs`zddl}WntytdYdSwzddlm}Wnty,tddYdSwddl}|j\}}}}|jt||d} |jddd j } z | j | ddd Wn$t ywz | j | ddd Wnt yt| j | dd YnwYnwt | d  } | } Wdn1swYzt| WntytdYnwtj|||| dS)Nrzadd_video needs package moviepy)editorz6moviepy is installed, but can't import moviepy.editor.z2Some packages could be missing [imageio, requests])rz.gifF)suffixdelete)verboser)r progress_bar)rrbz5The temporary file used by moviepy cannot be deleted.r)moviepy ImportErrorprintrtempfilerZImageSequenceCliprNamedTemporaryFiler}Z write_gifropenreadosremoveOSErrorrrrr) rJrrZmpyrZ_thwcrfilenamer&Z tensor_stringr/r/r0rsP        rDc Cs t|}|}t|dkrtd|dd}|jdks#Jd|ttj j d}ddl }ddl }| }||d}|d|d||||jWdn1sawY|}|tj|d|jd|d d } ttj|| d gd S) Nr z4warning: audio amplitude out of range, auto clipped.rz%input tensor should be 1 dimensional.zg?r r)rrrr) rFint32floorrfloat64rrmaximumr)rrrrZ_MINIMUM_COUNTZbucket_indicesZ float_labelsZhistogram_rangeZ tp_buckets_Z fp_bucketsrrrrrrr/r/r0r$>s2       r$c Csddl}ddlm}||}|j|||||j||d} td|dt t j |jddt j |jddt j |jd dgd d }t j | |||| d } | S) aCreate a tensor summary with summary metadata. Args: name: Uniquely identifiable name of the summary op. Could be replaced by combination of name and type to make it unique even outside of this summary. display_name: Will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. tensor: Tensor to display in summary. content_type: Type of content inside the Tensor. components: Bitmask representing present parts (vertices, colors, etc.) that belong to the summary. json_config: A string, JSON-serialized dictionary of ThreeJS classes configuration. Returns: Tensor summary with metadata. rNr) json_configr@rrr rMrrr)r=tensorboard.plugins.meshrZ as_tensorZcreate_summary_metadatarrrr9r rrrzZget_instance_name) r} display_name descriptionrJr componentsr#r=rZtensor_metadataZtensor_summaryr/r/r0_get_tensor_summary_s8     r(cCsd}|dur tj|dd}|S)z5Parse and returns JSON string from python dictionary.z{}NT) sort_keys)jsondumps) config_dictr#r/r/r0_get_json_configsr-c Csddlm}ddlm}t|} g} ||jf||jf||jfg} dd| D} |dd| D} | D]\} }| t |||| || | q3t | dS)a'Output a merged `Summary` protocol buffer with a mesh/point cloud. Args: tag: A name for this summary operation. vertices: Tensor of shape `[dim_1, ..., dim_n, 3]` representing the 3D coordinates of vertices. faces: Tensor of shape `[dim_1, ..., dim_n, 3]` containing indices of vertices within each triangle. colors: Tensor of shape `[dim_1, ..., dim_n, 3]` containing colors for each vertex. display_name: If set, will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. config_dict: Dictionary with ThreeJS classes names and configuration. Returns: Merged summary for mesh/point cloud representation. rr")MeshPluginDatacSsg|] }|ddur|qS)rNr/)r3rJr/r/r0r5rzmesh..cSsg|]\}}|qSr/r/)r3rJrr/r/r0r5r6r) r$rZ(tensorboard.plugins.mesh.plugin_data_pb2r.r-ZVERTEXZFACEZCOLORZget_components_bitmaskrr(r)rZverticescolorsZfacesr,r%r&rr.r#Z summariesZtensorsr'rJrr/r/r0r%s2     r%)rLrLrM)NNN)NFFr<)r r)r rN)r NN)r)r)rN)NN)[r*loggingrr+typingrrr=rGrFZgoogle.protobufrZ$tensorboard.compat.proto.summary_pb2rrrZ#tensorboard.compat.proto.tensor_pb2rZ)tensorboard.compat.proto.tensor_shape_pb2r Z!tensorboard.plugins.custom_scalarr Z,tensorboard.plugins.pr_curve.plugin_data_pb2r Z(tensorboard.plugins.text.plugin_data_pb2r Z _convert_npr_utilsrr__all__ getLogger__name__rrrrrrrr;r>r?ZhalfZfloat16Zbfloat16rrdoubleZint8rIZqint8rZshortrZqint32Zint64Z complex32ZchalfZ complex64ZcfloatrZ complex128ZcdoubleZquint8Zquint4x2rrKrbrrr!rrrrrrrrrrrr r"r#r$r(r-r%r/r/r/r0s                                      + >+% !  7&    +%  !;