a h>(@sddlZddlZddlmZddlmZmZmZmZddl m Z ddl m Z m Z ddlmZgdZd d d d d ddZdddddddZGdddeZdS)N)Path)AnyCallableOptionalUnion)Image)download_and_extract_archiveverify_str_arg) VisionDataset)ZkingdomZphylumclassorderfamilyZgenuszRhttps://ml-inat-competition-datasets.s3.amazonaws.com/2017/train_val_images.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2018/train_val2018.tar.gzzOhttps://ml-inat-competition-datasets.s3.amazonaws.com/2019/train_val2019.tar.gzzGhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train.tar.gzzLhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/train_mini.tar.gzzEhttps://ml-inat-competition-datasets.s3.amazonaws.com/2021/val.tar.gz)2017Z2018Z2019 2021_trainZ2021_train_miniZ 2021_validZ 7c784ea5e424efaec655bd392f87301fZ b1c6952ce38f31868cc50ea72d066cc3Z c60a6e2962c9b8ccbd458d12c8582644Z e0526d53c7f7b2e3167b2b43bb2690edZ db6ed8330e634445efc8fec83ae81442Z f6f6e0e242e3d4c9569ba56400938afcc seZdZdZdeeefeeeeefee ee e ee eeefge fddfdd Z dd d d Z dd d d Zeee e fdddZed ddZeeedddZe d ddZdd ddZZS) INaturalistaX`iNaturalist `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory of dataset where the image files are stored. This class does not require/use annotation files. version (string, optional): Which version of the dataset to download/use. One of '2017', '2018', '2019', '2021_train', '2021_train_mini', '2021_valid'. Default: `2021_train`. target_type (string or list, optional): Type of target to use, for 2021 versions, one of: - ``full``: the full category (species) - ``kingdom``: e.g. "Animalia" - ``phylum``: e.g. "Arthropoda" - ``class``: e.g. "Insecta" - ``order``: e.g. "Coleoptera" - ``family``: e.g. "Cleridae" - ``genus``: e.g. "Trichodes" for 2017-2019 versions, one of: - ``full``: the full (numeric) category - ``super``: the super category, e.g. "Amphibians" Can also be a list to output a tuple with all specified target types. Defaults to ``full``. transform (callable, optional): A function/transform that takes in a PIL image and returns a transformed version. E.g, ``transforms.RandomCrop`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. download (bool, optional): If true, downloads the dataset from the internet and puts it in root directory. If dataset is already downloaded, it is not downloaded again. loader (callable, optional): A function to load an image given its path. By default, it uses PIL as its image loader, but users could also pass in ``torchvision.io.decode_image`` for decoding image data into tensors directly. rfullNF)rootversion target_type transformtarget_transformdownloadloaderreturnc st|dt|_tjtj||||dtj |dd|rH| | sXt dg|_ i|_g|_t|tsz|g}|jdddkrdd |D|_|nd d |D|_|g|_t|j D]8\}} ttj|j| } | D]} |j|| fqq||_dS) Nr)rrT)exist_okzHDataset not found or corrupted. You can use download=True to download itZ2021cSs g|]}t|ddgtRqS)rr)r CATEGORIES_2021.0tr!N/var/www/auris/lib/python3.9/site-packages/torchvision/datasets/inaturalist.py fz(INaturalist.__init__..cSsg|]}t|ddqS)r)rsuper)r rr!r!r"r#ir$)r DATASET_URLSkeysrr%__init__ospathjoinmakedirsr _check_exists RuntimeErrorall_categoriescategories_indexcategories_map isinstancelistr _init_2021 _init_pre2021index enumeratelistdirrappendr) selfrrrrrrr dir_indexdir_namefilesfname __class__r!r"r(Fs.   zINaturalist.__init__)rcCstt|j|_ddtD|_t|jD]\}}|d}t |dkrZt d|d|d|dkrt d |dd |di}t t|d d D]J\}}||j|vr|j||}nt |j|}||j||<|||<q|j |q,d S)zInitialize based on 2021 layoutcSsi|] }|iqSr!r!)rkr!r!r" |r$z*INaturalist._init_2021.._zUnexpected category name z, wrong number of piecesrZ05dzUnexpected category id z , expecting rN)sortedr)r8rr/rr0r7splitlenr.zipr1r9)r:r;r<piecesZcat_mapcatnamecat_idr!r!r"r4vs    zINaturalist._init_2021c Cs`dii|_d}tt|j}t|D]\}}||jd|<tttj|j|}|D]}|jdkrx|}|d7}n.z t |}Wn t yt d|Yn0|t |j krt |j }|j ig||d|jdg||d|j |r t d|d|i|j |<tj|||j|<q\q&t|j D]\} } | sZ image_pathimgtargetr r!r!r" __getitem__s       zINaturalist.__getitem__cCs t|jS)N)rHr6r:r!r!r"__len__szINaturalist.__len__) category_type category_idrcCsn|dkr|j|S||jvr.td|dn<|j|D]\}}||kr<|Sqs,