a
h; @ sx d dl Zd dlmZ d dlmZmZmZmZm Z d dl
Z d dl m
Z
ddlmZmZmZ ddlmZ G dd d eZdS )
N)Path)AnyCallablecastOptionalUnion)Image )check_integrity download_and_extract_archiveverify_str_arg)
VisionDatasetc s. e Zd ZdZdZdZdZdZdZdZ dd gd
d gd d
ggZ
ddgddggZ dZ d-e
eef eee ee ee edd fdd
Zee ee dddZeeeef d d d Zed d d!Zd.eee eejeej f d"d#d$Z ed d%d&Z dd d'd(Z ed d)d*Z ee ddd+d,Z Z!S )/STL10a `STL10 `_ Dataset.
Args:
root (str or ``pathlib.Path``): Root directory of dataset where directory
``stl10_binary`` exists.
split (string): One of {'train', 'test', 'unlabeled', 'train+unlabeled'}.
Accordingly, dataset is selected.
folds (int, optional): One of {0-9} or None.
For training, loads one of the 10 pre-defined folds of 1k samples for the
standard evaluation procedure. If no value is passed, loads the 5k samples.
transform (callable, optional): A function/transform that takes in a PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
download (bool, optional): If true, downloads the dataset from the internet and
puts it in root directory. If dataset is already downloaded, it is not
downloaded again.
Z stl10_binaryz9http://ai.stanford.edu/~acoates/stl10/stl10_binary.tar.gzzstl10_binary.tar.gzZ 91f7769df0f17e558f3565bffb0c7dfbzclass_names.txtzfold_indices.txtz train_X.binZ 918c2871b30a85fa023e0c44e0bee87fz train_y.binZ 5a34089d4802c674881badbb80307741zunlabeled_X.binZ 5242ba1fed5e4be9e1e742405eb56ca4z
test_X.binZ 7f263ba9f9e0b06b93213547f721ac82z
test_y.binZ 36f9794fa4beb8a2c72628de14fa638e)traintrain+unlabeled unlabeledtestr NF)rootsplitfolds transformtarget_transformdownloadreturnc s t j|||d t|d| j| _| || _|r<| n| sLt d| | jdkr|
| j d d | j d d \| _ | _
ttj| j
| _
| | n| jdkr>|
| j d d | j d d \| _ | _
ttj| j
| _
| | |
| j d d \}}t| j |f| _ t| j
td g|jd f| _
nj| jd
kr|
| j d d \| _ }td g| j jd | _
n(|
| jd d | jd d \| _ | _
tj| j| j| j} tj | rt | }
|
| _ W d n1 s0 Y d S ) N)r r r zHDataset not found or corrupted. You can use download=True to download itr r r r r )!super__init__r splitsr
_verify_foldsr r _check_integrity RuntimeError_STL10__loadfile
train_listdatalabelsr npndarray_STL10__load_foldsZ concatenateZasarrayshape test_listospathjoinr base_folderclass_names_fileisfileopenread
splitlinesclasses) selfr r r r r r Zunlabeled_data_Z
class_filef __class__ H/var/www/auris/lib/python3.9/site-packages/torchvision/datasets/stl10.pyr / s6
( (
& (
zSTL10.__init__)r r c C sT |d u r |S t |tr:|tdv r&|S d}t||nd}t|t|d S )N
zDValue for argument folds should be in the range [0, 10), but got {}.z>Expected type None or int for argument folds, but got type {}.)
isinstanceintrange
ValueErrorformattype)r5 r msgr: r: r; r [ s
zSTL10._verify_folds)indexr c C sx | j dur&| j| t| j | }}n| j| d }}tt|d}| jdur\| |}| jdurp| |}||fS )z
Args:
index (int): Index
Returns:
tuple: (image, target) where target is index of the target class.
N)r r r ) r% r$ r> r Z fromarrayr& transposer r )r5 rD imgtargetr: r: r; __getitem__g s
zSTL10.__getitem__)r c C s | j jd S )Nr )r$ r) r5 r: r: r; __len__ s z
STL10.__len__) data_file labels_filer c C s d }|rZt j| j| j|}t|d$}tj|tjdd }W d n1 sP0 Y t j| j| j|}t|d8}tj|tjd}t |d}t
|d}W d n1 s0 Y ||fS )Nrb)dtyper )r ` rP )r r rO r ) r+ r, r- r r. r1 r& fromfileZuint8ZreshaperE ) r5 rK rL r% Zpath_to_labelsr7 Z path_to_dataZ
everythingZimagesr: r: r; Z
__loadfile s 2 *zSTL10.__loadfilec C s> | j | j D ],\}}tj| j| j|}t||s dS q dS )NFT)r# r* r+ r, r- r r. r
)r5 filenamemd5Zfpathr: r: r; r s
zSTL10._check_integrityc C s0 | r d S t| j| j| j| jd | d S )N)rR rS )r r urlr rR tgz_md5rI r: r: r; r s zSTL10.downloadc C s dj f i | jS )NzSplit: {split})rA __dict__rI r: r: r;
extra_repr s zSTL10.extra_reprc C s |d u r d S t j| j| j| j}t|h}| | }t j
|t j dd}| j |d d d d d d f | _ | j
d ur| j
| | _
W d n1 s0 Y d S )N )rN sep)r+ r, r- r r. folds_list_filer1 r2 r3 r&
fromstringint64r$ r% )r5 r Z
path_to_foldsr7 Zstr_idxZlist_idxr: r: r; Z __load_folds s
zSTL10.__load_folds)r NNNF)N)"__name__
__module__ __qualname____doc__r. rT rR rU r/ rZ r# r* r r strr r r> r boolr r tupler rH rJ r& r' r" r r rW r(
__classcell__r: r: r8 r; r sF
, (r )os.pathr+ pathlibr typingr r r r r numpyr& ZPILr utilsr
r r Zvisionr
r r: r: r: r; s