In order to explore the space of learning problems standing between *mnist-back-rand* and *mnist-back-images*, we set up an experiment where we could vary the amount of background pixel correlation. We are hence assuming that background correlation is the main characteristic that distinguishes *mnist-back-images* from *mnist-back-random*.

Correlated pixel noise was sampled from a zero-mean multivariate Gaussian distribution of dimension equal to the number of pixels: . The covariance matrix, , was defined as a convex combination of an identity matrix and a Gaussian kernel function. Representing the position of the th pixel with the vector , we have:

with kernel bandwidth . The Gaussian kernel induced a neighborhood correlation structure among pixels such that nearby pixels are more correlated that pixels further apart. For each sample from , the pixel values (ranging from 0 to 1) were determined by passing elements of through an error function:

We generated six datasets with varying degrees of neighborhood correlation by setting the mixture weight to the values . The marginal distributions for each pixel is uniform(0,1) for each value of .

All the datasets are provided as zip archives. Each archive contains two files -- a training (and validation) set and a test set. We used the last 2000 examples of the training sets as validation sets in all cases but for *rectangles* (200) and, in the case of SVMs, retrained the models with the entire set after choosing the optimal parameters on these validation sets. Data is stored at one example per row, the features being space-separated. There are 784 features per example (=28*28 images), corresponding to the first 784 columns of each row. The last column is the label, which is 0 to 9 for the MNIST variations and 1 or 0 for the *rectangles*, *rectangles-images* and *convex* datasets.

Link to dataset | Size | File description |
---|---|---|

MNIST noise variation sets | 304M packed; 1008M unpacked | 6x12000 train, 6x2000 test |

Please contact us if you are interested in the (MATLAB) scripts that we used to generate this data.

-- DumitruErhan - 21 Jun 2007

Show attachmentsHide attachments

I | Attachment | Action | Size | Date | Who | Comment |
---|---|---|---|---|---|---|

png | noise_variations.png | manage | 218.3 K | 21 Jun 2007 - 11:08 | DumitruErhan | MNIST noise variations |

Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.

Ideas, requests, problems regarding TWiki? Send feedback

Ideas, requests, problems regarding TWiki? Send feedback