Experiment 1: Amazon Products
Basic information
- Task: Product classification (of product reviews)
- Dataset: Amazon Products
- Classes: Clothing Shoes and Jewelry, Digital Music, Office Products, Toys and Games (4 classes)
- Train/Dev/Test examples: 100 / 100 / 20000
- Problem: The training data is very small.
- For more details, please see section 5 in the paper.
Word Clouds & Annotations
Model 1: AmazonProductsSmall_CNN_20200510185541
| Feature 0 | Feature 1 | Feature 2 | Feature 3 | Feature 4 | Feature 5 | Feature 6 | Feature 7 | Feature 8 | Feature 9 | Feature 10 | Feature 11 | Feature 12 | Feature 13 | Feature 14 | Feature 15 | Feature 16 | Feature 17 | Feature 18 | Feature 19 | Feature 20 | Feature 21 | Feature 22 | Feature 23 | Feature 24 | Feature 25 | Feature 26 | Feature 27 | Feature 28 | Feature 29 |
 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |
| Model weights: - Clothing Shoes and Jewelry = -0.150 - Digital Music = -0.052 - Office Products = -0.408 - Toys and Games = 0.261 | Model weights: - Clothing Shoes and Jewelry = 0.447 - Digital Music = 0.147 - Office Products = 0.173 - Toys and Games = -0.267 | Model weights: - Clothing Shoes and Jewelry = 0.018 - Digital Music = 0.392 - Office Products = 0.373 - Toys and Games = 0.411 | Model weights: - Clothing Shoes and Jewelry = -0.295 - Digital Music = -0.160 - Office Products = 0.049 - Toys and Games = 0.266 | Model weights: - Clothing Shoes and Jewelry = 0.001 - Digital Music = -0.195 - Office Products = -0.309 - Toys and Games = -0.430 | Model weights: - Clothing Shoes and Jewelry = -0.380 - Digital Music = -0.140 - Office Products = 0.018 - Toys and Games = -0.157 | Model weights: - Clothing Shoes and Jewelry = -0.493 - Digital Music = 0.230 - Office Products = 0.395 - Toys and Games = 0.401 | Model weights: - Clothing Shoes and Jewelry = 0.193 - Digital Music = -0.019 - Office Products = 0.130 - Toys and Games = -0.223 | Model weights: - Clothing Shoes and Jewelry = 0.242 - Digital Music = 0.140 - Office Products = 0.368 - Toys and Games = 0.268 | Model weights: - Clothing Shoes and Jewelry = 0.180 - Digital Music = -0.468 - Office Products = -0.138 - Toys and Games = -0.328 | Model weights: - Clothing Shoes and Jewelry = 0.301 - Digital Music = -0.022 - Office Products = 0.442 - Toys and Games = -0.314 | Model weights: - Clothing Shoes and Jewelry = -0.347 - Digital Music = -0.180 - Office Products = -0.063 - Toys and Games = 0.311 | Model weights: - Clothing Shoes and Jewelry = 0.416 - Digital Music = 0.019 - Office Products = -0.085 - Toys and Games = 0.460 | Model weights: - Clothing Shoes and Jewelry = 0.090 - Digital Music = 0.284 - Office Products = -0.106 - Toys and Games = 0.164 | Model weights: - Clothing Shoes and Jewelry = -0.305 - Digital Music = 0.398 - Office Products = 0.333 - Toys and Games = 0.112 | Model weights: - Clothing Shoes and Jewelry = 0.337 - Digital Music = 0.119 - Office Products = -0.286 - Toys and Games = 0.171 | Model weights: - Clothing Shoes and Jewelry = 0.054 - Digital Music = 0.305 - Office Products = 0.111 - Toys and Games = -0.415 | Model weights: - Clothing Shoes and Jewelry = -0.063 - Digital Music = -0.265 - Office Products = -0.081 - Toys and Games = 0.398 | Model weights: - Clothing Shoes and Jewelry = -0.025 - Digital Music = 0.121 - Office Products = -0.251 - Toys and Games = -0.335 | Model weights: - Clothing Shoes and Jewelry = 0.242 - Digital Music = 0.446 - Office Products = -0.119 - Toys and Games = 0.160 | Model weights: - Clothing Shoes and Jewelry = -0.091 - Digital Music = 0.116 - Office Products = -0.062 - Toys and Games = -0.129 | Model weights: - Clothing Shoes and Jewelry = -0.492 - Digital Music = 0.096 - Office Products = 0.122 - Toys and Games = -0.327 | Model weights: - Clothing Shoes and Jewelry = -0.118 - Digital Music = -0.098 - Office Products = 0.225 - Toys and Games = 0.305 | Model weights: - Clothing Shoes and Jewelry = 0.434 - Digital Music = 0.023 - Office Products = -0.160 - Toys and Games = 0.222 | Model weights: - Clothing Shoes and Jewelry = 0.257 - Digital Music = -0.267 - Office Products = 0.331 - Toys and Games = -0.412 | Model weights: - Clothing Shoes and Jewelry = -0.280 - Digital Music = 0.428 - Office Products = -0.102 - Toys and Games = -0.402 | Model weights: - Clothing Shoes and Jewelry = -0.287 - Digital Music = -0.470 - Office Products = 0.488 - Toys and Games = 0.262 | Model weights: - Clothing Shoes and Jewelry = 0.345 - Digital Music = -0.428 - Office Products = -0.191 - Toys and Games = -0.437 | Model weights: - Clothing Shoes and Jewelry = 0.389 - Digital Music = 0.364 - Office Products = -0.078 - Toys and Games = -0.417 | Model weights: - Clothing Shoes and Jewelry = -0.430 - Digital Music = -0.039 - Office Products = -0.144 - Toys and Games = -0.370 |
| Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 4 - Office Products = 1 - Toys and Games = 0 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 9 - Digital Music = 0 - Office Products = 0 - Toys and Games = 1 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 2 - Office Products = 0 - Toys and Games = 2 - None = 6 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 1 - Toys and Games = 0 - None = 9 | Human answers: - Clothing Shoes and Jewelry = 6 - Digital Music = 0 - Office Products = 0 - Toys and Games = 1 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 9 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 2 - Office Products = 6 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 2 - Digital Music = 0 - Office Products = 1 - Toys and Games = 1 - None = 6 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 10 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 10 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 8 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 2 - None = 8 | Human answers: - Clothing Shoes and Jewelry = 2 - Digital Music = 0 - Office Products = 0 - Toys and Games = 6 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 10 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 2 - Digital Music = 2 - Office Products = 0 - Toys and Games = 4 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 9 - Office Products = 0 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 4 - Office Products = 0 - Toys and Games = 0 - None = 6 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 6 - Toys and Games = 1 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 2 - Office Products = 5 - Toys and Games = 1 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 9 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 4 - Toys and Games = 0 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 2 - Digital Music = 0 - Office Products = 4 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 10 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 3 - Digital Music = 5 - Office Products = 0 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 |
| Summary: - Average score: 0.213 - Rank: C | Summary: - Average score: 0.900 - Rank: B | Summary: - Average score: 0.391 - Rank: C | Summary: - Average score: 0.061 - Rank: C | Summary: - Average score: 0.600 - Rank: C | Summary: - Average score: 0.960 - Rank: A | Summary: - Average score: 0.758 - Rank: B | Summary: - Average score: 0.285 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.881 - Rank: B | Summary: - Average score: 0.200 - Rank: C | Summary: - Average score: 0.784 - Rank: B | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.907 - Rank: B | Summary: - Average score: 0.624 - Rank: B | Summary: - Average score: 0.900 - Rank: B | Summary: - Average score: 0.000 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.627 - Rank: B | Summary: - Average score: 0.515 - Rank: C | Summary: - Average score: 0.900 - Rank: B | Summary: - Average score: 0.490 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.438 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.784 - Rank: B | Summary: - Average score: 1.000 - Rank: A |
Model 2: AmazonProductsSmall_CNN_20200510191020
| Feature 0 | Feature 1 | Feature 2 | Feature 3 | Feature 4 | Feature 5 | Feature 6 | Feature 7 | Feature 8 | Feature 9 | Feature 10 | Feature 11 | Feature 12 | Feature 13 | Feature 14 | Feature 15 | Feature 16 | Feature 17 | Feature 18 | Feature 19 | Feature 20 | Feature 21 | Feature 22 | Feature 23 | Feature 24 | Feature 25 | Feature 26 | Feature 27 | Feature 28 | Feature 29 |
 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |
| Model weights: - Clothing Shoes and Jewelry = 0.015 - Digital Music = 0.345 - Office Products = 0.018 - Toys and Games = -0.206 | Model weights: - Clothing Shoes and Jewelry = 0.243 - Digital Music = -0.188 - Office Products = 0.471 - Toys and Games = 0.040 | Model weights: - Clothing Shoes and Jewelry = -0.099 - Digital Music = -0.253 - Office Products = -0.419 - Toys and Games = 0.249 | Model weights: - Clothing Shoes and Jewelry = -0.345 - Digital Music = -0.200 - Office Products = 0.013 - Toys and Games = -0.105 | Model weights: - Clothing Shoes and Jewelry = -0.220 - Digital Music = 0.148 - Office Products = -0.306 - Toys and Games = 0.435 | Model weights: - Clothing Shoes and Jewelry = 0.220 - Digital Music = -0.245 - Office Products = -0.302 - Toys and Games = -0.264 | Model weights: - Clothing Shoes and Jewelry = 0.274 - Digital Music = -0.326 - Office Products = 0.476 - Toys and Games = 0.205 | Model weights: - Clothing Shoes and Jewelry = -0.220 - Digital Music = 0.087 - Office Products = 0.106 - Toys and Games = 0.238 | Model weights: - Clothing Shoes and Jewelry = -0.170 - Digital Music = 0.228 - Office Products = 0.431 - Toys and Games = -0.107 | Model weights: - Clothing Shoes and Jewelry = 0.406 - Digital Music = 0.233 - Office Products = -0.412 - Toys and Games = -0.226 | Model weights: - Clothing Shoes and Jewelry = -0.115 - Digital Music = 0.369 - Office Products = -0.139 - Toys and Games = -0.238 | Model weights: - Clothing Shoes and Jewelry = 0.319 - Digital Music = 0.392 - Office Products = 0.009 - Toys and Games = -0.075 | Model weights: - Clothing Shoes and Jewelry = 0.166 - Digital Music = 0.428 - Office Products = -0.192 - Toys and Games = 0.127 | Model weights: - Clothing Shoes and Jewelry = -0.391 - Digital Music = 0.163 - Office Products = -0.462 - Toys and Games = -0.111 | Model weights: - Clothing Shoes and Jewelry = 0.277 - Digital Music = -0.320 - Office Products = -0.102 - Toys and Games = 0.144 | Model weights: - Clothing Shoes and Jewelry = -0.440 - Digital Music = 0.456 - Office Products = 0.436 - Toys and Games = 0.372 | Model weights: - Clothing Shoes and Jewelry = 0.345 - Digital Music = -0.323 - Office Products = -0.497 - Toys and Games = 0.155 | Model weights: - Clothing Shoes and Jewelry = -0.003 - Digital Music = -0.149 - Office Products = 0.375 - Toys and Games = -0.198 | Model weights: - Clothing Shoes and Jewelry = -0.058 - Digital Music = -0.238 - Office Products = 0.264 - Toys and Games = 0.301 | Model weights: - Clothing Shoes and Jewelry = 0.157 - Digital Music = -0.053 - Office Products = -0.189 - Toys and Games = 0.322 | Model weights: - Clothing Shoes and Jewelry = 0.386 - Digital Music = 0.150 - Office Products = 0.457 - Toys and Games = 0.167 | Model weights: - Clothing Shoes and Jewelry = -0.047 - Digital Music = 0.369 - Office Products = 0.335 - Toys and Games = 0.006 | Model weights: - Clothing Shoes and Jewelry = 0.355 - Digital Music = -0.323 - Office Products = 0.217 - Toys and Games = -0.194 | Model weights: - Clothing Shoes and Jewelry = -0.356 - Digital Music = -0.494 - Office Products = -0.336 - Toys and Games = 0.050 | Model weights: - Clothing Shoes and Jewelry = -0.226 - Digital Music = 0.340 - Office Products = 0.390 - Toys and Games = 0.071 | Model weights: - Clothing Shoes and Jewelry = 0.232 - Digital Music = 0.161 - Office Products = -0.202 - Toys and Games = -0.086 | Model weights: - Clothing Shoes and Jewelry = -0.364 - Digital Music = 0.009 - Office Products = -0.238 - Toys and Games = 0.122 | Model weights: - Clothing Shoes and Jewelry = -0.309 - Digital Music = -0.016 - Office Products = 0.266 - Toys and Games = -0.248 | Model weights: - Clothing Shoes and Jewelry = -0.183 - Digital Music = -0.358 - Office Products = 0.502 - Toys and Games = -0.429 | Model weights: - Clothing Shoes and Jewelry = 0.347 - Digital Music = -0.268 - Office Products = -0.473 - Toys and Games = -0.198 |
| Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 4 - Office Products = 1 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 6 - Digital Music = 0 - Office Products = 2 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 5 - Office Products = 0 - Toys and Games = 0 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 8 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 2 - Office Products = 0 - Toys and Games = 3 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 4 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 6 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 9 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 0 - Toys and Games = 9 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 10 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 2 - Office Products = 1 - Toys and Games = 0 - None = 6 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 8 - Office Products = 0 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 8 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 6 - Office Products = 3 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 7 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 5 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 5 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 9 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 4 - Digital Music = 0 - Office Products = 5 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 7 - Office Products = 0 - Toys and Games = 0 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 6 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 5 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 2 - Office Products = 6 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 0 - Toys and Games = 4 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 7 - Toys and Games = 0 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 6 - Toys and Games = 1 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 8 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 2 |
| Summary: - Average score: 0.481 - Rank: C | Summary: - Average score: 0.592 - Rank: B | Summary: - Average score: 0.125 - Rank: C | Summary: - Average score: 0.800 - Rank: A | Summary: - Average score: 0.422 - Rank: C | Summary: - Average score: 0.400 - Rank: C | Summary: - Average score: 0.900 - Rank: A | Summary: - Average score: 0.967 - Rank: A | Summary: - Average score: 0.662 - Rank: B | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.302 - Rank: C | Summary: - Average score: 0.800 - Rank: B | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.800 - Rank: B | Summary: - Average score: 0.893 - Rank: A | Summary: - Average score: 0.541 - Rank: C | Summary: - Average score: 0.534 - Rank: C | Summary: - Average score: 0.500 - Rank: C | Summary: - Average score: 0.900 - Rank: A | Summary: - Average score: 0.808 - Rank: A | Summary: - Average score: 0.700 - Rank: B | Summary: - Average score: 0.600 - Rank: B | Summary: - Average score: 0.500 - Rank: C | Summary: - Average score: 0.784 - Rank: B | Summary: - Average score: 0.837 - Rank: A | Summary: - Average score: 0.477 - Rank: C | Summary: - Average score: 0.751 - Rank: B | Summary: - Average score: 0.608 - Rank: B | Summary: - Average score: 0.800 - Rank: B |
Model 3: AmazonProductsSmall_CNN_20200510192541
| Feature 0 | Feature 1 | Feature 2 | Feature 3 | Feature 4 | Feature 5 | Feature 6 | Feature 7 | Feature 8 | Feature 9 | Feature 10 | Feature 11 | Feature 12 | Feature 13 | Feature 14 | Feature 15 | Feature 16 | Feature 17 | Feature 18 | Feature 19 | Feature 20 | Feature 21 | Feature 22 | Feature 23 | Feature 24 | Feature 25 | Feature 26 | Feature 27 | Feature 28 | Feature 29 |
 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |
| Model weights: - Clothing Shoes and Jewelry = -0.088 - Digital Music = -0.160 - Office Products = 0.255 - Toys and Games = -0.043 | Model weights: - Clothing Shoes and Jewelry = -0.328 - Digital Music = 0.332 - Office Products = 0.327 - Toys and Games = -0.360 | Model weights: - Clothing Shoes and Jewelry = 0.123 - Digital Music = 0.370 - Office Products = 0.211 - Toys and Games = -0.421 | Model weights: - Clothing Shoes and Jewelry = -0.177 - Digital Music = -0.377 - Office Products = 0.294 - Toys and Games = -0.237 | Model weights: - Clothing Shoes and Jewelry = 0.282 - Digital Music = 0.331 - Office Products = -0.318 - Toys and Games = 0.272 | Model weights: - Clothing Shoes and Jewelry = -0.111 - Digital Music = 0.114 - Office Products = -0.272 - Toys and Games = -0.023 | Model weights: - Clothing Shoes and Jewelry = -0.030 - Digital Music = -0.325 - Office Products = 0.120 - Toys and Games = 0.055 | Model weights: - Clothing Shoes and Jewelry = 0.003 - Digital Music = 0.281 - Office Products = -0.291 - Toys and Games = 0.220 | Model weights: - Clothing Shoes and Jewelry = 0.261 - Digital Music = -0.383 - Office Products = 0.404 - Toys and Games = 0.288 | Model weights: - Clothing Shoes and Jewelry = 0.171 - Digital Music = -0.359 - Office Products = -0.131 - Toys and Games = -0.003 | Model weights: - Clothing Shoes and Jewelry = -0.195 - Digital Music = 0.415 - Office Products = 0.122 - Toys and Games = -0.303 | Model weights: - Clothing Shoes and Jewelry = -0.431 - Digital Music = -0.356 - Office Products = 0.338 - Toys and Games = -0.370 | Model weights: - Clothing Shoes and Jewelry = 0.011 - Digital Music = -0.421 - Office Products = -0.387 - Toys and Games = 0.212 | Model weights: - Clothing Shoes and Jewelry = -0.396 - Digital Music = 0.273 - Office Products = 0.161 - Toys and Games = -0.441 | Model weights: - Clothing Shoes and Jewelry = 0.175 - Digital Music = 0.241 - Office Products = 0.197 - Toys and Games = -0.504 | Model weights: - Clothing Shoes and Jewelry = 0.091 - Digital Music = 0.153 - Office Products = 0.411 - Toys and Games = -0.120 | Model weights: - Clothing Shoes and Jewelry = -0.205 - Digital Music = -0.436 - Office Products = 0.338 - Toys and Games = -0.177 | Model weights: - Clothing Shoes and Jewelry = -0.158 - Digital Music = 0.216 - Office Products = -0.022 - Toys and Games = 0.230 | Model weights: - Clothing Shoes and Jewelry = -0.408 - Digital Music = 0.147 - Office Products = 0.249 - Toys and Games = -0.396 | Model weights: - Clothing Shoes and Jewelry = 0.008 - Digital Music = 0.450 - Office Products = -0.329 - Toys and Games = 0.459 | Model weights: - Clothing Shoes and Jewelry = -0.309 - Digital Music = 0.229 - Office Products = 0.246 - Toys and Games = 0.368 | Model weights: - Clothing Shoes and Jewelry = -0.209 - Digital Music = 0.242 - Office Products = -0.208 - Toys and Games = 0.382 | Model weights: - Clothing Shoes and Jewelry = -0.331 - Digital Music = 0.022 - Office Products = 0.030 - Toys and Games = 0.370 | Model weights: - Clothing Shoes and Jewelry = -0.358 - Digital Music = 0.085 - Office Products = -0.369 - Toys and Games = 0.247 | Model weights: - Clothing Shoes and Jewelry = -0.109 - Digital Music = 0.373 - Office Products = -0.129 - Toys and Games = -0.209 | Model weights: - Clothing Shoes and Jewelry = -0.177 - Digital Music = 0.097 - Office Products = -0.427 - Toys and Games = 0.281 | Model weights: - Clothing Shoes and Jewelry = -0.206 - Digital Music = -0.106 - Office Products = 0.222 - Toys and Games = 0.478 | Model weights: - Clothing Shoes and Jewelry = -0.263 - Digital Music = -0.110 - Office Products = 0.123 - Toys and Games = 0.439 | Model weights: - Clothing Shoes and Jewelry = 0.411 - Digital Music = -0.449 - Office Products = -0.321 - Toys and Games = -0.358 | Model weights: - Clothing Shoes and Jewelry = -0.314 - Digital Music = -0.414 - Office Products = -0.289 - Toys and Games = 0.121 |
| Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 9 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 1 - Toys and Games = 0 - None = 9 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 10 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 9 - Office Products = 1 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 2 - Office Products = 0 - Toys and Games = 0 - None = 7 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 5 - Toys and Games = 3 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 7 - Office Products = 0 - Toys and Games = 0 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 2 - Digital Music = 0 - Office Products = 1 - Toys and Games = 0 - None = 7 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 1 - Toys and Games = 0 - None = 9 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 6 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 6 - Digital Music = 0 - Office Products = 0 - Toys and Games = 2 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 4 - Office Products = 0 - Toys and Games = 1 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 5 - Office Products = 0 - Toys and Games = 0 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 4 - Toys and Games = 0 - None = 5 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 10 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 1 - Office Products = 5 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 5 - Office Products = 0 - Toys and Games = 1 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 7 - Toys and Games = 0 - None = 3 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 6 - Office Products = 0 - Toys and Games = 3 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 6 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 6 - Office Products = 0 - Toys and Games = 0 - None = 4 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 10 - Office Products = 0 - Toys and Games = 0 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 9 - Office Products = 0 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 8 - None = 2 | Human answers: - Clothing Shoes and Jewelry = 0 - Digital Music = 0 - Office Products = 0 - Toys and Games = 10 - None = 0 | Human answers: - Clothing Shoes and Jewelry = 9 - Digital Music = 0 - Office Products = 0 - Toys and Games = 0 - None = 1 | Human answers: - Clothing Shoes and Jewelry = 1 - Digital Music = 0 - Office Products = 0 - Toys and Games = 5 - None = 4 |
| Summary: - Average score: 0.917 - Rank: A | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.080 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.900 - Rank: A | Summary: - Average score: 0.242 - Rank: C | Summary: - Average score: 0.823 - Rank: B | Summary: - Average score: 0.700 - Rank: B | Summary: - Average score: 0.263 - Rank: C | Summary: - Average score: 0.043 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.600 - Rank: B | Summary: - Average score: 0.609 - Rank: B | Summary: - Average score: 0.400 - Rank: C | Summary: - Average score: 0.500 - Rank: C | Summary: - Average score: 0.440 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.965 - Rank: A | Summary: - Average score: 0.585 - Rank: B | Summary: - Average score: 0.595 - Rank: B | Summary: - Average score: 0.575 - Rank: C | Summary: - Average score: 0.758 - Rank: B | Summary: - Average score: 0.600 - Rank: B | Summary: - Average score: 0.442 - Rank: C | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.666 - Rank: B | Summary: - Average score: 0.800 - Rank: B | Summary: - Average score: 1.000 - Rank: A | Summary: - Average score: 0.900 - Rank: A | Summary: - Average score: 0.519 - Rank: C |
Results
Results (Average ± SD) of Experiment 1: Amazon Products, CNNs; Boldface numbers are the best scores in the columns. They are further underlined if they are significantly better than the scores of all the other models (based on approximate randomization test with α = 0.05)
Downloads
- Wordclouds and annotations
- The dataset of this experiment as well as other experiments can be downloaded here.
- If you want to use the original trained models in the experiments, please contact Piyawat (pl1515 [at] imperial [dot] ac [dot] uk).