TOPBOTS Vision API Benchmarking
How well do the different popular vision APIs perform? Let's find out!
Results Summary
On Sep 22, 2017, 16 images were processed across 6 vendors: rekognition, msft, ibm, google, cloudsight, clarifai.
A thumbnail of each image is displayed (click to see it fullsize) along with results from each computer vision API vendor.
Statistics on response times and more are at the bottom of the page.
test1.png
| rekognition | View raw json (.54s) |
| rekognition_tags | Bread (.78) , Dessert (.78) , Food (.78) , Muffin (.78) , Cake (.69) |
| msft | View raw json (2.98s) |
| msft_captions | a close up of a stuffed animal (.65) |
| msft_tags | indoor (.88) , bread (.33) |
| ibm | View raw json (1.03s) |
| ibm_tags | light brown color (.96) , bread (.92) , food product (.92) , food (.92) , quick bread (.80) , bun (.65) , sweet roll (.65) , danish (.64) , scone (.62) , drop scone (.50) |
| View raw json (.84s) | |
| google_tags | muffin (.89) , baked goods (.81) , food (.79) , baking (.78) , dessert (.66) , blueberry (.60) , recipe (.54) |
| cloudsight | View raw json (12.46s) |
| cloudsight_captions | cooked cookies |
| clarifai | View raw json (1.76s) |
| clarifai_tags | sweet (1.00) , pastry (1.00) , cake (1.00) , homemade (1.00) , sugar (1.00) , blueberry (1.00) , food (1.00) , bakery (.99) , refreshment (.99) , delicious (.99) , breakfast (.99) , chocolate (.99) , baking (.99) , pie (.99) , fruit (.99) , cookie (.99) , goody (.98) , plate (.98) , muffin (.98) , indulgence (.97) |
test10.png
| rekognition | View raw json (1.53s) |
| rekognition_tags | Dessert (.60) , Food (.60) , Bread (.56) , Muffin (.56) |
| msft | View raw json (1.37s) |
| msft_captions | a close up of food (.90) |
| msft_tags | bread (.32) |
| ibm | View raw json (1.97s) |
| ibm_tags | light brown color (.89) , orange color (.88) , medlar fruit (.50) , fruit (.50) , insect (.50) , invertebrate (.50) , animal (.50) , fruit fly (.50) , Mediterranean fruit fly (.50) |
| View raw json (.99s) | |
| google_tags | snout (.62) , dog breed group (.58) |
| cloudsight | View raw json (8.90s) |
| cloudsight_captions | error_skipped_because_blurry |
| clarifai | View raw json (3.57s) |
| clarifai_tags | sweet (.99) , no person (.99) , food (.98) , desktop (.98) , nature (.97) , pastry (.96) , fruit (.96) , closeup (.96) , confection (.95) , color (.94) , little (.94) , refreshment (.92) , biology (.91) , delicious (.90) , sugar (.89) , cake (.88) , pie (.88) , horizontal (.87) , summer (.86) , healthy (.86) |
test11.png
| rekognition | View raw json (.57s) |
| rekognition_tags | Bread (.93) , Dessert (.93) , Food (.93) , Muffin (.93) , Cookie (.62) |
| msft | View raw json (2.75s) |
| msft_captions | a close up of a stuffed animal (.55) |
| msft_tags | indoor (.94) , food (.87) , bread (.74) , dessert (.30) |
| ibm | View raw json (1.98s) |
| ibm_tags | light brown color (.90) , quick bread (.82) , bread (.82) , food product (.82) , food (.82) , scone (.76) , fruit (.73) , raisin (.73) , dried fruit (.73) , bran muffin (.50) |
| View raw json (.96s) | |
| google_tags | muffin (.92) , food (.80) , baking (.76) , baked goods (.70) , dessert (.65) , blueberry (.61) , recipe (.57) |
| cloudsight | View raw json (8.86s) |
| cloudsight_captions | error_skipped_because_close |
| clarifai | View raw json (1.74s) |
| clarifai_tags | sweet (1.00) , homemade (.99) , food (.98) , delicious (.98) , sugar (.98) , refreshment (.98) , chocolate (.97) , muffin (.95) , cookie (.95) , pastry (.95) , cake (.95) , no person (.94) , breakfast (.94) , blueberry (.93) , unhealthy (.93) , baking (.92) , bakery (.92) , indulgence (.91) , fruit (.91) , gold (.90) |
test12.png
| rekognition | View raw json (.53s) |
| rekognition_tags | Animal (.96) , Canine (.96) , Chihuahua (.96) , Dog (.96) , Mammal (.96) , Pet (.96) , Pug (.69) |
| msft | View raw json (2.32s) |
| msft_captions | a brown and white dog looking at the camera (.89) |
| msft_tags | dog (1.00) , indoor (.99) , brown (.94) , mammal (.89) , looking (.86) , animal (.85) , eyes (.57) , cute (.54) , posing (.50) , staring (.35) , close (.25) |
| ibm | View raw json (1.28s) |
| ibm_tags | light brown color (.95) , animal (.81) , canine (.80) , carnivore (.80) , mammal (.80) , dog (.79) |
| View raw json (.99s) | |
| google_tags | dog (.97) , dog like mammal (.94) , dog breed (.94) , dog breed group (.92) , nose (.89) , snout (.81) , eye (.76) , carnivoran (.64) , dog crossbreeds (.63) , companion dog (.60) |
| cloudsight | View raw json (24.04s) |
| cloudsight_captions | closeup photo of fawn smooth Chihuahua |
| clarifai | View raw json (1.79s) |
| clarifai_tags | dog (1.00) , canine (1.00) , animal (1.00) , mammal (1.00) , cute (1.00) , pet (.99) , puppy (.99) , portrait (.99) , breed (.97) , adorable (.97) , little (.96) , looking (.96) , purebred (.95) , snout (.95) , pedigree (.95) , domestic (.94) , whelp (.92) , studio (.92) , fur (.90) , friendship (.90) |
test13.png
| rekognition | View raw json (.59s) |
| rekognition_tags | Cookie (.89) , Food (.89) , Bread (.55) , Dessert (.55) , Muffin (.55) |
| msft | View raw json (2.00s) |
| msft_captions | a brown and white teddy bear (.69) |
| msft_tags | |
| ibm | View raw json (.95s) |
| ibm_tags | light brown color (.99) , quick bread (.94) , bread (.94) , food product (.94) , food (.94) , scone (.89) , drop scone (.54) , fruit (.50) , raisin (.50) , dried fruit (.50) |
| View raw json (1.04s) | |
| google_tags | muffin (.78) , baked goods (.76) , food (.74) , snout (.70) , baking (.57) , recipe (.51) , chocolate chip (.50) |
| cloudsight | View raw json (11.94s) |
| cloudsight_captions | brown cookie on white surface |
| clarifai | View raw json (1.75s) |
| clarifai_tags | sweet (1.00) , refreshment (.99) , food (.99) , homemade (.99) , breakfast (.98) , pastry (.98) , delicious (.97) , little (.97) , sugar (.97) , chocolate (.96) , bakery (.96) , cookie (.96) , no person (.95) , raisin (.93) , cup (.92) , closeup (.92) , cake (.91) , confection (.91) , goody (.91) , baking (.90) |
test14.png
| rekognition | View raw json (.56s) |
| rekognition_tags | Animal (.99) , Canine (.99) , Chihuahua (.99) , Dog (.99) , Mammal (.99) , Pet (.99) |
| msft | View raw json (2.22s) |
| msft_captions | a brown and white dog looking at the camera (.82) |
| msft_tags | dog (1.00) , brown (.99) , indoor (.99) , sitting (.96) , yellow (.89) , mammal (.80) , posing (.60) , cute (.58) , eyes (.34) , staring (.33) , tan (.23) |
| ibm | View raw json (1.94s) |
| ibm_tags | animal (.93) , dog (.90) , domestic animal (.90) , small dog (.90) , light brown color (.88) , tan color (.84) , Chihuahua dog (.61) , young (.50) , pup (.50) |
| View raw json (1.05s) | |
| google_tags | dog (.97) , dog like mammal (.96) , dog breed (.94) , dog breed group (.90) , chihuahua (.88) , snout (.78) , carnivoran (.74) , puppy (.63) , toy dog (.62) , companion dog (.60) |
| cloudsight | View raw json (14.51s) |
| cloudsight_captions | close up photo shot of brown chihuahua |
| clarifai | View raw json (1.65s) |
| clarifai_tags | cute (1.00) , little (1.00) , dog (1.00) , mammal (.99) , animal (.99) , portrait (.99) , canine (.99) , looking (.98) , young (.96) , eye (.96) , pet (.96) , funny (.96) , adorable (.96) , puppy (.95) , fur (.94) , one (.93) , snout (.92) , face (.91) , whelp (.91) , studio (.90) |
test15.png
| rekognition | View raw json (.51s) |
| rekognition_tags | Animal (.98) , Canine (.98) , Chihuahua (.98) , Dog (.98) , Mammal (.98) , Pet (.98) , Puppy (.54) |
| msft | View raw json (1.13s) |
| msft_captions | a brown and white dog looking at the camera (.87) |
| msft_tags | dog (1.00) , mammal (.96) , indoor (.96) , animal (.94) , white (.90) , looking (.81) , close (.21) , staring (.18) |
| ibm | View raw json (.99s) |
| ibm_tags | dog (.96) , domestic animal (.96) , animal (.96) , small dog (.96) , Chihuahua dog (.92) , light brown color (.77) , ivory color (.70) |
| View raw json (1.05s) | |
| google_tags | dog (.97) , dog like mammal (.96) , dog breed (.94) , skin (.93) , dog breed group (.91) , chihuahua (.90) , snout (.79) , puppy (.76) , carnivoran (.71) , toy dog (.65) |
| cloudsight | View raw json (10.13s) |
| cloudsight_captions | white chihuahua |
| clarifai | View raw json (1.59s) |
| clarifai_tags | cute (1.00) , dog (1.00) , animal (1.00) , canine (.99) , mammal (.99) , little (.99) , pet (.99) , puppy (.99) , portrait (.98) , looking (.97) , young (.95) , fur (.94) , eye (.94) , whelp (.93) , adorable (.91) , domestic (.91) , snout (.90) , funny (.89) , sit (.88) , friendship (.88) |
test16.png
| rekognition | View raw json (.62s) |
| rekognition_tags | Bread (.99) , Dessert (.99) , Food (.99) , Muffin (.99) |
| msft | View raw json (1.30s) |
| msft_captions | a close up of food (.51) |
| msft_tags | bread (.59) |
| ibm | View raw json (1.01s) |
| ibm_tags | light brown color (1.00) , quick bread (.99) , bread (.99) , food product (.99) , food (.99) , bran muffin (.92) , muffin (.68) , Irish soda bread (.50) |
| View raw json (1.01s) | |
| google_tags | muffin (.92) , baked goods (.78) , food (.76) , blueberry (.71) , baking (.66) , dessert (.58) , recipe (.51) |
| cloudsight | View raw json (7.44s) |
| cloudsight_captions | cupckae |
| clarifai | View raw json (1.62s) |
| clarifai_tags | sweet (.99) , food (.99) , bakery (.97) , cake (.97) , delicious (.97) , pastry (.96) , desktop (.96) , muffin (.95) , sugar (.94) , refreshment (.94) , homemade (.94) , no person (.93) , wood (.92) , family (.91) , chocolate (.90) , breakfast (.90) , decoration (.89) , temptation (.88) , wooden (.88) , epicure (.87) |
test2.png
| rekognition | View raw json (.54s) |
| rekognition_tags | Animal (.98) , Canine (.98) , Chihuahua (.98) , Dog (.98) , Mammal (.98) , Pet (.98) |
| msft | View raw json (2.29s) |
| msft_captions | a brown and white dog looking at the camera (.81) |
| msft_tags | indoor (1.00) , dog (1.00) , looking (.93) , mammal (.91) , animal (.81) , staring (.53) |
| ibm | View raw json (.98s) |
| ibm_tags | light brown color (.98) , animal (.84) , dog (.77) , mammal (.72) , carnivore (.72) , canine (.72) , young (.53) , pup (.53) , domestic animal (.51) , puppy (.50) |
| View raw json (1.08s) | |
| google_tags | dog (.97) , dog like mammal (.96) , dog breed (.94) , dog breed group (.91) , nose (.89) , snout (.83) , puppy (.78) , carnivoran (.71) , dog crossbreeds (.68) , chihuahua (.65) |
| cloudsight | View raw json (15.91s) |
| cloudsight_captions | closed photography of Chihuahua |
| clarifai | View raw json (2.89s) |
| clarifai_tags | dog (1.00) , cute (1.00) , animal (.99) , mammal (.99) , canine (.99) , pet (.98) , little (.98) , portrait (.96) , looking (.96) , puppy (.95) , fur (.90) , one (.89) , domestic (.87) , sit (.85) , snout (.84) , nature (.84) , eye (.83) , adorable (.83) , curiosity (.81) , funny (.80) |
test3.png
| rekognition | View raw json (1.50s) |
| rekognition_tags | Bread (.76) , Dessert (.76) , Food (.76) , Muffin (.76) , Cookie (.58) , Cake (.52) , Pie (.52) , Tart (.52) , Cream (.51) , Creme (.51) |
| msft | View raw json (1.26s) |
| msft_captions | a close up of a doughnut (.59) |
| msft_tags | food (.89) , indoor (.86) , dessert (.31) , cream (.12) |
| ibm | View raw json (1.02s) |
| ibm_tags | light brown color (.99) , food (.92) , food product (.86) , quick bread (.82) , bread (.82) , drop scone (.71) , cobbler (.61) , highball (.61) , mixed drink (.61) , alcoholic beverage (.61) , beverage (.61) , scone (.59) , mincemeat (.50) |
| View raw json (1.01s) | |
| google_tags | muffin (.89) , mince pie (.80) , food (.79) , baked goods (.74) , blueberry pie (.70) , dessert (.68) , baking (.67) , blueberry (.63) , cherry pie (.62) , blackberry pie (.55) |
| cloudsight | View raw json (23.41s) |
| cloudsight_captions | cupcake close up photo |
| clarifai | View raw json (1.52s) |
| clarifai_tags | sweet (1.00) , pastry (1.00) , cake (1.00) , food (1.00) , refreshment (.99) , delicious (.99) , bakery (.99) , fruit (.99) , plate (.99) , pie (.99) , sugar (.98) , blueberry (.98) , epicure (.98) , tasty (.98) , homemade (.98) , muffin (.97) , breakfast (.97) , closeup (.96) , meal (.95) , freshness (.95) |
test4.png
| rekognition | View raw json (.66s) |
| rekognition_tags | Animal (.84) , Canine (.84) , Chihuahua (.84) , Dog (.84) , Mammal (.84) , Pet (.84) |
| msft | View raw json (2.42s) |
| msft_captions | a small brown and white dog (.92) |
| msft_tags | dog (1.00) , indoor (1.00) , brown (.99) , sitting (.98) , laying (.60) |
| ibm | View raw json (.98s) |
| ibm_tags | small dog (1.00) , dog (1.00) , domestic animal (1.00) , animal (1.00) , Chihuahua dog (1.00) , tan color (.74) , ivory color (.73) |
| View raw json (1.15s) | |
| google_tags | dog (.97) , dog like mammal (.97) , chihuahua (.95) , dog breed (.94) , dog breed group (.91) , carnivoran (.77) , puppy (.73) , toy dog (.70) , snout (.68) , companion dog (.60) |
| cloudsight | View raw json (13.93s) |
| cloudsight_captions | three brown Chihuahua |
| clarifai | View raw json (1.69s) |
| clarifai_tags | cute (1.00) , dog (1.00) , little (1.00) , canine (1.00) , animal (1.00) , puppy (1.00) , mammal (1.00) , whelp (.99) , sit (.99) , pet (.99) , portrait (.99) , looking (.99) , adorable (.99) , studio (.98) , purebred (.98) , tiny (.98) , carnivore (.98) , pedigree (.97) , friendship (.97) , fur (.97) |
test5.png
| rekognition | View raw json (.58s) |
| rekognition_tags | Bread (.99) , Dessert (.99) , Food (.99) , Muffin (.99) |
| msft | View raw json (2.51s) |
| msft_captions | a close up of food (.92) |
| msft_tags | food (.84) , bread (.42) |
| ibm | View raw json (1.30s) |
| ibm_tags | light brown color (1.00) , quick bread (.96) , bread (.96) , food product (.96) , food (.96) , bran muffin (.71) , muffin (.58) , corn muffin (.55) |
| View raw json (1.02s) | |
| google_tags | muffin (.93) , baked goods (.88) , food (.83) , dessert (.83) , baking (.79) , blueberry (.54) , recipe (.53) |
| cloudsight | View raw json (12.05s) |
| cloudsight_captions | cooked cupcakes on tray |
| clarifai | View raw json (1.62s) |
| clarifai_tags | sweet (.99) , food (.99) , delicious (.98) , breakfast (.98) , sugar (.98) , chocolate (.97) , homemade (.97) , no person (.96) , refreshment (.96) , cake (.96) , traditional (.96) , muffin (.96) , baking (.95) , unhealthy (.94) , bakery (.94) , Easter (.93) , pastry (.93) , confection (.91) , raisin (.90) , indulgence (.90) |
test6.png
| rekognition | View raw json (.56s) |
| rekognition_tags | Animal (.99) , Canine (.99) , Chihuahua (.99) , Dog (.99) , Mammal (.99) , Pet (.99) |
| msft | View raw json (1.62s) |
| msft_captions | a close up of a dog head posing for the camera (.96) |
| msft_tags | dog (1.00) , brown (1.00) , indoor (1.00) , looking (.99) , sitting (.99) , animal (.97) , mammal (.96) , cute (.79) , head (.78) , tan (.70) , yellow (.65) , sticking (.62) , staring (.58) , posing (.54) , distance (.33) , eyes (.30) |
| ibm | View raw json (.99s) |
| ibm_tags | light brown color (.95) , dog (.93) , domestic animal (.93) , animal (.93) , small dog (.90) , Chihuahua dog (.81) , tan color (.75) , Pomeranian (.50) |
| View raw json (1.07s) | |
| google_tags | dog (.97) , dog like mammal (.96) , dog breed (.94) , dog breed group (.90) , snout (.77) , chihuahua (.74) , puppy (.71) , carnivoran (.70) , companion dog (.60) , toy dog (.56) |
| cloudsight | View raw json (13.32s) |
| cloudsight_captions | brown Chihuahua screenshot |
| clarifai | View raw json (1.65s) |
| clarifai_tags | cute (1.00) , dog (1.00) , animal (1.00) , canine (.99) , little (.99) , mammal (.99) , puppy (.99) , pet (.99) , adorable (.97) , fur (.96) , looking (.96) , funny (.96) , sit (.96) , young (.96) , portrait (.95) , miniature (.95) , domestic (.93) , tiny (.93) , purebred (.92) , downy (.91) |
test7.png
| rekognition | View raw json (1.59s) |
| rekognition_tags | Animal (.90) , Canine (.90) , Chihuahua (.90) , Dog (.90) , Mammal (.90) , Pet (.90) |
| msft | View raw json (1.28s) |
| msft_captions | a little dog looking at the camera (.85) |
| msft_tags | dog (1.00) , animal (1.00) , mammal (1.00) , indoor (.99) , sitting (.95) , brown (.88) , little (.80) , staring (.17) , tan (.13) |
| ibm | View raw json (1.05s) |
| ibm_tags | animal (1.00) , small dog (.97) , dog (.97) , domestic animal (.97) , Chihuahua dog (.97) , tan color (.79) , mammal (.75) , light brown color (.69) , potto (primate) (.52) , honey bear (.50) , carnivore (.50) |
| View raw json (1.06s) | |
| google_tags | dog (.97) , dog like mammal (.96) , dog breed (.94) , chihuahua (.92) , dog breed group (.87) , snout (.74) , carnivoran (.71) , puppy (.68) , toy dog (.65) , companion dog (.60) |
| cloudsight | View raw json (23.96s) |
| cloudsight_captions | close up photo of apple head Chihuahua |
| clarifai | View raw json (2.58s) |
| clarifai_tags | animal (1.00) , cute (1.00) , mammal (1.00) , little (.99) , dog (.99) , portrait (.99) , canine (.98) , nature (.97) , pet (.96) , looking (.95) , eye (.95) , snout (.95) , young (.93) , adorable (.93) , fur (.93) , puppy (.93) , face (.93) , wildlife (.91) , hair (.89) , one (.89) |
test8.png
| rekognition | View raw json (1.51s) |
| rekognition_tags | Bread (.92) , Dessert (.92) , Food (.92) , Muffin (.92) , Cake (.81) |
| msft | View raw json (2.40s) |
| msft_captions | a close up of an animal (.81) |
| msft_tags | animal (.94) , indoor (.89) |
| ibm | View raw json (.98s) |
| ibm_tags | light brown color (.95) , bread (.88) , food product (.88) , food (.88) , quick bread (.76) , muffin (.67) , raisin bread (.60) , cinnamon bread (.52) , bran muffin (.50) |
| View raw json (1.17s) | |
| google_tags | muffin (.91) , dessert (.81) , food (.80) , baking (.70) , snout (.65) , baked goods (.62) , recipe (.52) , blueberry (.51) , cupcake (.51) |
| cloudsight | View raw json (8.05s) |
| cloudsight_captions | brown cup cake |
| clarifai | View raw json (1.71s) |
| clarifai_tags | cute (1.00) , dog (.99) , little (.98) , animal (.98) , sweet (.95) , mammal (.95) , puppy (.94) , nature (.91) , pet (.90) , adorable (.89) , fur (.89) , looking (.88) , no person (.86) , friendship (.84) , canine (.83) , funny (.80) , tiny (.79) , pastry (.79) , desktop (.79) , miniature (.79) |
test9.png
| rekognition | View raw json (.54s) |
| rekognition_tags | Animal (.98) , Canine (.98) , Chihuahua (.98) , Dog (.98) , Mammal (.98) , Pet (.98) |
| msft | View raw json (1.29s) |
| msft_captions | a brown and white dog looking at the camera (.89) |
| msft_tags | dog (1.00) , brown (1.00) , indoor (.99) , sitting (.95) , looking (.94) , animal (.91) , mammal (.86) , cute (.67) , laying (.63) , posing (.63) , staring (.46) , tan (.42) , close (.27) , distance (.14) |
| ibm | View raw json (1.06s) |
| ibm_tags | light brown color (.99) , animal (.89) , domestic animal (.85) , dog (.79) , small dog (.78) , Chihuahua dog (.74) , head of animal (.57) , young (.51) , doghouse (.50) , building (.50) , pup (.50) |
| View raw json (1.09s) | |
| google_tags | dog (.98) , dog like mammal (.96) , dog breed (.94) , dog breed group (.91) , nose (.88) , snout (.81) , dog crossbreeds (.68) , carnivoran (.67) , companion dog (.60) , whiskers (.59) |
| cloudsight | View raw json (20.28s) |
| cloudsight_captions | deer head brown Chihuahua |
| clarifai | View raw json (2.53s) |
| clarifai_tags | dog (1.00) , canine (1.00) , pet (1.00) , animal (1.00) , cute (1.00) , puppy (1.00) , mammal (.99) , portrait (.99) , breed (.99) , little (.98) , adorable (.98) , domestic (.98) , looking (.98) , purebred (.97) , pedigree (.97) , friendship (.95) , studio (.94) , whelp (.94) , terrier (.93) , young (.93) |
Stats
On time taken, and number of tags returned. Note that Cloudsight returns captions, not a list of tags, so those counts appear as zero.
| Vendor | mean_response_time | stdev_response_time | mean_tags_count | stdev_tags_count |
| 1.04 | 0.07 | 8.50 | 2.15 | |
| ibm | 1.22 | 0.37 | 9.12 | 1.73 |
| rekognition | 0.81 | 0.42 | 5.75 | 1.44 |
| clarifai | 1.98 | 0.57 | 20.00 | 0.00 |
| cloudsight | 14.32 | 5.52 | 0.00 | 0.00 |
| msft | 1.95 | 0.59 | 6.00 | 4.81 |