TWiki> F4K Web>CrowdsourcingForEvaluation (18 Jun 2011, Main.jiyinhe_40gmail_2ecom)EditAttach

Crowdsourcing for Evaluation

Tasks

Feature recognition

  • Description
    • Define a set of visual features (e.g., number of fins, strips, spots, head directions, etc.), ask the workers to recognize these features from images (videos)
  • Pre-request
    • Which features are expected to be important?
    • What type of values are expected?

Fish clustering

  • Description
    • The workers group fish with their similarity
    • May provide insights into why some species are very easy to get confused
  • Pre-request

Fish recognition

  • Description
    • The workers are shown a (few) example fish species/family/genius, when seeing a new image, they are asked to tell if the fish in the image belong to the example species. If multiple example species are shown, they need to choose the most likely species.
  • Pre-request
    • Pre-classify the fishes, only list topX most likely species for workers to choose from
    • Which ones are very likely to be confused? Can human identify them?

Ideas

  • Improve fish recognition with high level features
    • Some features are easier to be identified by human compared to automatic methods
    • Can these features be used to improve fish recognition?

Ideas - crazy

  • Shooting game for fish recognition
    • shoot the fish with the target species,
    • paired game, shooting the same target fish gets high scores.

  • Memory game for fish recognition
    • identify the fish with the target species, (memorize examples)
    • paired game, labeling with the same label gets high scores.
    • level up: memorize and identify multiple species simultaneously.

Data

Documents

  • Related information about crowdsourcing, some initial ideas about our tasks ( cs-doc1.pdf)

Action list

06-17-11

  1. Check features from computer vision perspective (Bas)
  2. Check sample image/video (Bas)
  3. Check features from Biologists' perspective - Fishbase, Wikipedia, biologists (Jiyin & Emma)
  4. Draft interface for feature detection task (Jiyin & Emma)

-- Main.jiyinhegmail.com - 17 Jun 2011

Topic attachments
I Attachment Action Size Date Who Comment
pdfpdf cs-doc1.pdf manage 653.1 K 18 Jun 2011 - 19:03 Main.jiyinhe_40gmail_2ecom background information about crowdsourcing, initial ideas
Topic revision: r2 - 18 Jun 2011 - 19:07:04 - Main.jiyinhe_40gmail_2ecom
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
This Wiki uses Cookies