Great Work Labs
Models / Vision

Scout

Object detection
scout-1

Find and count 80 kinds of objects, with boxes.

Price$0.30 per 1,000 images
Speed (our servers)2339 to 2354 ms
LanguagesNot applicable
InputImage, up to 10 MB
Built onfacebook/detr-resnet-50 (Apache-2.0)

Scout finds people, vehicles, animals, furniture, food, electronics and 70 more everyday objects in a photo and returns a box and score for each, plus counts by label.

Filter with labels to count only what you care about: cars in a parking lot, people in a room, bottles on a shelf.

Use it

curl https://labs.greatwork.company/v1/run \
  -H "Authorization: Bearer $GWL_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "scout-1",
  "input": "https://labs.greatwork.company/examples/street.jpg"
}'

Set GWL_API_KEY to a key from your dashboard. The bare name scout works too and follows new versions.

Options

input: An image: an https URL, a data URL (`data:image/png;base64,...`), or a file in a multipart upload. JPEG, PNG, WebP, GIF, AVIF or TIFF, up to 10 MB.

NameTypeDefaultWhat it does
thresholdnumber0.7Score at or above which an object is returned.
labelsstring[]Only return these labels (COCO names like person, car, dog, bottle).

Output

FieldTypeMeaning
objectsobject[]label, score, box {x, y, width, height} in pixels, best first.
countsobjectObjects per label.

Every response wraps this in {"id", "model", "output", "usage": {"units", "unit", "cost_usd"}, "latency_ms"}.

Examples

Street

{
  "model": "scout-1",
  "input": "/examples/street.jpg"
}
{
  "objects": [
    {
      "label": "car",
      "score": 0.9993,
      "box": {
        "x": 633,
        "y": 512,
        "width": 413,
        "height": 150
      }
    },
    {
      "label": "dog",
      "score": 0.9991,
      "box": {
        "x": 330,
        "y": 600,
        "width": 97,
        "height": 76
      }
    },
    {
      "label": "person",
      "score": 0.9985,
      "box": {
        "x": 162,
        "y": 480,
        "width": 97,
        "height": 202
      }
    },
    {
      "label": "car",
      "score": 0.9984,
      "box": {
        "x": 506,
        "y": 519,
        "width": 265,
        "height": 126
      }
    },
    {
      "label": "person",
      "score": 0.9971,
      "box": {
        "x": 256,
        "y": 520,
        "width": 63,
        "height": 160
      }
    },
    {
      "label": "person",
      "score": 0.9968,
      "box": {
        "x": 425,
        "y": 468,
        "width": 59,
        "height": 185
      }
    },
    {
      "label": "person",
      "score": 0.9965,
      "box": {
        "x": 575,
        "y": 480,
        "width": 95,
        "height": 187
      }
    },
    {
      "label": "person",
      "score": 0.9953,
      "box": {
        "x": 495,
        "y": 479,
        "width": 50,
        "height": 135
      }
    },
    {
      "label": "person",
      "score": 0.9951,
      "box": {
        "x": 84,
        "y": 470,
        "width": 91,
        "height": 205
      }
    },
    {
      "label": "bicycle",
      "score": 0.9951,
      "box": {
        "x": 550,
        "y": 563,
        "width": 130,
        "height": 141
      }
    },
    {
      "label": "car",
      "score": 0.9855,
      "box": {
        "x": 938,
        "y": 493,
        "width": 96,
        "height": 70
      }
    },
    {
      "label": "person",
      "score": 0.982,
      "box": {
        "x": 0,
        "y": 393,
        "width": 41,
        "height": 194
      }
    },
    {
      "label": "person",
      "score": 0.975,
      "box": {
        "x": 399,
        "y": 488,
        "width": 47,
        "height": 134
      }
    },
    {
      "label": "person",
      "score": 0.9657,
      "box": {
        "x": 567,
        "y": 494,
        "width": 42,
        "height": 77
      }
    },
    {
      "label": "umbrella",
      "score": 0.9518,
      "box": {
        "x": 718,
        "y": 455,
        "width": 164,
        "height": 37
      }
    },
    {
      "label": "person",
      "score": 0.9254,
      "box": {
        "x": 737,
        "y": 484,
        "width": 30,
        "height": 55
      }
    },
    {
      "label": "backpack",
      "score": 0.8771,
      "box": {
        "x": 444,
        "y": 501,
        "width": 36,
        "height": 55
      }
    },
    {
      "label": "person",
      "score": 0.8596,
      "box": {
        "x": 769,
        "y": 493,
        "width": 25,
        "height": 44
      }
    },
    {
      "label": "person",
      "score": 0.8228,
      "box": {
        "x": 805,
        "y": 497,
        "width": 26,
        "height": 32
      }
    },
    {
      "label": "car",
      "score": 0.8076,
      "box": {
        "x": 941,
        "y": 484,
        "width": 94,
        "height": 31
      }
    },
    {
      "label": "person",
      "score": 0.794,
      "box": {
        "x": 785,
        "y": 494,
        "width": 24,
        "height": 39
      }
    },
    {
      "label": "umbrella",
      "score": 0.7676,
      "box": {
        "x": 722,
        "y": 450,
        "width": 155,
        "height": 81
      }
    },
    {
      "label": "person",
      "score": 0.7632,
      "box": {
        "x": 810,
        "y": 495,
        "width": 26,
        "height": 32
      }
    },
    {
      "label": "backpack",
      "score": 0.7459,
      "box": {
        "x": 625,
        "y": 517,
        "width": 49,
        "height": 65
      }
    }
  ],
  "counts": {
    "car": 4,
    "dog": 1,
    "person": 14,
    "bicycle": 1,
    "umbrella": 2,
    "backpack": 2
  },
  "width": 1024,
  "height": 1024
}

Captured on our production servers: 2339 ms, 1 image, $0.0003.

Only people

{
  "model": "scout-1",
  "input": "/examples/street.jpg",
  "labels": [
    "person"
  ],
  "threshold": 0.6
}
{
  "objects": [
    {
      "label": "person",
      "score": 0.9985,
      "box": {
        "x": 162,
        "y": 480,
        "width": 97,
        "height": 202
      }
    },
    {
      "label": "person",
      "score": 0.9971,
      "box": {
        "x": 256,
        "y": 520,
        "width": 63,
        "height": 160
      }
    },
    {
      "label": "person",
      "score": 0.9968,
      "box": {
        "x": 425,
        "y": 468,
        "width": 59,
        "height": 185
      }
    },
    {
      "label": "person",
      "score": 0.9965,
      "box": {
        "x": 575,
        "y": 480,
        "width": 95,
        "height": 187
      }
    },
    {
      "label": "person",
      "score": 0.9953,
      "box": {
        "x": 495,
        "y": 479,
        "width": 50,
        "height": 135
      }
    },
    {
      "label": "person",
      "score": 0.9951,
      "box": {
        "x": 84,
        "y": 470,
        "width": 91,
        "height": 205
      }
    },
    {
      "label": "person",
      "score": 0.982,
      "box": {
        "x": 0,
        "y": 393,
        "width": 41,
        "height": 194
      }
    },
    {
      "label": "person",
      "score": 0.975,
      "box": {
        "x": 399,
        "y": 488,
        "width": 47,
        "height": 134
      }
    },
    {
      "label": "person",
      "score": 0.9657,
      "box": {
        "x": 567,
        "y": 494,
        "width": 42,
        "height": 77
      }
    },
    {
      "label": "person",
      "score": 0.9254,
      "box": {
        "x": 737,
        "y": 484,
        "width": 30,
        "height": 55
      }
    },
    {
      "label": "person",
      "score": 0.8596,
      "box": {
        "x": 769,
        "y": 493,
        "width": 25,
        "height": 44
      }
    },
    {
      "label": "person",
      "score": 0.8228,
      "box": {
        "x": 805,
        "y": 497,
        "width": 26,
        "height": 32
      }
    },
    {
      "label": "person",
      "score": 0.794,
      "box": {
        "x": 785,
        "y": 494,
        "width": 24,
        "height": 39
      }
    },
    {
      "label": "person",
      "score": 0.7632,
      "box": {
        "x": 810,
        "y": 495,
        "width": 26,
        "height": 32
      }
    },
    {
      "label": "person",
      "score": 0.6189,
      "box": {
        "x": 927,
        "y": 488,
        "width": 26,
        "height": 28
      }
    }
  ],
  "counts": {
    "person": 15
  },
  "width": 1024,
  "height": 1024
}

Captured on our production servers: 2354 ms, 1 image, $0.0003.

Good for

  • Count people or cars in camera stills
  • Check a product photo shows the product
  • Auto-crop around the main subject
  • Pre-label images for a dataset

Limits and caveats

  • The 80 COCO categories only (no logos, faces or custom objects).
  • Small objects in big photos are often missed.

Pricing

$0.30 per 1,000 images. One unit per image. Failed calls aren't charged, and a call never costs more than its estimate (POST /v1/estimate tells you before you run it).

Built on

facebook/detr-resnet-50, 41M parameters. License: Apache-2.0. We run it on our servers.